-- Logs begin at Fri 2022-04-08 10:08:17 UTC, end at Fri 2022-04-08 12:11:52 UTC. -- Apr 08 11:04:56.810427 dv-cinder-836074-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 08 11:04:56.820005 dv-cinder-836074-3-iscsi devstack@n-api.service[103376]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 08 11:04:56.822025 dv-cinder-836074-3-iscsi devstack@n-api.service[103376]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Apr 8 11:04:56 2022] *** Apr 08 11:04:56.822025 dv-cinder-836074-3-iscsi devstack@n-api.service[103376]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 08 11:04:56.822025 dv-cinder-836074-3-iscsi devstack@n-api.service[103376]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 08 11:04:56.822025 dv-cinder-836074-3-iscsi devstack@n-api.service[103376]: nodename: dv-cinder-836074-3-iscsi Apr 08 11:04:56.822025 dv-cinder-836074-3-iscsi devstack@n-api.service[103376]: machine: x86_64 Apr 08 11:04:56.822025 dv-cinder-836074-3-iscsi devstack@n-api.service[103376]: clock source: unix Apr 08 11:04:56.822025 dv-cinder-836074-3-iscsi devstack@n-api.service[103376]: pcre jit disabled Apr 08 11:04:56.822025 dv-cinder-836074-3-iscsi devstack@n-api.service[103376]: detected number of CPU cores: 4 Apr 08 11:04:56.822025 dv-cinder-836074-3-iscsi devstack@n-api.service[103376]: current working directory: / Apr 08 11:04:56.822025 dv-cinder-836074-3-iscsi devstack@n-api.service[103376]: detected binary path: /usr/bin/uwsgi-core Apr 08 11:04:56.822025 dv-cinder-836074-3-iscsi devstack@n-api.service[103376]: your processes number limit is 47680 Apr 08 11:04:56.822025 dv-cinder-836074-3-iscsi devstack@n-api.service[103376]: your memory page size is 4096 bytes Apr 08 11:04:56.822878 dv-cinder-836074-3-iscsi devstack@n-api.service[103376]: detected max file descriptor number: 2048 Apr 08 11:04:56.822878 dv-cinder-836074-3-iscsi devstack@n-api.service[103376]: lock engine: pthread robust mutexes Apr 08 11:04:56.822878 dv-cinder-836074-3-iscsi devstack@n-api.service[103376]: thunder lock: enabled Apr 08 11:04:56.822878 dv-cinder-836074-3-iscsi devstack@n-api.service[103376]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 08 11:04:56.822878 dv-cinder-836074-3-iscsi devstack@n-api.service[103376]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 08 11:04:56.867426 dv-cinder-836074-3-iscsi devstack@n-api.service[103376]: Python main interpreter initialized at 0x55adc6b0c9c0 Apr 08 11:04:56.867426 dv-cinder-836074-3-iscsi devstack@n-api.service[103376]: python threads support enabled Apr 08 11:04:56.867426 dv-cinder-836074-3-iscsi devstack@n-api.service[103376]: your server socket listen backlog is limited to 100 connections Apr 08 11:04:56.867426 dv-cinder-836074-3-iscsi devstack@n-api.service[103376]: your mercy for graceful operations on workers is 90 seconds Apr 08 11:04:56.867793 dv-cinder-836074-3-iscsi devstack@n-api.service[103376]: mapped 403077 bytes (393 KB) for 2 cores Apr 08 11:04:56.867859 dv-cinder-836074-3-iscsi devstack@n-api.service[103376]: *** Operational MODE: preforking *** Apr 08 11:04:56.868120 dv-cinder-836074-3-iscsi devstack@n-api.service[103376]: *** uWSGI is running in multiple interpreter mode *** Apr 08 11:04:56.868120 dv-cinder-836074-3-iscsi devstack@n-api.service[103376]: spawned uWSGI master process (pid: 103376) Apr 08 11:04:56.868321 dv-cinder-836074-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 08 11:04:56.868880 dv-cinder-836074-3-iscsi devstack@n-api.service[103376]: spawned uWSGI worker 1 (pid: 103377, cores: 1) Apr 08 11:04:56.871804 dv-cinder-836074-3-iscsi devstack@n-api.service[103376]: spawned uWSGI worker 2 (pid: 103378, cores: 1) Apr 08 11:04:56.871804 dv-cinder-836074-3-iscsi devstack@n-api.service[103376]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 08 11:04:58.082342 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 08 11:04:58.085294 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 08 11:04:58.964284 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 08 11:04:58.964284 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: from cryptography.utils import int_from_bytes Apr 08 11:04:58.964568 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 08 11:04:58.964568 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: from cryptography.utils import int_from_bytes Apr 08 11:04:58.982675 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 08 11:04:58.982675 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: from cryptography.utils import int_from_bytes Apr 08 11:04:58.983042 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 08 11:04:58.983042 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: from cryptography.utils import int_from_bytes Apr 08 11:05:01.546282 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 08 11:05:01.546995 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 08 11:05:01.547092 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 08 11:05:01.547412 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 08 11:05:01.547664 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 08 11:05:01.548057 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.548372 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.548690 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.549003 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.549335 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.549648 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.549987 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.550302 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.550626 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.550884 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.551101 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 08 11:05:01.551480 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.551570 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 08 11:05:01.551650 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836074-3-iscsi {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.551806 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.551893 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 08 11:05:01.552110 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.552264 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 08 11:05:01.552483 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.553178 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 08 11:05:01.553317 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.553465 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.553593 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.553820 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.553964 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.554146 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.554408 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.554518 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.554738 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.555173 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.555173 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.555419 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.555525 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.555644 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.555774 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.555936 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.556056 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.556169 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.556297 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.556447 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.556594 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.556690 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.556924 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836074-3-iscsi {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.557015 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.557253 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.557380 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.557564 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.557661 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.557956 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.558056 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.558259 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.558365 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836074-3-iscsi {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.558510 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.558605 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.558839 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.558925 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.559161 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.559302 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.559580 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.559676 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.559889 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.559979 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.560223 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.560357 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.560548 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.560695 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.560868 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.561018 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.561167 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.561349 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.561480 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.561575 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.561819 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.561927 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.562133 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.562228 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.562455 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.562566 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.562753 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.562861 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.563057 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.563170 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836074-3-iscsi {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.563363 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.563464 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.563677 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.563772 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.563987 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.564090 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.564289 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.564465 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.564610 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.564772 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.564891 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.565070 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.565163 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.565397 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.565484 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.565728 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.565904 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.566014 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.566149 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.566251 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.566386 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.566564 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.566704 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.566838 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.567018 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.567145 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.567343 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.567441 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.567652 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.567747 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.568022 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.568126 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.568359 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.568475 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.568656 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.568761 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.568958 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.569045 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.569265 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.569402 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.569518 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.569623 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.569856 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.569972 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.570186 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.570310 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.570496 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.570592 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.570816 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.570916 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.571069 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.571214 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.571328 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.571466 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.571634 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.571770 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.571962 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.572107 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.572273 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.572422 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.572583 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.572731 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.572892 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.573044 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.573201 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.573360 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.573510 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.573666 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.573842 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.573997 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.574154 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.574302 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.574466 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.574619 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.574785 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.574956 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.575112 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.575250 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.575435 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.575538 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.575746 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.575833 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.576070 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.576169 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.576382 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.576473 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.576683 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.576780 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.576984 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.577102 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.577343 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.577460 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.577639 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.577731 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.577969 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.578068 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.578274 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.578373 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.578572 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.578661 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.578874 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.578965 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.579163 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.579250 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.579477 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.579648 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.579809 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.579963 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.580103 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.580227 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.580379 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.580471 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.580700 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.580830 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.581009 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.581095 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.581312 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.581409 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.581614 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.581712 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.581939 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.582030 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.582241 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.582336 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.582558 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.582665 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.582863 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.583031 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.583159 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.583254 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.583465 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.583564 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.583798 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.583883 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.584104 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.584201 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.584415 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.584514 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.584716 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.584807 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.585020 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.585110 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.585324 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.585421 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.585620 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.585704 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.585946 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.586035 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.586260 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.586361 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.586564 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.586654 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.586867 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.586956 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.587167 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.587257 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.587467 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.587564 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.587766 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.587854 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.588067 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.588157 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.588364 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.588499 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.588664 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.588751 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.588960 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.589049 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.589275 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.589423 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.589591 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.589860 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.590053 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.590224 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.590374 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.590549 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.590717 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.590867 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.591035 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.591182 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.591182 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.591448 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.591590 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.591747 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.591896 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.592048 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.592196 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.592340 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.592497 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.592655 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.592804 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.592950 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.593106 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.593252 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.593396 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.593553 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.593700 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.593880 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.593974 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.594056 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.594134 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.594242 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.594371 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.594502 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.594701 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.594811 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.595009 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.595104 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.595321 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.595432 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.595637 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.595734 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.596269 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:05:01.596560 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.596658 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.596885 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.596973 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.597204 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.597305 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.597515 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.597644 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.597855 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.597947 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.598185 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.598274 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.598509 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.598659 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.598821 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.598911 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.599155 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.599771 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.600019 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.600118 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.600332 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.600417 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.600645 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.600815 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.600963 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.601061 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.601273 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.601359 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.601584 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.601675 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.601917 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.602007 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.602240 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.602330 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.602575 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.602665 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.602886 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.602975 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.603200 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.603287 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.603508 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.603596 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.603820 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.603912 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.604129 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.604218 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.604444 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.604534 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.604755 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.604842 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.605089 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.605186 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.605404 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.605492 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.605720 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.605861 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.606055 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.606150 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.606370 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.606456 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.606680 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.606776 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.606988 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.607085 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.607295 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.607388 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.607598 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.607685 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.607903 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.608003 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.608237 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.608329 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.608554 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.608650 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.608856 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.608943 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.609173 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.609262 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.609490 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.609579 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.609816 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.610012 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.610175 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.610330 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.610487 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.610643 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.610814 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.610968 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.611120 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.611273 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.611424 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.611574 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.611739 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.611891 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.612065 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.612215 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.612367 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.612529 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.612679 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.612829 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.612978 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.613124 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.613270 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.613437 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.613586 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.613732 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.613929 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.614077 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.614230 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.614401 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.614553 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.614724 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.614886 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.615598 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.615744 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.615893 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.616027 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.616158 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.616288 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.616433 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.616574 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.616701 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.616843 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.616987 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.617119 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.617258 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.617406 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.617540 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.617671 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.617964 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.618104 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.618238 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.618417 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.618561 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.618711 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.618970 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.619122 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.619272 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.619435 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.619577 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.619717 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.619861 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.620002 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.620162 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.620372 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.620522 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.620679 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.620827 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.620987 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.621143 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.621303 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.621449 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.621593 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.621749 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.621920 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.622084 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.622239 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.622388 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.622539 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.622539 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.622762 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.622900 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.623028 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.623177 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.623344 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.623473 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.623610 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.623737 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.623862 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.623986 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.624111 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.624235 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.624372 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.624507 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.624632 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.624767 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.624899 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.625039 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.625246 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.625444 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.625668 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.625884 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.626053 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.626181 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.626352 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.626489 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.626616 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.626740 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.626878 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.627013 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.627140 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.627265 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.627390 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.627523 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.627649 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.627782 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.627915 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.628144 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.628274 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.628406 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.628532 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.628670 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.628796 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.628921 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.629036 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.629220 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.629351 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.629563 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.629694 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.629880 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.630010 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.630135 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.630326 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.630497 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.631176 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.631378 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.631541 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.631677 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.631818 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.631951 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.632115 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.632251 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.632432 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.632568 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.632748 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.632885 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.633069 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.633202 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.633365 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.633526 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.633724 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.633888 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.634030 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.634224 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.634382 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.634518 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.634653 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.634778 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.634933 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.635072 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.635239 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.635410 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.635538 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.635670 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.635802 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.635946 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.636085 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.636276 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.636430 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.636556 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.636680 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.636853 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.636987 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.637122 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.637282 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.637411 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.637619 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.637746 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.637933 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.638126 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.638346 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.638483 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.638617 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.638742 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.638866 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.638992 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.639108 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.639255 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.639407 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.639578 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.639703 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.639896 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.640012 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.640220 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.640336 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.640535 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.640664 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.640864 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.640979 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.641180 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.641295 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.641483 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.641606 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.641806 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.641926 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.642109 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.642237 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.642419 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.642547 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.642740 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.642863 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.643049 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.643163 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.643367 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.643482 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.643688 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.643801 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.643992 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.644107 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.644296 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.644420 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.644610 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.644723 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.644916 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.645033 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.645209 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.645326 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.645510 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.645632 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.645830 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.645949 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.646843 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.647667 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.647667 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.647874 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.647993 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.648112 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.648220 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.648344 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.648570 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.648695 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.648802 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.648916 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.648916 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.649134 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.649134 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.649347 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.649453 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.649579 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.650295 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.650424 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.650532 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.650651 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.650767 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.650874 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.650979 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.651094 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.651209 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.651316 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.651430 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.651571 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.651868 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.651985 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.652091 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.652218 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.652326 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.652431 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.652536 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.652641 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.652787 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.652933 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.653070 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.653196 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.653320 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.653443 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.653574 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.653708 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.653708 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.654018 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.654146 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.654282 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.654421 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.654547 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.654681 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.654809 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.654933 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.655057 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.655246 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.655377 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.655566 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.655695 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.655881 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.656010 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.656203 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.656333 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.656519 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.656704 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.656822 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.656950 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.657132 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.657271 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.657461 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.657591 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.657781 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.657925 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.658086 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.658224 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.658389 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.658518 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.658706 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.658834 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.658963 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.659098 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.659267 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.659396 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.659568 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.659869 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.660007 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.660224 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.660359 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.660484 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.660608 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.660774 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.660910 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.661067 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.661197 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.661369 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.661498 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.661714 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.661982 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.662115 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.662240 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.662364 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.662479 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.662645 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.662785 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.662945 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.663075 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.663284 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.663420 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.663585 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.663714 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.663921 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.664099 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.664276 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.664404 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.664575 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.664711 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.664877 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.665005 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.665182 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.665313 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.665489 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.665627 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.665813 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.665955 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.666118 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.666254 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.666419 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.666557 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.666724 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.666861 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.667030 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.667157 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.667326 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.667463 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.667632 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.667761 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.667936 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.668065 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.668243 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.668374 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.668547 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.668676 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.668847 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.668975 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.669151 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.669279 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.669448 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.669576 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.669758 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.669905 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.670082 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.670213 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.670383 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.670513 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.670681 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.670817 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.670987 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.671117 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.671290 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.671420 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.671589 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.671732 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.671893 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.672100 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.672229 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.672354 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.672486 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.672611 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.672778 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.672916 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.673077 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.673207 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.673378 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.673506 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.673683 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.673833 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.674011 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.674139 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.674310 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.674457 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.674636 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.674773 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.674945 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.675074 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.675247 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.675377 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.675548 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.675677 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.675851 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.675980 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.676153 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.676290 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.676453 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.676589 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.676759 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.676889 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.677070 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.677199 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.677407 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.677539 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.677709 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.677854 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.678039 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.678176 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.678339 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.678469 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.678639 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.678781 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.678942 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.679071 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.679246 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.679373 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.679542 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.679678 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.679842 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.679972 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.680140 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.680269 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.680439 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.680580 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.680737 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.680867 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.681056 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.681186 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.681363 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.681498 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.681660 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.681806 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.681984 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.682128 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.682337 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.682468 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.682593 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.682705 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.682878 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.683049 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.683191 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.683318 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.683513 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.683643 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.683822 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.683962 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.684173 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.684304 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.684485 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.684614 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.684791 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.684919 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.685098 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.685234 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.685398 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.685525 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.685704 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.685933 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.686067 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.686193 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.686316 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.686440 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.686617 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.686836 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.686985 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.687112 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.687237 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.687371 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.687509 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.687645 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.687813 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.687943 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.688122 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.688251 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.688430 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.688577 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.688751 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.688890 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.689054 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.689184 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.689360 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.689507 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.689665 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.689813 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.689995 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.690128 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.690301 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.690433 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.690606 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.690735 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.690912 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.691050 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.691219 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.691350 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.691526 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.691655 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.691834 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.691985 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.692142 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.692274 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.692483 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.692622 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.692749 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.692858 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.693551 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.693685 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.693876 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.694201 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.694510 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.694638 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.695493 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.695996 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.696135 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.696311 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.696484 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.696624 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.696910 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.697038 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.697215 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.697388 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.697652 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.697847 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.697992 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.698236 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.698372 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.698630 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.698756 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.698891 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.699095 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.699225 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.699478 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.699604 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.699790 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.699921 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.700092 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.700342 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.700504 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.700753 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.701053 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.701197 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.701322 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.701446 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.701571 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.701695 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.701979 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.702118 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.702294 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.702493 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.702700 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.702829 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.702956 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.703192 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.703321 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.703493 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.703631 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.703811 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.704040 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.704179 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.704412 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.704538 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.704822 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.704960 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.705131 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.705260 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.705433 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.705618 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.705877 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.706068 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.706215 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.706475 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.706606 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.706789 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.707042 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.707182 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.707415 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.707542 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.707717 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.707855 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.708028 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.708260 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.708390 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.708693 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.709321 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.709512 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.709721 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.709872 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.710094 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.710236 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.710437 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.710565 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.710756 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.710947 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.711084 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.711374 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.711508 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.711694 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.711866 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.712103 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.712258 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.712425 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.712668 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.712876 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.713036 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.713157 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.713357 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.713488 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.713658 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.713929 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.714076 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.714273 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.714414 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.714575 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.714826 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.714955 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.715182 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.715324 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.715485 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.715629 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.715798 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.716057 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.716199 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.716395 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.716522 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.716694 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.716895 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.717025 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.717299 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.717435 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.717599 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.717863 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.717998 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.718245 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.718391 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.718565 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.718780 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.718910 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.719174 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.719318 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.719494 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.719625 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.719803 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.719978 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.720114 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.720387 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.720524 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.720684 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.720860 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.721274 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.721502 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.721632 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.721907 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.722038 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.722241 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.722375 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.722617 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.722759 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.722908 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.723176 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.723309 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.723500 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.723628 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.723815 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.724029 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.724157 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.724432 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.724562 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.724758 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.724887 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.725060 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.725329 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.725467 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.725657 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.725841 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.725984 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.726186 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.726347 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.726567 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.726695 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.726868 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.727112 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.727242 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.727455 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.727581 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.727777 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.727925 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.728081 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.728305 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.728434 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.728690 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.728820 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.728990 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.729119 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.729291 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.729470 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.729598 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.729899 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.730119 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.730258 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.730384 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.730550 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.730757 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.730895 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.731161 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.731291 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.731490 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.731618 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.731798 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.731960 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.732120 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.732362 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.732492 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.732735 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.732861 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.733047 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.733307 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.733435 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.733643 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.733792 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.733979 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.734120 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.734293 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.734498 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.734635 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.734901 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.735031 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.735214 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.735377 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.735514 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.735788 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.736077 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.736216 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.736406 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.736568 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.736719 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.736966 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.737107 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.737324 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.737453 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.737635 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.737830 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.737967 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.738253 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.738393 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.738558 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.738695 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.738864 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.739085 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.739223 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.739481 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.739609 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.740311 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.740448 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.740644 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.740853 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.740992 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.741269 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.741398 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.741583 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.741715 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.741919 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.742155 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.742284 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.742561 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.742707 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.742868 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.743002 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.743172 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.743395 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.743525 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.743779 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.743916 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.744089 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.744217 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.744393 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.744601 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.744738 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.745031 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.745164 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.745302 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.746129 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.746323 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.746463 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.746591 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.746725 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.746852 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.746977 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.747103 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.747103 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.747350 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.747475 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.747600 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.747715 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.747715 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.747967 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.748103 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.748235 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.748361 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.748597 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.748840 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.748971 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.749151 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.749361 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.749501 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.749748 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.749911 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.750129 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.750267 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.750445 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.750620 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.750757 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.751067 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.751196 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.751368 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.751505 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.751671 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.751914 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.752053 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.752266 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.752394 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.752566 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.752750 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.752887 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.753155 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.753285 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.753493 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.753622 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.753748 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.754032 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.754163 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.754433 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.754587 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.754834 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.754963 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.755229 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.755364 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.755606 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.756268 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.756428 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.756693 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.756832 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.757034 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.757169 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.757356 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.757497 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.757660 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.757907 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.758046 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.758285 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.758413 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.758592 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.758729 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.758894 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.759194 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.759399 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.759528 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.759791 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.759926 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.760091 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.760220 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.760396 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.760620 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.760750 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.761001 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.761122 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.761301 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.761462 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.761598 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.761914 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.762057 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.762223 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.762359 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.762522 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.762720 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.762858 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.763111 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.763246 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.763411 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.763618 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.763747 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.763953 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.764082 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.764291 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.764418 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.764590 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.764796 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.764928 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.765181 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.765308 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.765485 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.765702 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.765895 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.766137 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.766275 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.766454 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.766581 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.766754 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.766939 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.767083 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.767358 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.767486 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.767678 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.767816 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.767987 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.768165 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.768295 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.768571 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.768761 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.768898 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.769021 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.769332 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.769457 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.769731 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.769877 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.770085 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.770215 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.770415 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.770565 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.770744 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.770966 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.771627 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.771868 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.772017 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.772174 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.772392 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.772532 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.772789 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.772917 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.773097 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.773226 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.773402 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.773634 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.773844 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.774037 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.774243 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.774795 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.774795 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.775020 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.775145 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.775271 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.775396 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.775519 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.775739 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.775871 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.776059 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.776195 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.776375 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.776714 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.776855 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.777029 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.777181 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.777342 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.777604 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.777733 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.777976 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.778104 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.778285 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.778472 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.778614 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.778874 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.779009 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.779178 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.779304 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.779490 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.779697 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.779837 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.780085 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.780212 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.780401 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.780527 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.780821 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.780957 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.781131 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.781258 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.781447 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.781615 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.781750 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.782079 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.782220 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.782398 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.782527 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.782719 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.782859 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.783027 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.783250 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.783380 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.783637 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.783852 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.783991 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.784284 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.784411 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.784611 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.784785 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.784934 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.785191 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.785326 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.785527 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.785660 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.785849 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.786081 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.786211 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.786464 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.786589 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.787368 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.787507 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.787740 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.787875 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.788046 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.788173 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.788354 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.788569 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.788707 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.788947 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.789073 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.789250 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.789377 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.789552 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.789744 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.789892 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.790170 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.790305 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.790472 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.790612 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.790771 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.790960 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.791088 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.791345 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.791479 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.791641 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.791768 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.791945 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.792171 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.792299 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.792531 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.792666 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.792828 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.792962 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.793126 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.793354 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.793495 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.793739 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.793981 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.794108 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.794235 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.794389 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.794603 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.794734 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.794994 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.795123 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.795311 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.795438 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.795620 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.795784 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.795940 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.796210 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.796387 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.796564 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.796710 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.796872 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.797002 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.797201 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.797365 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.797495 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.797778 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.797912 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.798123 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.798249 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.798430 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.798621 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.798797 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.799036 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.799230 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.799369 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.799662 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.799802 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.799962 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.800091 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.800284 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.800452 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.800582 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.800852 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.800983 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.801196 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.801331 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.801502 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.801642 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.801850 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.802109 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.802240 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.802480 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.802617 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.802793 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.802996 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.803134 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.803393 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.803519 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.803704 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.804021 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.804158 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.804342 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.804484 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.804666 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.804893 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.805029 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.805300 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.805472 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.805640 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.805801 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.805974 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.806193 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.806331 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.806582 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.806717 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.806931 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.807072 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.807241 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.807378 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.807545 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.807773 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.807909 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 08 11:05:01.808163 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.808522 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.808882 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.809242 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.809600 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.810007 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.810370 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.810723 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.811078 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.811434 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.811790 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.812153 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.812593 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.812961 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.813325 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.813687 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.814094 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.814578 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.815008 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.815427 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.815840 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.816319 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.816760 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.817180 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.817595 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.818193 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.818608 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.819028 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.819461 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.819874 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.820305 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.820730 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.821144 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.821568 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.822035 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.822526 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.822971 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.823404 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.823833 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.824252 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.824661 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.825070 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.825939 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.826322 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.826641 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.827060 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.827983 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.827983 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.828451 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.829004 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.829549 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.830121 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.830632 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.831124 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.831651 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.832097 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.832538 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.832869 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG oslo_db.sqlalchemy.engines [None req-254630c8-8241-4739-984b-da4edef8f790 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103377) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 08 11:05:01.833101 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.833390 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.834360 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.834876 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.835393 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.835907 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.836449 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.836971 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.837565 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.838199 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.838729 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.839288 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.839837 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.840397 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.840924 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.841497 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.842062 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.842611 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.843148 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.843728 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.844280 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.844811 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.845352 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.846157 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.846691 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.847227 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.847797 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.848360 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.848893 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.850046 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.850598 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.851152 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.851709 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.852250 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.852877 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.853378 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.853939 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.854492 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.855032 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.855583 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.856148 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.856693 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.857261 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.857860 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.858433 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.859007 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.859606 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.860148 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.860737 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.861290 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.861862 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.862413 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.862947 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:05:01.863371 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 08 11:05:01.901311 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG oslo_db.sqlalchemy.engines [None req-6840c7ff-2d53-4121-ad10-7923e804403a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103378) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 08 11:05:01.937326 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.context [None req-254630c8-8241-4739-984b-da4edef8f790 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d6edf63b-1f02-42e6-8c3b-21b0e04531ff(cell1) {{(pid=103377) load_cells /opt/stack/nova/nova/context.py:464}} Apr 08 11:05:01.943355 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG oslo_concurrency.lockutils [None req-254630c8-8241-4739-984b-da4edef8f790 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103377) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:05:01.944984 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG oslo_concurrency.lockutils [None req-254630c8-8241-4739-984b-da4edef8f790 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103377) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:05:01.953284 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG oslo_concurrency.lockutils [None req-254630c8-8241-4739-984b-da4edef8f790 None None] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103377) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:05:01.953284 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG oslo_concurrency.lockutils [None req-254630c8-8241-4739-984b-da4edef8f790 None None] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103377) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:05:01.959472 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG oslo_db.sqlalchemy.engines [None req-254630c8-8241-4739-984b-da4edef8f790 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103377) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 08 11:05:01.960200 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG oslo_db.sqlalchemy.engines [None req-254630c8-8241-4739-984b-da4edef8f790 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103377) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 08 11:05:01.977415 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.context [None req-6840c7ff-2d53-4121-ad10-7923e804403a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d6edf63b-1f02-42e6-8c3b-21b0e04531ff(cell1) {{(pid=103378) load_cells /opt/stack/nova/nova/context.py:464}} Apr 08 11:05:01.983466 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG oslo_concurrency.lockutils [None req-6840c7ff-2d53-4121-ad10-7923e804403a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:05:01.984983 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG oslo_concurrency.lockutils [None req-6840c7ff-2d53-4121-ad10-7923e804403a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:05:01.985818 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG oslo_concurrency.lockutils [None req-6840c7ff-2d53-4121-ad10-7923e804403a None None] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:05:01.987722 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG oslo_concurrency.lockutils [None req-6840c7ff-2d53-4121-ad10-7923e804403a None None] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:05:02.000561 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG oslo_db.sqlalchemy.engines [None req-6840c7ff-2d53-4121-ad10-7923e804403a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103378) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 08 11:05:02.003823 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG oslo_db.sqlalchemy.engines [None req-6840c7ff-2d53-4121-ad10-7923e804403a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103378) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 08 11:05:02.122032 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG oslo_db.sqlalchemy.engines [None req-254630c8-8241-4739-984b-da4edef8f790 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103377) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 08 11:05:02.163637 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG oslo_db.sqlalchemy.engines [None req-6840c7ff-2d53-4121-ad10-7923e804403a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103378) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 08 11:05:02.630398 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: WARNING keystonemiddleware.auth_token [None req-254630c8-8241-4739-984b-da4edef8f790 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 08 11:05:02.637549 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: WARNING keystonemiddleware.auth_token [None req-254630c8-8241-4739-984b-da4edef8f790 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 08 11:05:02.653234 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: WARNING keystonemiddleware.auth_token [None req-6840c7ff-2d53-4121-ad10-7923e804403a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 08 11:05:02.659919 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: WARNING keystonemiddleware.auth_token [None req-6840c7ff-2d53-4121-ad10-7923e804403a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 08 11:05:02.870179 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: WARNING keystonemiddleware.auth_token [None req-254630c8-8241-4739-984b-da4edef8f790 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 08 11:05:02.875562 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: WARNING keystonemiddleware.auth_token [None req-254630c8-8241-4739-984b-da4edef8f790 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 08 11:05:02.881389 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55adc6b0c9c0 pid: 103377 (default app) Apr 08 11:05:02.883462 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-254630c8-8241-4739-984b-da4edef8f790 None None] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:05:02.884644 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-254630c8-8241-4739-984b-da4edef8f790 None None] 10.222.0.46 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001745 Apr 08 11:05:02.885051 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 788 bytes} [Fri Apr 8 11:05:02 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:05:02.887495 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: WARNING keystonemiddleware.auth_token [None req-6840c7ff-2d53-4121-ad10-7923e804403a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 08 11:05:02.892670 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: WARNING keystonemiddleware.auth_token [None req-6840c7ff-2d53-4121-ad10-7923e804403a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 08 11:05:02.898160 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55adc6b0c9c0 pid: 103378 (default app) Apr 08 11:06:27.799757 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-254630c8-8241-4739-984b-da4edef8f790 None None] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:06:27.800787 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-254630c8-8241-4739-984b-da4edef8f790 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Apr 08 11:06:27.801608 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 2/2] 10.222.0.46 () {54 vars in 930 bytes} [Fri Apr 8 11:06:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:06:28.234517 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-362e3cfd-a2b2-4271-bf40-9277a61ac035 admin admin] Calling method '>' {{(pid=103378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:06:28.263016 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.requestlog [None req-362e3cfd-a2b2-4271-bf40-9277a61ac035 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.453108 Apr 08 11:06:28.263747 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: [pid: 103378|app: 0|req: 1/3] 10.222.0.46 () {60 vars in 1291 bytes} [Fri Apr 8 11:06:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:06:30.679639 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-254630c8-8241-4739-984b-da4edef8f790 None None] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:06:30.679639 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-254630c8-8241-4739-984b-da4edef8f790 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Apr 08 11:06:30.679639 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 3/4] 10.222.0.46 () {54 vars in 930 bytes} [Fri Apr 8 11:06:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:06:30.742483 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-5bef3b6d-4462-443c-bc11-69bcd3892d20 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "ram": 256, "swap": 0, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "c1", "os-flavor-access:is_public": true}} {{(pid=103378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:06:30.762628 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 11:06:30.762628 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: warnings.warn(msg) Apr 08 11:06:30.882428 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.requestlog [None req-5bef3b6d-4462-443c-bc11-69bcd3892d20 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.197404 Apr 08 11:06:30.883162 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: [pid: 103378|app: 0|req: 2/5] 10.222.0.46 () {64 vars in 1282 bytes} [Fri Apr 8 11:06:30 2022] POST /compute/v2.1/flavors => generated 407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 08 11:06:31.104416 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-da15d38c-149c-4fc9-a7b2-38cc00b133d1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:06:31.106951 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 11:06:31.106951 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: warnings.warn(msg) Apr 08 11:06:31.223120 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-da15d38c-149c-4fc9-a7b2-38cc00b133d1 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.331387 Apr 08 11:06:31.224317 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 4/6] 10.222.0.46 () {64 vars in 1335 bytes} [Fri Apr 8 11:06:30 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:06:33.655798 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-5bef3b6d-4462-443c-bc11-69bcd3892d20 admin admin] Calling method '>' {{(pid=103378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:06:33.656811 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.requestlog [None req-5bef3b6d-4462-443c-bc11-69bcd3892d20 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Apr 08 11:06:33.657219 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: [pid: 103378|app: 0|req: 3/7] 10.222.0.46 () {54 vars in 930 bytes} [Fri Apr 8 11:06:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:06:33.775304 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-11f84bf3-e1fe-46ff-9a62-399d42bb6c2b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 5, "name": "ds512M", "id": "d1", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1}} {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:06:33.795706 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 11:06:33.795706 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: warnings.warn(msg) Apr 08 11:06:33.905969 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-11f84bf3-e1fe-46ff-9a62-399d42bb6c2b admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.241813 Apr 08 11:06:33.907204 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 5/8] 10.222.0.46 () {64 vars in 1282 bytes} [Fri Apr 8 11:06:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 11:06:33.925289 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-f2883be1-7ed7-4df1-9d64-dfec080dd661 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:06:33.925289 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 11:06:33.925289 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: warnings.warn(msg) Apr 08 11:06:34.020324 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.requestlog [None req-f2883be1-7ed7-4df1-9d64-dfec080dd661 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102941 Apr 08 11:06:34.021035 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: [pid: 103378|app: 0|req: 4/9] 10.222.0.46 () {64 vars in 1335 bytes} [Fri Apr 8 11:06:33 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:06:36.449041 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-11f84bf3-e1fe-46ff-9a62-399d42bb6c2b admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:06:36.451418 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-11f84bf3-e1fe-46ff-9a62-399d42bb6c2b admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002089 Apr 08 11:06:36.451790 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 6/10] 10.222.0.46 () {54 vars in 930 bytes} [Fri Apr 8 11:06:36 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:06:36.513304 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-ab76bf89-9986-44f3-a767-65c548c468a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "vcpus": 1, "disk": 10, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "swap": 0, "rxtx_factor": 1.0, "id": "d2"}} {{(pid=103378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:06:36.638309 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.requestlog [None req-ab76bf89-9986-44f3-a767-65c548c468a8 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.176602 Apr 08 11:06:36.638309 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: [pid: 103378|app: 0|req: 5/11] 10.222.0.46 () {64 vars in 1282 bytes} [Fri Apr 8 11:06:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 11:06:36.652918 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-a0b5a637-9382-4c00-98bb-397927568b91 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:06:36.745200 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-a0b5a637-9382-4c00-98bb-397927568b91 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096410 Apr 08 11:06:36.745799 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 7/12] 10.222.0.46 () {64 vars in 1335 bytes} [Fri Apr 8 11:06:36 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:06:39.291623 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-ab76bf89-9986-44f3-a767-65c548c468a8 admin admin] Calling method '>' {{(pid=103378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:06:39.292669 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.requestlog [None req-ab76bf89-9986-44f3-a767-65c548c468a8 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Apr 08 11:06:39.293088 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: [pid: 103378|app: 0|req: 6/13] 10.222.0.46 () {54 vars in 930 bytes} [Fri Apr 8 11:06:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:06:39.353686 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-61695450-c815-4ab4-a38d-9afbc9a1a7fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "vcpus": 2, "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "swap": 0, "os-flavor-access:is_public": true, "ram": 2048}} {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:06:39.427059 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-61695450-c815-4ab4-a38d-9afbc9a1a7fc admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.127483 Apr 08 11:06:39.427616 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 8/14] 10.222.0.46 () {64 vars in 1282 bytes} [Fri Apr 8 11:06:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 11:06:39.439673 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-3c15f99b-3cc6-4265-9e5e-9240ec5de13c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:06:39.528420 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.requestlog [None req-3c15f99b-3cc6-4265-9e5e-9240ec5de13c admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092459 Apr 08 11:06:39.528970 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: [pid: 103378|app: 0|req: 7/15] 10.222.0.46 () {64 vars in 1335 bytes} [Fri Apr 8 11:06:39 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:06:41.970455 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-61695450-c815-4ab4-a38d-9afbc9a1a7fc admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:06:41.971485 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-61695450-c815-4ab4-a38d-9afbc9a1a7fc admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Apr 08 11:06:41.971908 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 9/16] 10.222.0.46 () {54 vars in 930 bytes} [Fri Apr 8 11:06:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:06:42.039353 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-27a4690d-a0e0-4611-99ff-93cf3a72cdf1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "name": "ds4G", "swap": 0, "id": "d4", "vcpus": 4}} {{(pid=103378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:06:42.113179 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.requestlog [None req-27a4690d-a0e0-4611-99ff-93cf3a72cdf1 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.134360 Apr 08 11:06:42.114360 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: [pid: 103378|app: 0|req: 8/17] 10.222.0.46 () {64 vars in 1282 bytes} [Fri Apr 8 11:06:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 11:06:42.132986 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-6492d92b-2186-493e-9148-5fad9379ef61 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:06:42.213544 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-6492d92b-2186-493e-9148-5fad9379ef61 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086625 Apr 08 11:06:42.214255 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 10/18] 10.222.0.46 () {64 vars in 1335 bytes} [Fri Apr 8 11:06:42 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:06:44.643605 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-27a4690d-a0e0-4611-99ff-93cf3a72cdf1 admin admin] Calling method '>' {{(pid=103378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:06:44.646058 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.requestlog [None req-27a4690d-a0e0-4611-99ff-93cf3a72cdf1 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002264 Apr 08 11:06:44.653700 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: [pid: 103378|app: 0|req: 9/19] 10.222.0.46 () {54 vars in 930 bytes} [Fri Apr 8 11:06:44 2022] GET /compute/v2.1 => generated 388 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:06:44.710140 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-4be19b2e-66a2-4e8f-96b6-a34e2fbd3680 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:06:44.735237 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-4be19b2e-66a2-4e8f-96b6-a34e2fbd3680 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080456 Apr 08 11:06:44.737230 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 11/20] 10.222.0.46 () {60 vars in 1291 bytes} [Fri Apr 8 11:06:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:06:47.346930 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-27a4690d-a0e0-4611-99ff-93cf3a72cdf1 admin admin] Calling method '>' {{(pid=103378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:06:47.348065 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.requestlog [None req-27a4690d-a0e0-4611-99ff-93cf3a72cdf1 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Apr 08 11:06:47.348494 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: [pid: 103378|app: 0|req: 10/21] 10.222.0.46 () {54 vars in 930 bytes} [Fri Apr 8 11:06:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:06:47.426299 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-90a50255-3c1c-4b48-ba9c-6e4faa7634bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "disk": 1, "rxtx_factor": 1.0, "name": "m1.tiny", "id": "1"}} {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:06:47.501254 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-90a50255-3c1c-4b48-ba9c-6e4faa7634bc admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.146721 Apr 08 11:06:47.501833 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 12/22] 10.222.0.46 () {64 vars in 1282 bytes} [Fri Apr 8 11:06:47 2022] POST /compute/v2.1/flavors => generated 402 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 11:06:47.515800 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-fe192f9f-3aa5-4750-9bc3-25331052ba76 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:06:47.612260 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.requestlog [None req-fe192f9f-3aa5-4750-9bc3-25331052ba76 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101910 Apr 08 11:06:47.613090 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: [pid: 103378|app: 0|req: 11/23] 10.222.0.46 () {64 vars in 1332 bytes} [Fri Apr 8 11:06:47 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:06:50.601894 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-90a50255-3c1c-4b48-ba9c-6e4faa7634bc admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:06:50.602956 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-90a50255-3c1c-4b48-ba9c-6e4faa7634bc admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001577 Apr 08 11:06:50.603376 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 13/24] 10.222.0.46 () {54 vars in 930 bytes} [Fri Apr 8 11:06:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:06:50.683403 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-cab17530-5d74-40dd-9a55-0786a74f64ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "vcpus": 1, "id": "2", "disk": 20, "name": "m1.small", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:06:50.782560 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.requestlog [None req-cab17530-5d74-40dd-9a55-0786a74f64ba admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.172457 Apr 08 11:06:50.783122 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: [pid: 103378|app: 0|req: 12/25] 10.222.0.46 () {64 vars in 1282 bytes} [Fri Apr 8 11:06:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 08 11:06:50.795582 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-e825fc4c-c01f-43fb-8747-8a28c4ce9f87 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:06:50.877461 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-e825fc4c-c01f-43fb-8747-8a28c4ce9f87 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085913 Apr 08 11:06:50.878134 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 14/26] 10.222.0.46 () {64 vars in 1332 bytes} [Fri Apr 8 11:06:50 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:06:53.317258 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-cab17530-5d74-40dd-9a55-0786a74f64ba admin admin] Calling method '>' {{(pid=103378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:06:53.318340 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.requestlog [None req-cab17530-5d74-40dd-9a55-0786a74f64ba admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Apr 08 11:06:53.318907 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: [pid: 103378|app: 0|req: 13/27] 10.222.0.46 () {54 vars in 930 bytes} [Fri Apr 8 11:06:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:06:53.378096 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-d2924a1a-24c5-4879-b2b9-dd289d071bc2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true, "ram": 4096, "name": "m1.medium"}} {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:06:53.511137 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-d2924a1a-24c5-4879-b2b9-dd289d071bc2 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.185785 Apr 08 11:06:53.513096 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 15/28] 10.222.0.46 () {64 vars in 1282 bytes} [Fri Apr 8 11:06:53 2022] POST /compute/v2.1/flavors => generated 406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 08 11:06:53.524948 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-2c10955d-405a-4b1b-b5d0-f5af0fb0f2a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:06:53.618909 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.requestlog [None req-2c10955d-405a-4b1b-b5d0-f5af0fb0f2a0 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097749 Apr 08 11:06:53.619516 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: [pid: 103378|app: 0|req: 14/29] 10.222.0.46 () {64 vars in 1332 bytes} [Fri Apr 8 11:06:53 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:06:56.018992 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-d2924a1a-24c5-4879-b2b9-dd289d071bc2 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:06:56.020001 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-d2924a1a-24c5-4879-b2b9-dd289d071bc2 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Apr 08 11:06:56.020404 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 16/30] 10.222.0.46 () {54 vars in 930 bytes} [Fri Apr 8 11:06:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:06:56.083379 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-1b49de4e-cecf-4b1c-8e8f-7f0127f398f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "4", "vcpus": 4, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "os-flavor-access:is_public": true, "name": "m1.large", "swap": 0}} {{(pid=103378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:06:56.169284 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.requestlog [None req-1b49de4e-cecf-4b1c-8e8f-7f0127f398f8 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.141263 Apr 08 11:06:56.169848 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: [pid: 103378|app: 0|req: 15/31] 10.222.0.46 () {64 vars in 1282 bytes} [Fri Apr 8 11:06:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 11:06:56.182631 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-1d96336a-e70e-4e0f-9b88-238cb5f7a338 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:06:56.343929 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-1d96336a-e70e-4e0f-9b88-238cb5f7a338 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.165413 Apr 08 11:06:56.344788 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 17/32] 10.222.0.46 () {64 vars in 1332 bytes} [Fri Apr 8 11:06:56 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:06:58.756611 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-1b49de4e-cecf-4b1c-8e8f-7f0127f398f8 admin admin] Calling method '>' {{(pid=103378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:06:58.757627 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.requestlog [None req-1b49de4e-cecf-4b1c-8e8f-7f0127f398f8 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Apr 08 11:06:58.758464 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: [pid: 103378|app: 0|req: 16/33] 10.222.0.46 () {54 vars in 930 bytes} [Fri Apr 8 11:06:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:06:58.822631 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-1ae52020-e4f4-4696-bca6-8802408162b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "vcpus": 8, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "ram": 16384, "disk": 160}} {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:06:58.894904 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-1ae52020-e4f4-4696-bca6-8802408162b4 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.129644 Apr 08 11:06:58.895456 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 18/34] 10.222.0.46 () {64 vars in 1282 bytes} [Fri Apr 8 11:06:58 2022] POST /compute/v2.1/flavors => generated 408 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 11:06:58.907608 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-e73a2e07-beaa-422f-a0fe-e1dbf92e31b8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:06:58.979038 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.requestlog [None req-e73a2e07-beaa-422f-a0fe-e1dbf92e31b8 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.075343 Apr 08 11:06:58.979542 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: [pid: 103378|app: 0|req: 17/35] 10.222.0.46 () {64 vars in 1332 bytes} [Fri Apr 8 11:06:58 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:07:22.730679 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-1ae52020-e4f4-4696-bca6-8802408162b4 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:07:22.732237 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-1ae52020-e4f4-4696-bca6-8802408162b4 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001990 Apr 08 11:07:22.732916 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 19/36] 10.222.0.46 () {54 vars in 930 bytes} [Fri Apr 8 11:07:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:07:22.790930 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-2aecb537-ca17-47be-ab75-9c29c5691990 admin admin] Calling method '>' {{(pid=103378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:07:22.808304 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.requestlog [None req-2aecb537-ca17-47be-ab75-9c29c5691990 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069134 Apr 08 11:07:22.809952 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: [pid: 103378|app: 0|req: 18/37] 10.222.0.46 () {60 vars in 1291 bytes} [Fri Apr 8 11:07:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:07:24.218199 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-1ae52020-e4f4-4696-bca6-8802408162b4 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:07:24.220427 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-1ae52020-e4f4-4696-bca6-8802408162b4 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002508 Apr 08 11:07:24.220912 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 20/38] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Apr 8 11:07:24 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:07:24.434241 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-22a34b4d-58ab-4e1e-b1fe-66eb14cb32e9 admin admin] Calling method '>' {{(pid=103378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:07:24.439732 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.wsgi [None req-22a34b4d-58ab-4e1e-b1fe-66eb14cb32e9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 08 11:07:24.440298 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-22a34b4d-58ab-4e1e-b1fe-66eb14cb32e9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103378) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:07:24.441086 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.requestlog [None req-22a34b4d-58ab-4e1e-b1fe-66eb14cb32e9 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.058129 Apr 08 11:07:24.441596 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: [pid: 103378|app: 0|req: 19/39] 10.222.0.46 () {60 vars in 1190 bytes} [Fri Apr 8 11:07:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Apr 08 11:07:24.451374 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-0e6ad0e8-5479-472a-9949-1989ff1f2fb4 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:07:24.472456 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-0e6ad0e8-5479-472a-9949-1989ff1f2fb4 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025143 Apr 08 11:07:24.472993 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 21/40] 10.222.0.46 () {60 vars in 1210 bytes} [Fri Apr 8 11:07:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:07:24.482442 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-86e870aa-3d39-407c-b10d-6030b1efc809 admin admin] Calling method '>' {{(pid=103378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:07:24.503107 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.requestlog [None req-86e870aa-3d39-407c-b10d-6030b1efc809 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024126 Apr 08 11:07:24.503673 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: [pid: 103378|app: 0|req: 20/41] 10.222.0.46 () {60 vars in 1210 bytes} [Fri Apr 8 11:07:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:07:24.513482 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-dd5c074c-9093-4719-b48a-92a193c491e9 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:07:24.518921 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.wsgi [None req-dd5c074c-9093-4719-b48a-92a193c491e9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 08 11:07:24.519482 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-dd5c074c-9093-4719-b48a-92a193c491e9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103377) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:07:24.520279 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-dd5c074c-9093-4719-b48a-92a193c491e9 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010856 Apr 08 11:07:24.520781 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 22/42] 10.222.0.46 () {60 vars in 1190 bytes} [Fri Apr 8 11:07:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 08 11:07:25.790411 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-86e870aa-3d39-407c-b10d-6030b1efc809 admin admin] Calling method '>' {{(pid=103378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:07:25.791429 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.requestlog [None req-86e870aa-3d39-407c-b10d-6030b1efc809 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Apr 08 11:07:25.791829 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: [pid: 103378|app: 0|req: 21/43] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Apr 8 11:07:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:07:25.982330 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-c58eb123-66cf-48c9-9275-e01c0df7949a admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:07:25.988038 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.wsgi [None req-c58eb123-66cf-48c9-9275-e01c0df7949a admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 08 11:07:25.988613 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-c58eb123-66cf-48c9-9275-e01c0df7949a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103377) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:07:25.989426 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-c58eb123-66cf-48c9-9275-e01c0df7949a admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061030 Apr 08 11:07:25.990459 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 23/44] 10.222.0.46 () {60 vars in 1190 bytes} [Fri Apr 8 11:07:25 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 08 11:07:26.001911 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-da394448-bca7-43e1-86d1-a2aebec74935 admin admin] Calling method '>' {{(pid=103378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:07:26.015602 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.requestlog [None req-da394448-bca7-43e1-86d1-a2aebec74935 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017248 Apr 08 11:07:26.016158 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: [pid: 103378|app: 0|req: 22/45] 10.222.0.46 () {60 vars in 1210 bytes} [Fri Apr 8 11:07:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:07:26.025835 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-70326979-4389-49ec-bd4a-ce47f3f40ef9 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:07:26.040562 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-70326979-4389-49ec-bd4a-ce47f3f40ef9 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018222 Apr 08 11:07:26.041113 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 24/46] 10.222.0.46 () {60 vars in 1210 bytes} [Fri Apr 8 11:07:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:07:26.051445 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-2dcfbb8d-d15f-4d0d-9e4a-673c9b8391e6 admin admin] Calling method '>' {{(pid=103378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:07:26.056875 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.wsgi [None req-2dcfbb8d-d15f-4d0d-9e4a-673c9b8391e6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 08 11:07:26.057437 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-2dcfbb8d-d15f-4d0d-9e4a-673c9b8391e6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103378) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:07:26.058276 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.requestlog [None req-2dcfbb8d-d15f-4d0d-9e4a-673c9b8391e6 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010479 Apr 08 11:07:26.058804 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: [pid: 103378|app: 0|req: 23/47] 10.222.0.46 () {60 vars in 1190 bytes} [Fri Apr 8 11:07:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 08 11:07:27.354909 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-70326979-4389-49ec-bd4a-ce47f3f40ef9 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:07:27.355923 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-70326979-4389-49ec-bd4a-ce47f3f40ef9 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Apr 08 11:07:27.356321 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 25/48] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Apr 8 11:07:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:07:27.545194 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-3b4f5808-4355-4e1c-b270-db5737d7fbb2 admin admin] Calling method '>' {{(pid=103378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:07:27.550872 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.wsgi [None req-3b4f5808-4355-4e1c-b270-db5737d7fbb2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 08 11:07:27.551432 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-3b4f5808-4355-4e1c-b270-db5737d7fbb2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103378) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:07:27.552308 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.requestlog [None req-3b4f5808-4355-4e1c-b270-db5737d7fbb2 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058975 Apr 08 11:07:27.552809 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: [pid: 103378|app: 0|req: 24/49] 10.222.0.46 () {60 vars in 1193 bytes} [Fri Apr 8 11:07:27 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 08 11:07:27.562311 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-5e11bdbc-98e6-47de-8efb-487df9e0e166 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:07:27.577338 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-5e11bdbc-98e6-47de-8efb-487df9e0e166 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018552 Apr 08 11:07:27.577905 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 26/50] 10.222.0.46 () {60 vars in 1210 bytes} [Fri Apr 8 11:07:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:07:27.588823 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-bb729c0a-d747-4960-94ce-fc96dd387c4f admin admin] Calling method '>' {{(pid=103378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:07:27.603401 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.requestlog [None req-bb729c0a-d747-4960-94ce-fc96dd387c4f admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018668 Apr 08 11:07:27.603973 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: [pid: 103378|app: 0|req: 25/51] 10.222.0.46 () {60 vars in 1210 bytes} [Fri Apr 8 11:07:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:07:27.623346 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-2d2a81ef-34cd-4b9c-9080-151f65b8304f admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:07:27.628790 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.wsgi [None req-2d2a81ef-34cd-4b9c-9080-151f65b8304f admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 08 11:07:27.629362 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-2d2a81ef-34cd-4b9c-9080-151f65b8304f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103377) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:07:27.630193 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-2d2a81ef-34cd-4b9c-9080-151f65b8304f admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010983 Apr 08 11:07:27.630728 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 27/52] 10.222.0.46 () {60 vars in 1193 bytes} [Fri Apr 8 11:07:27 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 08 11:07:28.918035 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-bb729c0a-d747-4960-94ce-fc96dd387c4f admin admin] Calling method '>' {{(pid=103378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:07:28.919052 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.requestlog [None req-bb729c0a-d747-4960-94ce-fc96dd387c4f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Apr 08 11:07:28.919458 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: [pid: 103378|app: 0|req: 26/53] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Apr 8 11:07:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:07:29.111347 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-36a7e413-b119-46d2-9e2b-4f5c4da44f76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:07:29.186973 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-36a7e413-b119-46d2-9e2b-4f5c4da44f76 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.128933 Apr 08 11:07:29.187448 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 28/54] 10.222.0.46 () {64 vars in 1235 bytes} [Fri Apr 8 11:07:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 11:07:30.457360 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-bb729c0a-d747-4960-94ce-fc96dd387c4f admin admin] Calling method '>' {{(pid=103378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:07:30.458433 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.requestlog [None req-bb729c0a-d747-4960-94ce-fc96dd387c4f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Apr 08 11:07:30.458867 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: [pid: 103378|app: 0|req: 27/55] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Apr 8 11:07:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:07:30.653184 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-444537d4-17dd-4787-ab50-2f5238177677 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:07:30.739381 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-444537d4-17dd-4787-ab50-2f5238177677 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.139118 Apr 08 11:07:30.739922 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 29/56] 10.222.0.46 () {64 vars in 1235 bytes} [Fri Apr 8 11:07:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 11:07:32.017678 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-bb729c0a-d747-4960-94ce-fc96dd387c4f admin admin] Calling method '>' {{(pid=103378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:07:32.018714 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.requestlog [None req-bb729c0a-d747-4960-94ce-fc96dd387c4f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Apr 08 11:07:32.019107 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: [pid: 103378|app: 0|req: 28/57] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Apr 8 11:07:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:07:32.208256 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-6ff0e7b6-e12a-4c73-9876-fce292e3710b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:07:32.282816 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-6ff0e7b6-e12a-4c73-9876-fce292e3710b admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.125183 Apr 08 11:07:32.284725 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 30/58] 10.222.0.46 () {64 vars in 1235 bytes} [Fri Apr 8 11:07:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 11:07:33.563318 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-bb729c0a-d747-4960-94ce-fc96dd387c4f admin admin] Calling method '>' {{(pid=103378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:07:33.564314 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.requestlog [None req-bb729c0a-d747-4960-94ce-fc96dd387c4f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Apr 08 11:07:33.566770 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: [pid: 103378|app: 0|req: 29/59] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Apr 8 11:07:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:07:33.758927 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-9b078c2c-432b-4f11-9f97-fb4b03c5412e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:07:33.837413 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-9b078c2c-432b-4f11-9f97-fb4b03c5412e admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.130100 Apr 08 11:07:33.837878 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 31/60] 10.222.0.46 () {64 vars in 1235 bytes} [Fri Apr 8 11:07:33 2022] POST /compute/v2.1/flavors => generated 409 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 11:07:35.156160 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-bb729c0a-d747-4960-94ce-fc96dd387c4f admin admin] Calling method '>' {{(pid=103378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:07:35.157198 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.requestlog [None req-bb729c0a-d747-4960-94ce-fc96dd387c4f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Apr 08 11:07:35.157597 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: [pid: 103378|app: 0|req: 30/61] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Apr 8 11:07:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:07:35.348981 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-03a4196b-ac7f-4426-8302-386d9e5fc747 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:07:35.368303 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-03a4196b-ac7f-4426-8302-386d9e5fc747 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.074149 Apr 08 11:07:35.368844 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 32/62] 10.222.0.46 () {60 vars in 1202 bytes} [Fri Apr 8 11:07:35 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:08:39.602931 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-bb729c0a-d747-4960-94ce-fc96dd387c4f admin admin] Calling method '>' {{(pid=103378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:08:39.603976 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.requestlog [None req-bb729c0a-d747-4960-94ce-fc96dd387c4f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Apr 08 11:08:39.604372 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: [pid: 103378|app: 0|req: 31/63] 10.222.0.46 () {54 vars in 930 bytes} [Fri Apr 8 11:08:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:08:39.664087 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-b707874b-25b0-4b96-af04-10a88f141ac6 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:08:39.683374 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-b707874b-25b0-4b96-af04-10a88f141ac6 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072968 Apr 08 11:08:39.683910 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 33/64] 10.222.0.46 () {60 vars in 1291 bytes} [Fri Apr 8 11:08:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:08:39.706123 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-75cbba2b-9f4c-4a70-b815-28b826a3cb5b admin admin] Calling method '>' {{(pid=103378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:08:39.713753 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.requestlog [None req-75cbba2b-9f4c-4a70-b815-28b826a3cb5b admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011855 Apr 08 11:08:39.714298 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: [pid: 103378|app: 0|req: 32/65] 10.222.0.46 () {60 vars in 1282 bytes} [Fri Apr 8 11:08:39 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:08:39.725580 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-e7fa01b3-ba1d-4624-b07a-047325645f55 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:08:39.733195 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-e7fa01b3-ba1d-4624-b07a-047325645f55 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011148 Apr 08 11:08:39.733714 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 34/66] 10.222.0.46 () {60 vars in 1285 bytes} [Fri Apr 8 11:08:39 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:08:39.745153 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-4a95475e-7cfa-4380-bc74-150acc97398a admin admin] Calling method '>' {{(pid=103378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:08:39.752576 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.requestlog [None req-4a95475e-7cfa-4380-bc74-150acc97398a admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011356 Apr 08 11:08:39.753090 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: [pid: 103378|app: 0|req: 33/67] 10.222.0.46 () {60 vars in 1285 bytes} [Fri Apr 8 11:08:39 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:08:39.764623 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-2d259b3b-b88f-4379-bef9-2f71199906a8 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:08:39.772296 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-2d259b3b-b88f-4379-bef9-2f71199906a8 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011235 Apr 08 11:08:39.772834 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 35/68] 10.222.0.46 () {60 vars in 1282 bytes} [Fri Apr 8 11:08:39 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:10:32.885602 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-b3c916e2-1636-4fc9-b492-865f4564d62d tempest-verify_tempest_config-1591925694 tempest-verify_tempest_config-1591925694-project] Calling method '>' {{(pid=103378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:10:32.887559 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.requestlog [None req-b3c916e2-1636-4fc9-b492-865f4564d62d tempest-verify_tempest_config-1591925694 tempest-verify_tempest_config-1591925694-project] 10.222.0.46 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.117914 Apr 08 11:10:32.888083 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: [pid: 103378|app: 0|req: 34/69] 10.222.0.46 () {58 vars in 1133 bytes} [Fri Apr 8 11:10:32 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 11:12:18.281581 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-2d259b3b-b88f-4379-bef9-2f71199906a8 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:12:18.282628 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-2d259b3b-b88f-4379-bef9-2f71199906a8 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Apr 08 11:12:18.283056 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 36/70] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Apr 8 11:12:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:12:18.535327 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-225f5acd-5485-4ffd-8423-4d28fc52b8e5 admin admin] Calling method '>' {{(pid=103378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:12:18.542589 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 11:12:18.542589 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: warnings.warn(msg) Apr 08 11:12:18.542589 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG oslo_concurrency.lockutils [None req-225f5acd-5485-4ffd-8423-4d28fc52b8e5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:12:18.542589 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG oslo_concurrency.lockutils [None req-225f5acd-5485-4ffd-8423-4d28fc52b8e5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:12:18.542589 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG oslo_concurrency.lockutils [None req-225f5acd-5485-4ffd-8423-4d28fc52b8e5 admin admin] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:12:18.542589 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG oslo_concurrency.lockutils [None req-225f5acd-5485-4ffd-8423-4d28fc52b8e5 admin admin] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:12:18.573668 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.requestlog [None req-225f5acd-5485-4ffd-8423-4d28fc52b8e5 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.150020 Apr 08 11:12:18.574258 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: [pid: 103378|app: 0|req: 35/71] 10.222.0.46 () {60 vars in 1193 bytes} [Fri Apr 8 11:12:18 2022] GET /compute/v2.1/os-services => generated 791 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 11:12:19.911159 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-2d259b3b-b88f-4379-bef9-2f71199906a8 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:12:19.912163 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-2d259b3b-b88f-4379-bef9-2f71199906a8 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Apr 08 11:12:19.912562 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 37/72] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Apr 8 11:12:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:12:20.106991 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-c8aa28ca-5718-4b8a-8a22-ec498ee70441 admin admin] Calling method '>' {{(pid=103378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:12:20.108168 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 11:12:20.108168 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: warnings.warn(msg) Apr 08 11:12:20.109392 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG oslo_concurrency.lockutils [None req-c8aa28ca-5718-4b8a-8a22-ec498ee70441 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:12:20.109915 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG oslo_concurrency.lockutils [None req-c8aa28ca-5718-4b8a-8a22-ec498ee70441 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:12:20.110660 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG oslo_concurrency.lockutils [None req-c8aa28ca-5718-4b8a-8a22-ec498ee70441 admin admin] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:12:20.111098 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG oslo_concurrency.lockutils [None req-c8aa28ca-5718-4b8a-8a22-ec498ee70441 admin admin] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:12:20.130644 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.requestlog [None req-c8aa28ca-5718-4b8a-8a22-ec498ee70441 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076803 Apr 08 11:12:20.131227 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: [pid: 103378|app: 0|req: 36/73] 10.222.0.46 () {60 vars in 1193 bytes} [Fri Apr 8 11:12:20 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 11:12:31.854305 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-2d259b3b-b88f-4379-bef9-2f71199906a8 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:12:31.855313 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-2d259b3b-b88f-4379-bef9-2f71199906a8 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Apr 08 11:12:31.855723 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 38/74] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Apr 8 11:12:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:12:32.053798 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-419e122d-81b8-4234-a9cb-85016d3b2256 admin admin] Calling method '>' {{(pid=103378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:12:32.055000 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 11:12:32.055000 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: warnings.warn(msg) Apr 08 11:12:32.056276 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG oslo_concurrency.lockutils [None req-419e122d-81b8-4234-a9cb-85016d3b2256 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:12:32.056720 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG oslo_concurrency.lockutils [None req-419e122d-81b8-4234-a9cb-85016d3b2256 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:12:32.057539 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG oslo_concurrency.lockutils [None req-419e122d-81b8-4234-a9cb-85016d3b2256 admin admin] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:12:32.058003 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG oslo_concurrency.lockutils [None req-419e122d-81b8-4234-a9cb-85016d3b2256 admin admin] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:12:32.082280 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.requestlog [None req-419e122d-81b8-4234-a9cb-85016d3b2256 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.081604 Apr 08 11:12:32.082849 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: [pid: 103378|app: 0|req: 37/75] 10.222.0.46 () {60 vars in 1193 bytes} [Fri Apr 8 11:12:31 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:12:33.369518 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-2d259b3b-b88f-4379-bef9-2f71199906a8 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:12:33.370591 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-2d259b3b-b88f-4379-bef9-2f71199906a8 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Apr 08 11:12:33.371185 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 39/76] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Apr 8 11:12:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:12:33.565300 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG nova.api.openstack.wsgi [None req-fda6dd13-bc45-4f00-8ba2-814f6af651b6 admin admin] Calling method '>' {{(pid=103378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:12:33.566639 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 11:12:33.566639 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: warnings.warn(msg) Apr 08 11:12:33.567887 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG oslo_concurrency.lockutils [None req-fda6dd13-bc45-4f00-8ba2-814f6af651b6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:12:33.568329 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG oslo_concurrency.lockutils [None req-fda6dd13-bc45-4f00-8ba2-814f6af651b6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:12:33.569120 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG oslo_concurrency.lockutils [None req-fda6dd13-bc45-4f00-8ba2-814f6af651b6 admin admin] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:12:33.569577 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: DEBUG oslo_concurrency.lockutils [None req-fda6dd13-bc45-4f00-8ba2-814f6af651b6 admin admin] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:12:33.592856 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: INFO nova.api.openstack.requestlog [None req-fda6dd13-bc45-4f00-8ba2-814f6af651b6 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.082521 Apr 08 11:12:33.593998 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: [pid: 103378|app: 0|req: 38/77] 10.222.0.46 () {60 vars in 1193 bytes} [Fri Apr 8 11:12:33 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:13:35.142979 dv-cinder-836074-3-iscsi devstack@n-api.service[103376]: Fri Apr 8 11:13:35 2022 - graceful shutdown triggered... Apr 08 11:13:35.143607 dv-cinder-836074-3-iscsi devstack@n-api.service[103377]: Gracefully killing worker 1 (pid: 103377)... Apr 08 11:13:35.144831 dv-cinder-836074-3-iscsi devstack@n-api.service[103378]: Gracefully killing worker 2 (pid: 103378)... Apr 08 11:13:35.145694 dv-cinder-836074-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Apr 08 11:13:36.144126 dv-cinder-836074-3-iscsi devstack@n-api.service[103376]: worker 1 buried after 1 seconds Apr 08 11:13:36.144126 dv-cinder-836074-3-iscsi devstack@n-api.service[103376]: worker 2 buried after 1 seconds Apr 08 11:13:36.144126 dv-cinder-836074-3-iscsi devstack@n-api.service[103376]: goodbye to uWSGI. Apr 08 11:13:36.145733 dv-cinder-836074-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Apr 08 11:13:36.146356 dv-cinder-836074-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Apr 08 11:13:36.149123 dv-cinder-836074-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 08 11:13:36.170366 dv-cinder-836074-3-iscsi devstack@n-api.service[117785]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 08 11:13:36.194041 dv-cinder-836074-3-iscsi devstack@n-api.service[117785]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Apr 8 11:13:36 2022] *** Apr 08 11:13:36.194041 dv-cinder-836074-3-iscsi devstack@n-api.service[117785]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 08 11:13:36.194041 dv-cinder-836074-3-iscsi devstack@n-api.service[117785]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 08 11:13:36.194041 dv-cinder-836074-3-iscsi devstack@n-api.service[117785]: nodename: dv-cinder-836074-3-iscsi Apr 08 11:13:36.194041 dv-cinder-836074-3-iscsi devstack@n-api.service[117785]: machine: x86_64 Apr 08 11:13:36.194041 dv-cinder-836074-3-iscsi devstack@n-api.service[117785]: clock source: unix Apr 08 11:13:36.194041 dv-cinder-836074-3-iscsi devstack@n-api.service[117785]: pcre jit disabled Apr 08 11:13:36.194041 dv-cinder-836074-3-iscsi devstack@n-api.service[117785]: detected number of CPU cores: 4 Apr 08 11:13:36.194041 dv-cinder-836074-3-iscsi devstack@n-api.service[117785]: current working directory: / Apr 08 11:13:36.194041 dv-cinder-836074-3-iscsi devstack@n-api.service[117785]: detected binary path: /usr/bin/uwsgi-core Apr 08 11:13:36.194041 dv-cinder-836074-3-iscsi devstack@n-api.service[117785]: your processes number limit is 47680 Apr 08 11:13:36.194041 dv-cinder-836074-3-iscsi devstack@n-api.service[117785]: your memory page size is 4096 bytes Apr 08 11:13:36.194041 dv-cinder-836074-3-iscsi devstack@n-api.service[117785]: detected max file descriptor number: 2048 Apr 08 11:13:36.194041 dv-cinder-836074-3-iscsi devstack@n-api.service[117785]: lock engine: pthread robust mutexes Apr 08 11:13:36.195299 dv-cinder-836074-3-iscsi devstack@n-api.service[117785]: thunder lock: enabled Apr 08 11:13:36.195299 dv-cinder-836074-3-iscsi devstack@n-api.service[117785]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 08 11:13:36.195299 dv-cinder-836074-3-iscsi devstack@n-api.service[117785]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 08 11:13:36.242016 dv-cinder-836074-3-iscsi devstack@n-api.service[117785]: Python main interpreter initialized at 0x5559904689c0 Apr 08 11:13:36.242016 dv-cinder-836074-3-iscsi devstack@n-api.service[117785]: python threads support enabled Apr 08 11:13:36.242016 dv-cinder-836074-3-iscsi devstack@n-api.service[117785]: your server socket listen backlog is limited to 100 connections Apr 08 11:13:36.242016 dv-cinder-836074-3-iscsi devstack@n-api.service[117785]: your mercy for graceful operations on workers is 90 seconds Apr 08 11:13:36.242490 dv-cinder-836074-3-iscsi devstack@n-api.service[117785]: mapped 403077 bytes (393 KB) for 2 cores Apr 08 11:13:36.242490 dv-cinder-836074-3-iscsi devstack@n-api.service[117785]: *** Operational MODE: preforking *** Apr 08 11:13:36.242716 dv-cinder-836074-3-iscsi devstack@n-api.service[117785]: *** uWSGI is running in multiple interpreter mode *** Apr 08 11:13:36.242716 dv-cinder-836074-3-iscsi devstack@n-api.service[117785]: spawned uWSGI master process (pid: 117785) Apr 08 11:13:36.242928 dv-cinder-836074-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 08 11:13:36.243635 dv-cinder-836074-3-iscsi devstack@n-api.service[117785]: spawned uWSGI worker 1 (pid: 117800, cores: 1) Apr 08 11:13:36.245806 dv-cinder-836074-3-iscsi devstack@n-api.service[117785]: spawned uWSGI worker 2 (pid: 117801, cores: 1) Apr 08 11:13:36.245806 dv-cinder-836074-3-iscsi devstack@n-api.service[117785]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 08 11:13:37.486404 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 08 11:13:37.520696 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 08 11:13:38.420755 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 08 11:13:38.420755 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: from cryptography.utils import int_from_bytes Apr 08 11:13:38.421085 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 08 11:13:38.421085 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: from cryptography.utils import int_from_bytes Apr 08 11:13:38.445049 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 08 11:13:38.445049 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: from cryptography.utils import int_from_bytes Apr 08 11:13:38.445377 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 08 11:13:38.445377 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: from cryptography.utils import int_from_bytes Apr 08 11:13:40.850793 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 08 11:13:40.851356 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 08 11:13:40.851704 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 08 11:13:40.852132 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 08 11:13:40.852325 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 08 11:13:40.852721 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.862241 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.862241 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.862241 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.862241 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.862241 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.862241 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.862241 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.862241 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.862867 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.862867 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.862867 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836074-3-iscsi {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.862867 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.862867 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.862867 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.862867 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.862867 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.863491 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.863491 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.863491 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.863491 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.863491 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.863491 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.863899 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.863899 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.863899 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.863899 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.863899 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.863899 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.863899 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.863899 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836074-3-iscsi {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.864404 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.864404 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.864404 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.864404 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.864709 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.864782 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.865078 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.865466 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.865788 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.866131 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.866457 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.866797 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.867104 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.867406 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.867759 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.868069 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.868385 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.868693 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.869000 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.869324 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.869635 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.869990 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.870314 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.870634 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.870888 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.871662 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.871989 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.872311 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.872621 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.872944 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.876543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.876543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.876543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.876543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.876543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.876543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.876543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.876543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.877222 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.877222 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.877222 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.877222 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.877222 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.877553 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.877829 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.878154 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.878463 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.878785 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.879110 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.879422 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.879833 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.880145 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.880467 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.880893 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.881202 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.881456 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.881848 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.882165 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.882486 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.882796 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.883103 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.883414 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.883719 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.884026 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.884332 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.884641 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.884948 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.885254 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.885559 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.885889 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.886198 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.886504 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.886875 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.887203 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.887513 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.887818 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.888133 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.888439 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.888759 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.889067 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.889374 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.889695 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.890028 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.890332 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.890651 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.890962 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.891272 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.891593 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.891892 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.892314 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.892638 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.892947 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.893254 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.893557 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.893882 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.894189 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.894496 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.894800 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.895105 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.895407 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.895728 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.896052 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.896362 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.896669 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.896976 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.897538 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.897843 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.898154 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.898618 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.898816 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.899152 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.899493 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.899814 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.900123 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.900436 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.900764 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.901077 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.901449 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.901829 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.902112 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.903311 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.903311 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.903595 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.903915 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.904237 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.904549 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.906404 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.906404 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.906404 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.906700 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 08 11:13:40.907161 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.907268 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 08 11:13:40.907364 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.907364 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.907528 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 08 11:13:40.907622 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.907724 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 08 11:13:40.907819 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.907905 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 08 11:13:40.907989 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.908074 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.908157 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.908249 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.908341 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.908427 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.908511 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.908611 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.908704 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.908806 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.909090 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.909211 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.909304 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.909391 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.909596 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.909709 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.909931 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.912134 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.912257 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.912370 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.912469 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.912616 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.912714 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.912807 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836074-3-iscsi {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.912900 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.912992 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.913086 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.913179 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.913264 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.913355 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.913439 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.913523 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.913615 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.913700 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.913700 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.913891 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.913984 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.914076 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.914076 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.914252 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.914358 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.914434 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.914506 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.914591 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.914672 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.914826 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.914909 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.914995 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.915078 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.915173 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.915258 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.915437 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.915539 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.915762 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.915894 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.916076 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.916204 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.916404 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.916543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.916720 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.916854 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.917128 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836074-3-iscsi {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.917228 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.917448 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.917552 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.917800 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.917897 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.918163 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.918774 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.918999 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.919301 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.919420 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.919515 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.919607 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.919693 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.919920 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.920024 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.920234 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.920342 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.920545 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.920638 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.920871 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.920972 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.921181 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.921274 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.921488 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.921590 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.921879 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.922005 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.922144 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.922246 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.922462 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.922555 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.922777 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.922882 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.923090 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.923193 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.923401 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.923502 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.923716 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.923825 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.923979 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.924072 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.924293 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.924394 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.924624 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.924725 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.924951 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.925056 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.925282 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.925381 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.925541 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.925643 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.925882 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.925992 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.926214 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.926320 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.926537 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.926629 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.926845 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.926938 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.927152 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.927252 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.927462 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.927588 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.927830 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.927935 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.928085 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.928283 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.928383 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.928482 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.928697 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.928792 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.929015 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.929154 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.929342 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.929477 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.929668 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.929822 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.929998 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.930104 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.930307 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.930400 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.930613 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.930713 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.930921 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.931025 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.931267 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.931368 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.931576 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.931678 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.931935 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.932042 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.932241 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.932378 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.932555 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.932706 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.932878 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.933034 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.933203 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.933351 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.933517 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.933690 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.933883 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.934029 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.934204 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.934345 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.934529 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.934659 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.934876 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.935043 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.935196 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.935358 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.935513 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.935615 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.935891 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.936015 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.936203 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.936529 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.936619 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.936869 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.936972 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.937185 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.937283 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.937501 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.937593 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.937843 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.937936 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.938154 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.938255 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.938465 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.938558 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.938775 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.938877 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.939125 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.939211 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.939585 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.939729 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.939847 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.939957 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.940083 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.940177 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.940393 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.940496 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.940702 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.940804 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.941011 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.941127 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.941323 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.941433 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.941635 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.941740 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.941972 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.942093 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.942286 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.942396 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.942579 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.942677 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.942892 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.942988 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.943210 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.943305 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.943516 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.943637 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.943826 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.943955 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.944159 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.944286 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.944465 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.944620 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.944772 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.944930 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.945094 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.945245 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.945405 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.945569 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.945715 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.945905 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.946077 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.946244 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.946378 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.946518 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.946692 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.946920 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.947040 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.947228 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.947325 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.947596 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.947692 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.947900 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.948020 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.948207 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.948314 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.948514 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.948611 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.948823 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.948925 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.949131 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.949271 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.949464 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.949564 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.949819 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.949940 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.950103 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.950212 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.950400 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.950500 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.950724 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.950828 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.951033 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.951142 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.951343 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.951440 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.951662 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.951765 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 11:13:40.951967 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.952078 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.952282 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.952465 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.952619 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.952783 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.952946 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.953120 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.953286 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.953454 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.953557 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.953644 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.953864 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.953968 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.954124 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.954259 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.954434 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.954579 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.954737 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.954912 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.955051 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.955228 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.955372 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.955542 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.955682 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.955857 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.955998 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.956181 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.956309 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.956503 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.956608 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.956838 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.956935 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.957159 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.957262 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.957482 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.957573 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.957824 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.957925 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.958142 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.958279 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.958451 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.958561 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.958765 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.958862 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.959096 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.959197 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.959413 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.959509 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.959757 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.959909 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.960100 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.960210 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.960405 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.960500 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.960714 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.960818 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.961030 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.961135 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.961353 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.961622 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.961788 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.961982 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.962080 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.962305 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.962448 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.962627 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.962782 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.962935 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.963082 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.963251 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.963414 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.963574 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.963719 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.963878 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.964047 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.964202 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.964328 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.964479 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.964595 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.964798 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.965452 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.965669 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.965811 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.966015 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.966122 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.967638 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.967793 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.967919 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.968017 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.968104 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.968207 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.968296 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.968381 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.968381 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.968590 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.968590 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.968759 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.968844 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.968844 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.969005 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.969099 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.969194 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.969281 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.969366 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.969462 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.969548 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.969799 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.969918 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.969996 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.970081 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.970327 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.970434 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.970639 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.970743 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.970947 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.971031 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.971360 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.971471 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.971571 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.971667 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.971890 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.971985 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.972196 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.972292 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.972541 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.972643 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.972862 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.972958 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.973177 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.973284 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.973487 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.973584 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.973833 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.973946 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.974139 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.974238 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.974449 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.974605 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.974757 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.974864 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.975073 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.975180 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.975386 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.975482 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.975707 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.975810 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.976023 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.976181 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.976335 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.976428 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.976650 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.976744 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.976967 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.977070 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.977297 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.977391 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.977618 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.977720 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.977963 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.978098 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.978309 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.978412 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.978652 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.978770 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.978960 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.979065 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.979291 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.979385 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.979613 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.979958 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.980187 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.980279 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.980496 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.980670 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.980871 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.980970 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.981181 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.981318 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.981490 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.981594 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.982320 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.982420 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.982628 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.982724 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.982935 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.983036 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.983236 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.983416 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.983544 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.983638 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.983857 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.983980 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.984161 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.984279 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.984487 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.984582 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.984798 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.984898 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.985101 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.985208 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.985406 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.985502 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.985714 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.985838 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.986042 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.986149 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.986348 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.986450 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.986657 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.986761 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.986980 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.987076 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.987296 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.987397 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.987600 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.987694 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.987910 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.988012 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.988222 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.988346 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.988527 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.988659 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.988904 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.989124 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.989222 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.989439 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.989543 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.989747 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.989931 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.990155 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.990285 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.990463 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.990565 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.990769 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.990909 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.991074 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.991169 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.991402 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.991539 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.991725 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.991828 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.992034 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.992136 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.992352 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.992456 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.992699 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.992802 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.993036 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.993133 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.993356 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.993450 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.993680 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.993834 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.994055 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.994166 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.994354 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.994465 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.994744 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.995040 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.995040 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.995201 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.995297 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.995395 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.995581 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.995749 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.995920 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.996071 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.996221 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.996386 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.996549 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.996700 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.996848 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.996999 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.997150 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.997290 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.997390 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.997478 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.997832 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.998002 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.998125 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.998229 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.998390 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.998484 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:40.999977 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.000098 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.000206 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.000353 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.000487 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.000578 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.000673 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.000802 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.000905 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.001040 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.001143 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.001232 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.001232 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.001395 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.001490 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.001490 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.001729 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.001853 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.001944 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.002030 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.002127 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.002254 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.002385 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.002574 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.002691 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.002891 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.002988 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.003198 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.003292 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.003507 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.003602 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.003818 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.003913 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.004124 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.004227 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.004449 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.004544 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.004841 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.005125 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.005125 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.005313 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.005401 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.005494 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.005650 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.005746 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.005999 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.006136 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.006307 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.006418 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.006637 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.006733 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.006946 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.007042 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.007273 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.007384 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.007589 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.007687 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.007898 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.007991 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.008206 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.008346 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.008515 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.008663 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.008863 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.008994 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.009180 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.009342 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.009483 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.009671 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.009828 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.010126 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.010242 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.010492 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.010607 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.010749 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.010842 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.011139 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.011250 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.011452 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.011586 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.012304 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.012446 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.012648 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.012815 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.012920 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.013156 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.013254 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.013489 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.013583 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.013841 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.013942 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.014165 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.014267 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.014492 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.014597 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.014805 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.014905 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.015124 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.015310 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.015441 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.015647 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.015750 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.015971 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.016065 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.016356 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.016457 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.016718 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.016947 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.017050 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.017290 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.017385 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.017613 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.017718 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.018075 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.018186 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.018401 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.018501 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.018591 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.018673 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.018920 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.019028 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.019254 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.019820 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.019928 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.020085 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.020189 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.020279 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.020374 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.020461 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.020689 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.020787 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.020873 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.020970 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.021097 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.021202 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.021409 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.021508 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.021720 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.021933 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.022055 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.022335 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.022484 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.022667 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.022768 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.022976 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.023079 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.023285 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.023380 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.023612 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.023727 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.023909 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.024016 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.024219 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.024321 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.024536 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.024647 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.024849 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.024954 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.025169 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.025263 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.025483 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.025633 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.025813 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.025968 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.026144 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.026243 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.026466 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.026578 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.026791 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.026959 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.027111 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.027263 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.027476 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.028131 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.028314 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.028482 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.028696 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.028834 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.028948 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.029039 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.029285 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.029436 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.029608 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.029729 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.029971 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.031321 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.031493 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.031595 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.031683 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.031777 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.031880 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.031968 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.032054 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.032054 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.032223 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.032317 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.032417 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.032505 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.032579 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.032715 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.032799 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.033034 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.033138 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.033368 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.033463 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.033697 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.033843 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.034046 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.034166 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.034361 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.034459 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.034679 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.034783 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.034995 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.035098 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.035306 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.035397 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.035622 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.035718 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.035935 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.036038 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.036243 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.036343 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.036557 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.036661 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.036868 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.036970 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.037182 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.037283 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.037490 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.037597 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.037817 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.037929 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.038130 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.038226 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.038441 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.038545 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.038752 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.038845 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.039059 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.039161 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.039388 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.039486 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.039777 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.039877 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.040010 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.040094 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.040318 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.040422 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.040633 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.040736 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.040942 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.041113 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.041252 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.041347 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.041551 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.041689 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.041902 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.042017 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.042224 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.042320 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.042531 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.042638 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.042843 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.042989 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.043279 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.043433 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.043526 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.043620 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.043820 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.043940 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.044086 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.044182 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.044393 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.044498 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.044703 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.044811 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.045015 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.045110 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.045320 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.045415 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.045627 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.045731 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.045989 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.046097 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.046304 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.046412 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.046614 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.046710 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.046924 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.047020 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.047256 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.047362 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.047605 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.047843 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.047937 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.048214 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.048328 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.048553 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.048647 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.048835 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.049066 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.049166 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.049300 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.049458 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.049544 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.049794 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.049912 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.050122 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.050344 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.050443 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.050529 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.051343 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.051447 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.051543 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.051694 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.051824 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.051928 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.052017 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.052144 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.052237 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.052337 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.052427 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.052513 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.052623 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.052716 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.052925 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.053069 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.053301 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.053403 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.053628 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.053726 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.054010 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.054144 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.054334 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.054440 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.054648 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.054844 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.054970 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.055296 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.055444 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.055608 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.055883 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.055999 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.056210 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.056306 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.056535 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.056642 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.056858 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.057047 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.057176 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.057381 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.057478 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.057707 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.057889 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.058127 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.058237 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.058461 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.058746 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.058857 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.059080 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.059233 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.059403 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.059507 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.059723 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.059829 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.060113 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.060223 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.060379 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.060613 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.060709 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.060935 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.061236 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.061507 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.061603 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.061690 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.061852 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.061971 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.062122 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.062228 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.062324 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.062567 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.063027 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.063474 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.063573 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.063655 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.063729 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.063840 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.064637 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.064821 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.064974 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.065125 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.065276 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.065443 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.065590 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.065694 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.065865 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.065978 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.066091 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.066192 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.066323 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.066556 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.066711 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.066872 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.067038 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.067038 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.067361 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.067515 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.067666 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.067816 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.067982 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.068149 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.068328 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.068483 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.068642 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.068798 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.068976 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.069147 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.069316 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.069445 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.069537 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.069683 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.069935 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.070092 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.070234 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.070381 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.070518 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.070654 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.070790 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.070954 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.071125 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.071290 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.071448 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.071448 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.071794 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.071958 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.072102 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.072317 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.072490 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.072490 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.072842 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.073080 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.073254 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.073407 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.073594 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.073691 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.073802 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.073881 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.073981 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.074070 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.074156 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.074787 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.074890 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.074981 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.074981 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.075157 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.075281 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.075599 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.075709 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.076005 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.076151 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.076246 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.076568 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.076704 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.076895 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.077282 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.077389 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.077644 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.077880 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.077994 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.078312 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.078459 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.078645 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.078956 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.079052 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.079296 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.079605 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.079856 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.079982 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.080177 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.080284 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.080573 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.080758 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.080886 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.081203 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.081421 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.081527 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.081852 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.082782 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.082903 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.082903 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.083064 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.083163 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.083163 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.083320 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.083408 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.083736 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.083956 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.084559 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.084559 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.084736 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.084824 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.084919 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.085096 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.085426 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.085591 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.085849 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.085972 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.086160 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.086274 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.086496 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.086753 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.086861 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.087104 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.087200 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.087440 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.087540 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.087766 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.087860 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.088105 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.088201 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.088434 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.088530 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.088747 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.088848 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.089062 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.089145 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.089440 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.089558 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.089716 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.089826 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.090608 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.090733 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.090949 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.091034 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.091261 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.091357 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.091572 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.091678 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.091887 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.091989 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.092198 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.092349 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.092509 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.092608 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.092818 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.092915 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.093131 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.093237 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.093440 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.093545 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.093750 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.093942 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.094099 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.094433 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.094744 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.095071 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.095387 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.095722 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.096034 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.096350 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.096718 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.097029 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.097372 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.097699 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.098059 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.098399 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.098510 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.098717 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.098848 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.099220 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.099326 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.099403 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.099610 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.099717 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.099896 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.099983 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.100242 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.100349 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.100577 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.100663 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.101023 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.101130 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.101309 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.101414 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.101621 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.101712 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.101860 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.101947 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.102182 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.102282 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.102506 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.102599 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.102879 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.103087 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.103325 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.103411 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.103657 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.103742 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.103992 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.104077 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.104329 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.104417 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.105082 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.105194 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.105273 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.105354 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.105565 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.105655 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.105911 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.106001 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.106220 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.106443 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.106527 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.106602 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.106855 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.106948 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.107185 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.107291 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.107515 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.107609 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.107860 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.107952 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.108185 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.108300 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.108500 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.108586 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.108818 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.108910 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.109141 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.109286 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.109465 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.109559 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.109813 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.109927 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.110133 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.110230 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.110450 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.110535 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.110769 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.110860 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.111088 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.111240 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.111400 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.111486 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.111720 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.111934 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.112072 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.112222 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.112333 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.112422 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.112631 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.112725 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.112944 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.113044 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.113253 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.113346 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.113574 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.113745 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.113966 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.114105 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.114244 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.114358 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.114512 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.114607 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.114825 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.114917 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.115145 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.115237 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.115459 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.115545 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.115773 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.116031 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.116114 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.116358 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.116464 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.116702 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.116805 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.117038 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.117134 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.117373 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.117477 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.117700 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.117845 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.118060 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.118173 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.118367 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.118470 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.118818 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.118982 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.119144 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.119300 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.119469 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.119684 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.120054 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.120255 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.120417 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.120546 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.120674 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.120790 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.120887 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.120983 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.121078 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.121192 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.121292 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.121390 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.121486 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.121693 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.123278 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.123428 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.123428 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.123575 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.123575 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.123725 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.123725 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.123876 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.123876 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.124017 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.124098 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.124342 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.124342 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.124540 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.124641 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.124726 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.124813 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.124999 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.125137 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.125328 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.125461 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.125650 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.125809 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.126010 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.126129 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.126335 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.126432 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.126658 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.126763 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.126984 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.127090 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.127308 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.127412 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.127624 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.127938 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.128489 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.128639 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.128882 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.129192 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.129511 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.129856 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.130173 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.130482 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.130794 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.131104 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.131422 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.131711 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.131823 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.132075 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.132185 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.132385 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.132483 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.132704 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.132809 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.133015 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.133192 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.133331 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.133536 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.133741 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.133935 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.134106 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.134290 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.134402 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.134635 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.134765 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.134966 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.135064 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.135292 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.135389 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.135552 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 08 11:13:41.135659 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.135963 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.136288 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.136646 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.137505 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.138116 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.138459 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.138785 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.139132 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.139475 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.139790 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.140099 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.140413 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.140830 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.141088 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.141405 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.141719 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.142065 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.142384 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.142698 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.143010 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.143326 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.143647 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.143954 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.144344 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.144586 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.144907 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.145267 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.145601 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.145955 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.146271 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.146596 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.146916 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.147228 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.147546 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.147860 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.148182 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.148516 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.148836 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.149149 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.149586 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.149925 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.150240 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.150630 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.150872 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.151203 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.153298 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.153298 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.153298 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.153298 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.153956 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.153956 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.154475 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.154921 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.155307 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.155918 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.156127 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.156318 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.156837 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.157216 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.157372 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.157558 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.157905 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.158221 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.158533 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.158844 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.159153 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.159468 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.159780 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.160090 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.160405 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.160862 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.161113 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.161341 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.161627 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.164111 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.164111 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.164111 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.164111 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.164111 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.164111 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.164111 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.164111 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.165162 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.165162 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.165162 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.165645 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_db.sqlalchemy.engines [None req-0a7f681f-a4fc-4c9e-baa7-013c3a58e98e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117800) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 08 11:13:41.165818 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.165818 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.166098 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.167353 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.167682 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.168048 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.168378 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.168705 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.169025 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.169348 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.169666 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.170011 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.170350 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.170688 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.171006 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.171343 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.171670 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.172002 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.172324 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.172644 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.172980 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.173296 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.173613 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.173973 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.174292 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.174610 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.174935 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.175256 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.175592 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.175927 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.176268 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.176599 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.176960 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.177283 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.177636 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.177996 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.178322 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.178643 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.178956 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 11:13:41.179208 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 08 11:13:41.204546 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_db.sqlalchemy.engines [None req-c9bdec59-c986-466c-a831-6f53ebf26e50 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117801) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 08 11:13:41.245622 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.context [None req-0a7f681f-a4fc-4c9e-baa7-013c3a58e98e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d6edf63b-1f02-42e6-8c3b-21b0e04531ff(cell1) {{(pid=117800) load_cells /opt/stack/nova/nova/context.py:464}} Apr 08 11:13:41.252205 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0a7f681f-a4fc-4c9e-baa7-013c3a58e98e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:13:41.255029 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0a7f681f-a4fc-4c9e-baa7-013c3a58e98e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:13:41.256191 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0a7f681f-a4fc-4c9e-baa7-013c3a58e98e None None] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:13:41.259545 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0a7f681f-a4fc-4c9e-baa7-013c3a58e98e None None] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:13:41.273513 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.context [None req-c9bdec59-c986-466c-a831-6f53ebf26e50 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d6edf63b-1f02-42e6-8c3b-21b0e04531ff(cell1) {{(pid=117801) load_cells /opt/stack/nova/nova/context.py:464}} Apr 08 11:13:41.278457 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c9bdec59-c986-466c-a831-6f53ebf26e50 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:13:41.280639 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c9bdec59-c986-466c-a831-6f53ebf26e50 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:13:41.281286 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_db.sqlalchemy.engines [None req-0a7f681f-a4fc-4c9e-baa7-013c3a58e98e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117800) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 08 11:13:41.281556 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c9bdec59-c986-466c-a831-6f53ebf26e50 None None] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:13:41.283677 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c9bdec59-c986-466c-a831-6f53ebf26e50 None None] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:13:41.283866 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_db.sqlalchemy.engines [None req-0a7f681f-a4fc-4c9e-baa7-013c3a58e98e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117800) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 08 11:13:41.296534 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_db.sqlalchemy.engines [None req-c9bdec59-c986-466c-a831-6f53ebf26e50 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117801) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 08 11:13:41.297877 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_db.sqlalchemy.engines [None req-c9bdec59-c986-466c-a831-6f53ebf26e50 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117801) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 08 11:13:41.481133 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_db.sqlalchemy.engines [None req-0a7f681f-a4fc-4c9e-baa7-013c3a58e98e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117800) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 08 11:13:41.485736 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_db.sqlalchemy.engines [None req-c9bdec59-c986-466c-a831-6f53ebf26e50 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117801) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 08 11:13:41.976309 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: WARNING keystonemiddleware.auth_token [None req-c9bdec59-c986-466c-a831-6f53ebf26e50 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 08 11:13:41.984476 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: WARNING keystonemiddleware.auth_token [None req-c9bdec59-c986-466c-a831-6f53ebf26e50 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 08 11:13:42.002613 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: WARNING keystonemiddleware.auth_token [None req-0a7f681f-a4fc-4c9e-baa7-013c3a58e98e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 08 11:13:42.009215 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: WARNING keystonemiddleware.auth_token [None req-0a7f681f-a4fc-4c9e-baa7-013c3a58e98e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 08 11:13:42.211554 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: WARNING keystonemiddleware.auth_token [None req-c9bdec59-c986-466c-a831-6f53ebf26e50 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 08 11:13:42.217254 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: WARNING keystonemiddleware.auth_token [None req-c9bdec59-c986-466c-a831-6f53ebf26e50 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 08 11:13:42.222718 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5559904689c0 pid: 117801 (default app) Apr 08 11:13:42.236579 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: WARNING keystonemiddleware.auth_token [None req-0a7f681f-a4fc-4c9e-baa7-013c3a58e98e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 08 11:13:42.241698 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: WARNING keystonemiddleware.auth_token [None req-0a7f681f-a4fc-4c9e-baa7-013c3a58e98e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 08 11:13:42.247174 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5559904689c0 pid: 117800 (default app) Apr 08 11:14:26.135257 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-8ec8386e-8d5b-47e9-a45e-489f2909485e tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] Action: 'create', calling method: .version_select at 0x7f04254fe820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-543148541"}} {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:14:27.415594 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-051c4649-adc9-45b5-8a3a-cc18e76e80b9 tempest-VolumesGetTestJSON-1362649758 tempest-VolumesGetTestJSON-1362649758-project] Action: 'create', calling method: .version_select at 0x7f04254fc820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-850759625", "metadata": {"Type": "work"}}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:14:29.079671 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-8ec8386e-8d5b-47e9-a45e-489f2909485e tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 4.636424 Apr 08 11:14:29.080683 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 1/1] 10.222.0.46 () {60 vars in 1154 bytes} [Fri Apr 8 11:14:24 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 4639 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 08 11:14:29.094998 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-6834fe1f-d9ee-4f8b-aff0-49518d91675e tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] Calling method '.version_select at 0x7f04253d2820>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:29.232927 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-6834fe1f-d9ee-4f8b-aff0-49518d91675e tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/153f2aee-608f-4c18-99a6-8eae740bab4b" status: 200 len: 344 microversion: 2.1 time: 0.140190 Apr 08 11:14:29.235872 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 2/2] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Apr 8 11:14:29 2022] GET /compute/v2.1/os-volumes/153f2aee-608f-4c18-99a6-8eae740bab4b => generated 344 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:14:29.816100 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-051c4649-adc9-45b5-8a3a-cc18e76e80b9 tempest-VolumesGetTestJSON-1362649758 tempest-VolumesGetTestJSON-1362649758-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.720763 Apr 08 11:14:29.816100 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1/3] 10.222.0.46 () {60 vars in 1155 bytes} [Fri Apr 8 11:14:26 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3723 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 08 11:14:29.821212 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a9fd48c3-eb26-4a10-aff2-844074c155f2 tempest-VolumesGetTestJSON-1362649758 tempest-VolumesGetTestJSON-1362649758-project] Calling method '.version_select at 0x7f04253d29d0>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:29.940635 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a9fd48c3-eb26-4a10-aff2-844074c155f2 tempest-VolumesGetTestJSON-1362649758 tempest-VolumesGetTestJSON-1362649758-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/1bcb3388-e6d8-4d5b-85e6-1de60cea5fca" status: 200 len: 352 microversion: 2.1 time: 0.123189 Apr 08 11:14:29.941390 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 3/4] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Apr 8 11:14:29 2022] GET /compute/v2.1/os-volumes/1bcb3388-e6d8-4d5b-85e6-1de60cea5fca => generated 352 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:14:30.077078 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-be6db390-45d6-46a6-8e6a-52426c1f28a6 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-475604827", "imageRef": "35b8d8d2-a0e9-4c3e-8586-5e088dec27e6", "flavorRef": "452", "networks": [{"uuid": "073ef550-4faf-436a-86ec-cbe617bca35e"}]}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:14:30.193310 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.network.neutron [None req-be6db390-45d6-46a6-8e6a-52426c1f28a6 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] validate_networks() for [('073ef550-4faf-436a-86ec-cbe617bca35e', None, None, None, None, None)] {{(pid=117800) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 08 11:14:30.247083 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-954d47f2-5358-41bf-a634-d8188203db2b tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] Calling method '.version_select at 0x7f04253e2040>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:30.363647 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-954d47f2-5358-41bf-a634-d8188203db2b tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/153f2aee-608f-4c18-99a6-8eae740bab4b" status: 200 len: 344 microversion: 2.1 time: 0.122316 Apr 08 11:14:30.368703 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 4/5] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Apr 8 11:14:30 2022] GET /compute/v2.1/os-volumes/153f2aee-608f-4c18-99a6-8eae740bab4b => generated 344 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:14:30.960777 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-728b32d8-2547-4d5e-bc0c-b9d293e82a34 tempest-VolumesGetTestJSON-1362649758 tempest-VolumesGetTestJSON-1362649758-project] Calling method '.version_select at 0x7f04253e2700>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:31.051337 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-728b32d8-2547-4d5e-bc0c-b9d293e82a34 tempest-VolumesGetTestJSON-1362649758 tempest-VolumesGetTestJSON-1362649758-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/1bcb3388-e6d8-4d5b-85e6-1de60cea5fca" status: 200 len: 352 microversion: 2.1 time: 0.100161 Apr 08 11:14:31.055222 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 5/6] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Apr 8 11:14:30 2022] GET /compute/v2.1/os-volumes/1bcb3388-e6d8-4d5b-85e6-1de60cea5fca => generated 352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:14:31.348131 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-346902d3-3768-4781-8959-84e8f2c1375f tempest-VolumesTestJSON-441933602 tempest-VolumesTestJSON-441933602-project] Calling method '.version_select at 0x7f04253d2e50>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:31.352506 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-be6db390-45d6-46a6-8e6a-52426c1f28a6 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Flavor limits 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 11:14:31.352995 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-be6db390-45d6-46a6-8e6a-52426c1f28a6 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Image limits 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 11:14:31.354313 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-be6db390-45d6-46a6-8e6a-52426c1f28a6 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Flavor pref 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 11:14:31.354741 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-be6db390-45d6-46a6-8e6a-52426c1f28a6 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Image pref 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 11:14:31.356376 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-be6db390-45d6-46a6-8e6a-52426c1f28a6 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 11:14:31.423036 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-be6db390-45d6-46a6-8e6a-52426c1f28a6 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:31.424643 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-be6db390-45d6-46a6-8e6a-52426c1f28a6 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:31.428185 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-be6db390-45d6-46a6-8e6a-52426c1f28a6 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:31.428914 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-be6db390-45d6-46a6-8e6a-52426c1f28a6 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:31.446282 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-346902d3-3768-4781-8959-84e8f2c1375f tempest-VolumesTestJSON-441933602 tempest-VolumesTestJSON-441933602-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/e0556720-4e70-4746-9751-e07d77896093" status: 200 len: 350 microversion: 2.1 time: 0.101720 Apr 08 11:14:31.460896 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 6/7] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Apr 8 11:14:31 2022] GET /compute/v2.1/os-volumes/e0556720-4e70-4746-9751-e07d77896093 => generated 350 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:14:31.467889 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-c984c61b-a529-4a2b-a03c-6a1274413e94 tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] Calling method '.version_select at 0x7f04253e2af0>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:31.540873 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-be6db390-45d6-46a6-8e6a-52426c1f28a6 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Getting quotas for project d1a05f833c354a00a03d62f49c9e3402. Resources: {'instances', 'ram', 'cores'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 11:14:31.592103 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-be6db390-45d6-46a6-8e6a-52426c1f28a6 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Getting quotas for user 44deb9de4511458ba769ad2b8b26651c and project d1a05f833c354a00a03d62f49c9e3402. Resources: {'instances', 'ram', 'cores'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 11:14:31.623174 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-be6db390-45d6-46a6-8e6a-52426c1f28a6 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Going to run 1 instances... {{(pid=117800) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 08 11:14:31.631319 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-be6db390-45d6-46a6-8e6a-52426c1f28a6 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='35b8d8d2-a0e9-4c3e-8586-5e088dec27e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 08 11:14:31.635696 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-c984c61b-a529-4a2b-a03c-6a1274413e94 tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/153f2aee-608f-4c18-99a6-8eae740bab4b" status: 200 len: 345 microversion: 2.1 time: 0.173241 Apr 08 11:14:31.636276 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 7/8] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Apr 8 11:14:31 2022] GET /compute/v2.1/os-volumes/153f2aee-608f-4c18-99a6-8eae740bab4b => generated 345 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:14:31.649658 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-963c399c-a4d6-42d6-be48-73a30137e446 tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] Action: 'create', calling method: .version_select at 0x7f04253e2430>, body: {"snapshot": {"volume_id": "153f2aee-608f-4c18-99a6-8eae740bab4b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1634894826"}} {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:14:31.879563 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-be6db390-45d6-46a6-8e6a-52426c1f28a6 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.910569 Apr 08 11:14:31.880413 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2/9] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Apr 8 11:14:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 11:14:31.917631 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-224d3c39-8d82-43f7-aa82-b4193611f462 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:31.920496 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-224d3c39-8d82-43f7-aa82-b4193611f462 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:14:32.071828 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-224d3c39-8d82-43f7-aa82-b4193611f462 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44deb9de4511458ba769ad2b8b26651c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a05f833c354a00a03d62f49c9e3402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:32.106348 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-224d3c39-8d82-43f7-aa82-b4193611f462 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 200 len: 1214 microversion: 2.1 time: 0.209918 Apr 08 11:14:32.575269 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 3/10] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:14:31 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 1214 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:14:32.575269 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-32e54a1c-50b9-4253-8622-075cb94f0eb1 tempest-VolumesGetTestJSON-1362649758 tempest-VolumesGetTestJSON-1362649758-project] Calling method '.version_select at 0x7f04252e0d30>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:32.786162 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-963c399c-a4d6-42d6-be48-73a30137e446 tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] 10.222.0.46 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.142433 Apr 08 11:14:32.795597 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 8/11] 10.222.0.46 () {60 vars in 1161 bytes} [Fri Apr 8 11:14:31 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:14:32.804626 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-1ec1b071-f538-4379-ae77-7a614ec96f2b tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] Calling method '.version_select at 0x7f04253e2d30>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:32.859878 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-32e54a1c-50b9-4253-8622-075cb94f0eb1 tempest-VolumesGetTestJSON-1362649758 tempest-VolumesGetTestJSON-1362649758-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/1bcb3388-e6d8-4d5b-85e6-1de60cea5fca" status: 200 len: 353 microversion: 2.1 time: 0.740319 Apr 08 11:14:32.860879 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 4/12] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Apr 8 11:14:32 2022] GET /compute/v2.1/os-volumes/1bcb3388-e6d8-4d5b-85e6-1de60cea5fca => generated 353 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:14:32.872469 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-adf33415-3a2d-42ec-be35-30a175131562 tempest-VolumesGetTestJSON-1362649758 tempest-VolumesGetTestJSON-1362649758-project] Calling method '.version_select at 0x7f0424aa09d0>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:32.952391 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-1ec1b071-f538-4379-ae77-7a614ec96f2b tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/fb20da4f-9f80-4c9d-9b33-83419f9eab89" status: 200 len: 287 microversion: 2.1 time: 0.152951 Apr 08 11:14:32.953282 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 9/13] 10.222.0.46 () {58 vars in 1250 bytes} [Fri Apr 8 11:14:32 2022] GET /compute/v2.1/os-snapshots/fb20da4f-9f80-4c9d-9b33-83419f9eab89 => generated 287 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:14:32.963511 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-958d0cbf-1855-4b81-9c50-d891c6038580 tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] Calling method '.version_select at 0x7f04253e2940>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:33.021892 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-adf33415-3a2d-42ec-be35-30a175131562 tempest-VolumesGetTestJSON-1362649758 tempest-VolumesGetTestJSON-1362649758-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/1bcb3388-e6d8-4d5b-85e6-1de60cea5fca" status: 200 len: 353 microversion: 2.1 time: 0.153995 Apr 08 11:14:33.023276 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 5/14] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Apr 8 11:14:32 2022] GET /compute/v2.1/os-volumes/1bcb3388-e6d8-4d5b-85e6-1de60cea5fca => generated 353 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:14:33.041674 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0403b116-2d2c-44b0-a1f9-2b74ff9f6183 tempest-VolumesGetTestJSON-1362649758 tempest-VolumesGetTestJSON-1362649758-project] Calling method '.version_select at 0x7f042422c0d0>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:33.048952 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-958d0cbf-1855-4b81-9c50-d891c6038580 tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.088585 Apr 08 11:14:33.051207 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 10/15] 10.222.0.46 () {58 vars in 1139 bytes} [Fri Apr 8 11:14:32 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:14:33.062716 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-87c49f4c-a6c0-4e8d-a3f2-dbe14037da9a tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] Calling method '.version_select at 0x7f04253d2c10>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:33.148373 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-87c49f4c-a6c0-4e8d-a3f2-dbe14037da9a tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/fb20da4f-9f80-4c9d-9b33-83419f9eab89" status: 200 len: 287 microversion: 2.1 time: 0.091517 Apr 08 11:14:33.149127 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 11/16] 10.222.0.46 () {58 vars in 1250 bytes} [Fri Apr 8 11:14:33 2022] GET /compute/v2.1/os-snapshots/fb20da4f-9f80-4c9d-9b33-83419f9eab89 => generated 287 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:14:33.155740 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-75c0d3f3-d12e-4f29-af10-9a045eef44e0 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:33.156723 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-75c0d3f3-d12e-4f29-af10-9a045eef44e0 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:14:33.381244 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-75c0d3f3-d12e-4f29-af10-9a045eef44e0 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44deb9de4511458ba769ad2b8b26651c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a05f833c354a00a03d62f49c9e3402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:33.433106 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-75c0d3f3-d12e-4f29-af10-9a045eef44e0 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 200 len: 1214 microversion: 2.1 time: 0.281755 Apr 08 11:14:33.434320 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 12/17] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:14:33 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 1214 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:14:33.468599 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0403b116-2d2c-44b0-a1f9-2b74ff9f6183 tempest-VolumesGetTestJSON-1362649758 tempest-VolumesGetTestJSON-1362649758-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/1bcb3388-e6d8-4d5b-85e6-1de60cea5fca" status: 202 len: 0 microversion: 2.1 time: 0.431324 Apr 08 11:14:33.469173 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 6/18] 10.222.0.46 () {58 vars in 1247 bytes} [Fri Apr 8 11:14:33 2022] DELETE /compute/v2.1/os-volumes/1bcb3388-e6d8-4d5b-85e6-1de60cea5fca => generated 0 bytes in 433 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 08 11:14:33.477922 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e42ce2bc-8d79-4d01-b60a-f7abd59209d4 tempest-VolumesGetTestJSON-1362649758 tempest-VolumesGetTestJSON-1362649758-project] Calling method '.version_select at 0x7f04253e2dc0>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:33.585104 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e42ce2bc-8d79-4d01-b60a-f7abd59209d4 tempest-VolumesGetTestJSON-1362649758 tempest-VolumesGetTestJSON-1362649758-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/1bcb3388-e6d8-4d5b-85e6-1de60cea5fca" status: 200 len: 352 microversion: 2.1 time: 0.110734 Apr 08 11:14:33.586063 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 13/19] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Apr 8 11:14:33 2022] GET /compute/v2.1/os-volumes/1bcb3388-e6d8-4d5b-85e6-1de60cea5fca => generated 352 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:14:34.161525 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-61637288-bc0b-45bb-856c-b38b2438b97a tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] Calling method '.version_select at 0x7f0424aa0af0>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:34.233310 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-61637288-bc0b-45bb-856c-b38b2438b97a tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/fb20da4f-9f80-4c9d-9b33-83419f9eab89" status: 200 len: 287 microversion: 2.1 time: 0.075528 Apr 08 11:14:34.246199 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 7/20] 10.222.0.46 () {58 vars in 1250 bytes} [Fri Apr 8 11:14:34 2022] GET /compute/v2.1/os-snapshots/fb20da4f-9f80-4c9d-9b33-83419f9eab89 => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:14:34.450986 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-92ae3c1c-9c3a-4e99-ba96-6e4a1654d544 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:34.454397 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-92ae3c1c-9c3a-4e99-ba96-6e4a1654d544 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:14:34.474237 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-92ae3c1c-9c3a-4e99-ba96-6e4a1654d544 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:34.475058 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-92ae3c1c-9c3a-4e99-ba96-6e4a1654d544 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:34.475920 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-92ae3c1c-9c3a-4e99-ba96-6e4a1654d544 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:34.476372 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-92ae3c1c-9c3a-4e99-ba96-6e4a1654d544 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:34.597575 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-db1d7963-e42a-44db-b5f1-6fa35128ed04 tempest-VolumesGetTestJSON-1362649758 tempest-VolumesGetTestJSON-1362649758-project] Calling method '.version_select at 0x7f0424a895e0>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:34.732740 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-db1d7963-e42a-44db-b5f1-6fa35128ed04 tempest-VolumesGetTestJSON-1362649758 tempest-VolumesGetTestJSON-1362649758-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/1bcb3388-e6d8-4d5b-85e6-1de60cea5fca" status: 200 len: 352 microversion: 2.1 time: 0.138822 Apr 08 11:14:34.733627 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 8/21] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Apr 8 11:14:34 2022] GET /compute/v2.1/os-volumes/1bcb3388-e6d8-4d5b-85e6-1de60cea5fca => generated 352 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:14:34.812691 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-92ae3c1c-9c3a-4e99-ba96-6e4a1654d544 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44deb9de4511458ba769ad2b8b26651c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a05f833c354a00a03d62f49c9e3402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:34.827455 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-92ae3c1c-9c3a-4e99-ba96-6e4a1654d544 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 200 len: 1218 microversion: 2.1 time: 0.380695 Apr 08 11:14:34.828056 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 14/22] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:14:34 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 1218 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:14:35.143470 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7192eda9-9951-4f8a-b96d-6f751dd1596a tempest-VolumesTestJSON-441933602 tempest-VolumesTestJSON-441933602-project] Calling method '.version_select at 0x7f042422c3a0>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:35.255191 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-ce0a9089-5185-4d5d-9a0d-a218c2a28e59 tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] Calling method '.version_select at 0x7f0425324f70>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:35.289117 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7192eda9-9951-4f8a-b96d-6f751dd1596a tempest-VolumesTestJSON-441933602 tempest-VolumesTestJSON-441933602-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/ceacf9c2-3715-44c9-9553-36bd84b3d0cc" status: 200 len: 351 microversion: 2.1 time: 0.149724 Apr 08 11:14:35.296342 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 9/23] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Apr 8 11:14:35 2022] GET /compute/v2.1/os-volumes/ceacf9c2-3715-44c9-9553-36bd84b3d0cc => generated 351 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:14:35.339317 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-ce0a9089-5185-4d5d-9a0d-a218c2a28e59 tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/fb20da4f-9f80-4c9d-9b33-83419f9eab89" status: 200 len: 287 microversion: 2.1 time: 0.097171 Apr 08 11:14:35.345921 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 15/24] 10.222.0.46 () {58 vars in 1250 bytes} [Fri Apr 8 11:14:35 2022] GET /compute/v2.1/os-snapshots/fb20da4f-9f80-4c9d-9b33-83419f9eab89 => generated 287 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:14:35.746935 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9696beb9-b681-4a51-bfbd-7f52f39a7d6e tempest-VolumesGetTestJSON-1362649758 tempest-VolumesGetTestJSON-1362649758-project] Calling method '.version_select at 0x7f04252e0dc0>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:35.847089 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e7b008cc-6cc8-4eef-bab3-7d687749debe tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:35.848386 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e7b008cc-6cc8-4eef-bab3-7d687749debe tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:14:35.873608 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e7b008cc-6cc8-4eef-bab3-7d687749debe tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:35.873608 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e7b008cc-6cc8-4eef-bab3-7d687749debe tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:35.873608 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e7b008cc-6cc8-4eef-bab3-7d687749debe tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:35.873608 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e7b008cc-6cc8-4eef-bab3-7d687749debe tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:35.886057 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9696beb9-b681-4a51-bfbd-7f52f39a7d6e tempest-VolumesGetTestJSON-1362649758 tempest-VolumesGetTestJSON-1362649758-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/1bcb3388-e6d8-4d5b-85e6-1de60cea5fca" status: 200 len: 352 microversion: 2.1 time: 0.144290 Apr 08 11:14:35.887201 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 10/25] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Apr 8 11:14:35 2022] GET /compute/v2.1/os-volumes/1bcb3388-e6d8-4d5b-85e6-1de60cea5fca => generated 352 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:14:35.978444 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e7b008cc-6cc8-4eef-bab3-7d687749debe tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44deb9de4511458ba769ad2b8b26651c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a05f833c354a00a03d62f49c9e3402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:35.990436 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e7b008cc-6cc8-4eef-bab3-7d687749debe tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 200 len: 1218 microversion: 2.1 time: 0.147259 Apr 08 11:14:35.992845 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 16/26] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:14:35 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 1218 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:14:36.352179 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-cae00c12-b0e5-4674-8417-429c483d8f46 tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] Calling method '.version_select at 0x7f0424aa0940>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:36.456268 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-cae00c12-b0e5-4674-8417-429c483d8f46 tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/fb20da4f-9f80-4c9d-9b33-83419f9eab89" status: 200 len: 287 microversion: 2.1 time: 0.108077 Apr 08 11:14:36.457279 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 11/27] 10.222.0.46 () {58 vars in 1250 bytes} [Fri Apr 8 11:14:36 2022] GET /compute/v2.1/os-snapshots/fb20da4f-9f80-4c9d-9b33-83419f9eab89 => generated 287 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:14:36.899893 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-b7392faa-1287-4fda-910a-33fcb64e5554 tempest-VolumesGetTestJSON-1362649758 tempest-VolumesGetTestJSON-1362649758-project] Calling method '.version_select at 0x7f04252b4700>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:37.010382 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-06ce06aa-cd80-4212-a6c6-2ea0fc02b9c3 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:37.011026 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-06ce06aa-cd80-4212-a6c6-2ea0fc02b9c3 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:14:37.027006 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-06ce06aa-cd80-4212-a6c6-2ea0fc02b9c3 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:37.027521 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-06ce06aa-cd80-4212-a6c6-2ea0fc02b9c3 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:37.028331 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-06ce06aa-cd80-4212-a6c6-2ea0fc02b9c3 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:37.038717 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-06ce06aa-cd80-4212-a6c6-2ea0fc02b9c3 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:37.062402 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-b7392faa-1287-4fda-910a-33fcb64e5554 tempest-VolumesGetTestJSON-1362649758 tempest-VolumesGetTestJSON-1362649758-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/1bcb3388-e6d8-4d5b-85e6-1de60cea5fca" status: 200 len: 352 microversion: 2.1 time: 0.166210 Apr 08 11:14:37.063625 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 17/28] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Apr 8 11:14:36 2022] GET /compute/v2.1/os-volumes/1bcb3388-e6d8-4d5b-85e6-1de60cea5fca => generated 352 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:14:37.475556 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-ed28ed84-cbaa-4813-81f4-f1bd38b67b10 tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] Calling method '.version_select at 0x7f04252b48b0>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:37.562738 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-ed28ed84-cbaa-4813-81f4-f1bd38b67b10 tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/fb20da4f-9f80-4c9d-9b33-83419f9eab89" status: 200 len: 287 microversion: 2.1 time: 0.097099 Apr 08 11:14:37.563674 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 18/29] 10.222.0.46 () {58 vars in 1250 bytes} [Fri Apr 8 11:14:37 2022] GET /compute/v2.1/os-snapshots/fb20da4f-9f80-4c9d-9b33-83419f9eab89 => generated 287 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:14:37.749123 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-06ce06aa-cd80-4212-a6c6-2ea0fc02b9c3 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44deb9de4511458ba769ad2b8b26651c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a05f833c354a00a03d62f49c9e3402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:37.788042 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-06ce06aa-cd80-4212-a6c6-2ea0fc02b9c3 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 200 len: 1218 microversion: 2.1 time: 0.781501 Apr 08 11:14:37.793025 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 12/30] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:14:37 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 1218 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:14:38.085626 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3eda2ae9-05e9-40d1-9668-b02d4f169d62 tempest-VolumesGetTestJSON-1362649758 tempest-VolumesGetTestJSON-1362649758-project] Calling method '.version_select at 0x7f04241a9160>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:38.241340 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-7065ee79-d786-4335-bd38-851822c38d38 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1608154382", "imageRef": "35b8d8d2-a0e9-4c3e-8586-5e088dec27e6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:14:38.266558 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3eda2ae9-05e9-40d1-9668-b02d4f169d62 tempest-VolumesGetTestJSON-1362649758 tempest-VolumesGetTestJSON-1362649758-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/1bcb3388-e6d8-4d5b-85e6-1de60cea5fca" status: 200 len: 352 microversion: 2.1 time: 0.180003 Apr 08 11:14:38.266558 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 13/31] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Apr 8 11:14:38 2022] GET /compute/v2.1/os-volumes/1bcb3388-e6d8-4d5b-85e6-1de60cea5fca => generated 352 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:14:38.504620 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.network.neutron [None req-7065ee79-d786-4335-bd38-851822c38d38 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] validate_networks() for [('c130d358-962f-43d2-8806-6bdc4416af3f', None, None, None, None, None)] {{(pid=117801) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 08 11:14:38.576915 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f93b30d9-3b49-42c0-a7e8-606d7eeb3abe tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] Calling method '.version_select at 0x7f04241a9a60>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:38.725536 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f93b30d9-3b49-42c0-a7e8-606d7eeb3abe tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/fb20da4f-9f80-4c9d-9b33-83419f9eab89" status: 200 len: 287 microversion: 2.1 time: 0.154536 Apr 08 11:14:38.730177 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 14/32] 10.222.0.46 () {58 vars in 1250 bytes} [Fri Apr 8 11:14:38 2022] GET /compute/v2.1/os-snapshots/fb20da4f-9f80-4c9d-9b33-83419f9eab89 => generated 287 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:14:38.814222 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5dc3c896-0c41-419a-81b3-6c012f1c06b0 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:38.816506 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5dc3c896-0c41-419a-81b3-6c012f1c06b0 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:14:38.832680 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5dc3c896-0c41-419a-81b3-6c012f1c06b0 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:38.837452 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5dc3c896-0c41-419a-81b3-6c012f1c06b0 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:38.839640 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5dc3c896-0c41-419a-81b3-6c012f1c06b0 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:38.844021 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5dc3c896-0c41-419a-81b3-6c012f1c06b0 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:38.969992 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5dc3c896-0c41-419a-81b3-6c012f1c06b0 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44deb9de4511458ba769ad2b8b26651c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a05f833c354a00a03d62f49c9e3402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:38.977786 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5dc3c896-0c41-419a-81b3-6c012f1c06b0 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 200 len: 1218 microversion: 2.1 time: 0.169009 Apr 08 11:14:38.991818 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 15/33] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:14:38 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 1218 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:14:39.278672 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1ff5d73d-2d32-4556-b178-9f9649514761 tempest-VolumesGetTestJSON-1362649758 tempest-VolumesGetTestJSON-1362649758-project] Calling method '.version_select at 0x7f0424aa0e50>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:39.416443 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1ff5d73d-2d32-4556-b178-9f9649514761 tempest-VolumesGetTestJSON-1362649758 tempest-VolumesGetTestJSON-1362649758-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/1bcb3388-e6d8-4d5b-85e6-1de60cea5fca" status: 200 len: 352 microversion: 2.1 time: 0.147643 Apr 08 11:14:39.416903 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 16/34] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Apr 8 11:14:39 2022] GET /compute/v2.1/os-volumes/1bcb3388-e6d8-4d5b-85e6-1de60cea5fca => generated 352 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:14:39.738653 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a31b1298-de60-4ab6-ab0a-393940151180 tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] Calling method '.version_select at 0x7f04241cbe50>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:39.818054 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a31b1298-de60-4ab6-ab0a-393940151180 tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/fb20da4f-9f80-4c9d-9b33-83419f9eab89" status: 200 len: 287 microversion: 2.1 time: 0.083281 Apr 08 11:14:39.822312 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 17/35] 10.222.0.46 () {58 vars in 1250 bytes} [Fri Apr 8 11:14:39 2022] GET /compute/v2.1/os-snapshots/fb20da4f-9f80-4c9d-9b33-83419f9eab89 => generated 287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:14:39.937839 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.virt.hardware [None req-7065ee79-d786-4335-bd38-851822c38d38 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Flavor limits 0:0:0 {{(pid=117801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 11:14:39.939131 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.virt.hardware [None req-7065ee79-d786-4335-bd38-851822c38d38 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Image limits 0:0:0 {{(pid=117801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 11:14:39.939720 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.virt.hardware [None req-7065ee79-d786-4335-bd38-851822c38d38 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Flavor pref 0:0:0 {{(pid=117801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 11:14:39.940365 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.virt.hardware [None req-7065ee79-d786-4335-bd38-851822c38d38 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Image pref 0:0:0 {{(pid=117801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 11:14:39.940899 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.virt.hardware [None req-7065ee79-d786-4335-bd38-851822c38d38 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 11:14:39.959955 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7065ee79-d786-4335-bd38-851822c38d38 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:39.961005 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7065ee79-d786-4335-bd38-851822c38d38 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:39.963146 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7065ee79-d786-4335-bd38-851822c38d38 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:39.964052 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7065ee79-d786-4335-bd38-851822c38d38 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:40.000057 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-17913b03-595a-44e2-b465-af710801276a tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:40.000684 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-17913b03-595a-44e2-b465-af710801276a tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:14:40.010883 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-17913b03-595a-44e2-b465-af710801276a tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:40.018848 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-17913b03-595a-44e2-b465-af710801276a tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:40.020047 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-17913b03-595a-44e2-b465-af710801276a tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:40.022770 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.quota [None req-7065ee79-d786-4335-bd38-851822c38d38 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Getting quotas for project 53fe2dc297a34f0281e7a165efea5957. Resources: {'instances', 'ram', 'cores'} {{(pid=117801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 11:14:40.023619 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-17913b03-595a-44e2-b465-af710801276a tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:40.037251 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.quota [None req-7065ee79-d786-4335-bd38-851822c38d38 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Getting quotas for user 6b5bdfdda63241d284449c6b2ec5c46b and project 53fe2dc297a34f0281e7a165efea5957. Resources: {'instances', 'ram', 'cores'} {{(pid=117801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 11:14:40.087931 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-7065ee79-d786-4335-bd38-851822c38d38 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Going to run 1 instances... {{(pid=117801) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 08 11:14:40.098740 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-7065ee79-d786-4335-bd38-851822c38d38 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: ea2b616a-165e-4f06-9017-37a69bc2a874] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='35b8d8d2-a0e9-4c3e-8586-5e088dec27e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 08 11:14:40.513417 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-7065ee79-d786-4335-bd38-851822c38d38 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.621413 Apr 08 11:14:40.513417 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 19/36] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Apr 8 11:14:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 2629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 11:14:40.622054 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-f6e2c7bd-7807-4bf4-9170-71f90fcc12c2 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Action: 'create', calling method: .version_select at 0x7f04249bddc0>, body: {"keypair": {"name": "tempest-keypair-1755896538"}} {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:14:40.687681 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-17913b03-595a-44e2-b465-af710801276a tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44deb9de4511458ba769ad2b8b26651c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a05f833c354a00a03d62f49c9e3402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:40.703612 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-17913b03-595a-44e2-b465-af710801276a tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 200 len: 1210 microversion: 2.1 time: 0.708400 Apr 08 11:14:40.712012 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 18/37] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:14:39 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 1210 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:14:40.716976 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-138034f9-78bf-4ee0-8b51-1418c4c28d10 tempest-VolumesGetTestJSON-1362649758 tempest-VolumesGetTestJSON-1362649758-project] Calling method '.version_select at 0x7f0424aa0ee0>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:40.841992 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-138034f9-78bf-4ee0-8b51-1418c4c28d10 tempest-VolumesGetTestJSON-1362649758 tempest-VolumesGetTestJSON-1362649758-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/1bcb3388-e6d8-4d5b-85e6-1de60cea5fca" status: 200 len: 352 microversion: 2.1 time: 0.123743 Apr 08 11:14:40.841992 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 19/38] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Apr 8 11:14:40 2022] GET /compute/v2.1/os-volumes/1bcb3388-e6d8-4d5b-85e6-1de60cea5fca => generated 352 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:14:40.842761 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e448ee65-3fcc-46ca-9a5a-e1e659e9df0c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:40.843285 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e448ee65-3fcc-46ca-9a5a-e1e659e9df0c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: ea2b616a-165e-4f06-9017-37a69bc2a874] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:14:41.055013 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.quota [None req-f6e2c7bd-7807-4bf4-9170-71f90fcc12c2 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Getting quotas for project bab0811e055f46b98a70790223b64a13. Resources: {'key_pairs'} {{(pid=117801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 11:14:41.071276 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.quota [None req-f6e2c7bd-7807-4bf4-9170-71f90fcc12c2 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Getting quotas for user af7f5f8b5df94835ae32b80a106ede09 and project bab0811e055f46b98a70790223b64a13. Resources: {'key_pairs'} {{(pid=117801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 11:14:41.084567 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e448ee65-3fcc-46ca-9a5a-e1e659e9df0c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:41.099020 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e448ee65-3fcc-46ca-9a5a-e1e659e9df0c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874" status: 200 len: 1222 microversion: 2.1 time: 0.259962 Apr 08 11:14:41.099620 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 20/39] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:14:40 2022] GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874 => generated 1222 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:14:41.114670 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-733601b0-7acb-497f-81ea-42e353f00fef tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] Calling method '.version_select at 0x7f0424a71f70>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:41.175503 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-733601b0-7acb-497f-81ea-42e353f00fef tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/fb20da4f-9f80-4c9d-9b33-83419f9eab89" status: 200 len: 288 microversion: 2.1 time: 0.070929 Apr 08 11:14:41.176754 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 21/40] 10.222.0.46 () {58 vars in 1250 bytes} [Fri Apr 8 11:14:41 2022] GET /compute/v2.1/os-snapshots/fb20da4f-9f80-4c9d-9b33-83419f9eab89 => generated 288 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:14:41.189579 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c5d46c60-147f-4863-88ca-a76de7bc7cc7 tempest-VolumesTestJSON-441933602 tempest-VolumesTestJSON-441933602-project] Calling method '.version_select at 0x7f04241a9280>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:41.299554 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c5d46c60-147f-4863-88ca-a76de7bc7cc7 tempest-VolumesTestJSON-441933602 tempest-VolumesTestJSON-441933602-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/460beebf-fbd7-4cc5-9129-9bcc2e6f16b7" status: 200 len: 349 microversion: 2.1 time: 0.120309 Apr 08 11:14:41.300355 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 22/41] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Apr 8 11:14:41 2022] GET /compute/v2.1/os-volumes/460beebf-fbd7-4cc5-9129-9bcc2e6f16b7 => generated 349 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:14:41.305324 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d469c09d-f1c7-47eb-817e-6b34be7f262d tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] Calling method '.version_select at 0x7f04241a9d30>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:41.545376 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d469c09d-f1c7-47eb-817e-6b34be7f262d tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] 10.222.0.46 "DELETE /compute/v2.1/os-snapshots/fb20da4f-9f80-4c9d-9b33-83419f9eab89" status: 202 len: 0 microversion: 2.1 time: 0.243361 Apr 08 11:14:41.546593 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 23/42] 10.222.0.46 () {58 vars in 1253 bytes} [Fri Apr 8 11:14:41 2022] DELETE /compute/v2.1/os-snapshots/fb20da4f-9f80-4c9d-9b33-83419f9eab89 => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 11:14:41.552651 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2a93dae1-8b7b-44a0-b5fe-7f2e3979d881 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-654631565", "imageRef": "35b8d8d2-a0e9-4c3e-8586-5e088dec27e6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:14:41.659420 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.network.neutron [None req-2a93dae1-8b7b-44a0-b5fe-7f2e3979d881 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] validate_networks() for [('c130d358-962f-43d2-8806-6bdc4416af3f', None, None, None, None, None)] {{(pid=117800) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 08 11:14:42.016257 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.quota [None req-f6e2c7bd-7807-4bf4-9170-71f90fcc12c2 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Getting quotas for project bab0811e055f46b98a70790223b64a13. Resources: {'key_pairs'} {{(pid=117801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 11:14:42.035586 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.quota [None req-f6e2c7bd-7807-4bf4-9170-71f90fcc12c2 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Getting quotas for user af7f5f8b5df94835ae32b80a106ede09 and project bab0811e055f46b98a70790223b64a13. Resources: {'key_pairs'} {{(pid=117801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 11:14:42.063273 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-f6e2c7bd-7807-4bf4-9170-71f90fcc12c2 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.567891 Apr 08 11:14:42.073660 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 20/43] 10.222.0.46 () {60 vars in 1157 bytes} [Fri Apr 8 11:14:40 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:14:42.092823 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-841ebd5a-1f88-42a9-9ca2-93dc561c05d7 tempest-VolumesTestJSON-441933602 tempest-VolumesTestJSON-441933602-project] Calling method '.version_select at 0x7f04249d0820>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:42.294397 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-841ebd5a-1f88-42a9-9ca2-93dc561c05d7 tempest-VolumesTestJSON-441933602 tempest-VolumesTestJSON-441933602-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.227051 Apr 08 11:14:42.294967 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 21/44] 10.222.0.46 () {58 vars in 1133 bytes} [Fri Apr 8 11:14:42 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:14:42.310181 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-7fde5566-f90a-4cb3-b0be-d9d4010d83b8 tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] Calling method '.version_select at 0x7f0424169af0>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:42.354397 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.wsgi [None req-7fde5566-f90a-4cb3-b0be-d9d4010d83b8 tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] HTTP exception thrown: Snapshot fb20da4f-9f80-4c9d-9b33-83419f9eab89 could not be found. Apr 08 11:14:42.356354 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-7fde5566-f90a-4cb3-b0be-d9d4010d83b8 tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] Returning 404 to user: Snapshot fb20da4f-9f80-4c9d-9b33-83419f9eab89 could not be found. {{(pid=117801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:14:42.358094 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-7fde5566-f90a-4cb3-b0be-d9d4010d83b8 tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/fb20da4f-9f80-4c9d-9b33-83419f9eab89" status: 404 len: 111 microversion: 2.1 time: 0.053373 Apr 08 11:14:42.359662 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 22/45] 10.222.0.46 () {58 vars in 1250 bytes} [Fri Apr 8 11:14:42 2022] GET /compute/v2.1/os-snapshots/fb20da4f-9f80-4c9d-9b33-83419f9eab89 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 11:14:42.372621 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2758732a-5ff7-4809-bd69-0c5837949b28 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:42.373793 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-2758732a-5ff7-4809-bd69-0c5837949b28 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:14:42.391667 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2758732a-5ff7-4809-bd69-0c5837949b28 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:42.392817 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2758732a-5ff7-4809-bd69-0c5837949b28 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:42.393089 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2758732a-5ff7-4809-bd69-0c5837949b28 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:42.393751 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2758732a-5ff7-4809-bd69-0c5837949b28 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:42.639976 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2758732a-5ff7-4809-bd69-0c5837949b28 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44deb9de4511458ba769ad2b8b26651c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a05f833c354a00a03d62f49c9e3402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:42.658296 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-2758732a-5ff7-4809-bd69-0c5837949b28 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 200 len: 1272 microversion: 2.1 time: 0.291312 Apr 08 11:14:42.668946 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 23/46] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:14:42 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 1272 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:14:42.683066 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-5e3ba6c8-6389-48de-82df-7c890cda72fc tempest-VolumesGetTestJSON-1362649758 tempest-VolumesGetTestJSON-1362649758-project] Calling method '.version_select at 0x7f042418d430>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:42.789813 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.wsgi [None req-5e3ba6c8-6389-48de-82df-7c890cda72fc tempest-VolumesGetTestJSON-1362649758 tempest-VolumesGetTestJSON-1362649758-project] HTTP exception thrown: Volume 1bcb3388-e6d8-4d5b-85e6-1de60cea5fca could not be found. Apr 08 11:14:42.791480 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-5e3ba6c8-6389-48de-82df-7c890cda72fc tempest-VolumesGetTestJSON-1362649758 tempest-VolumesGetTestJSON-1362649758-project] Returning 404 to user: Volume 1bcb3388-e6d8-4d5b-85e6-1de60cea5fca could not be found. {{(pid=117801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:14:42.793639 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-5e3ba6c8-6389-48de-82df-7c890cda72fc tempest-VolumesGetTestJSON-1362649758 tempest-VolumesGetTestJSON-1362649758-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/1bcb3388-e6d8-4d5b-85e6-1de60cea5fca" status: 404 len: 109 microversion: 2.1 time: 0.123157 Apr 08 11:14:42.798468 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 24/47] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Apr 8 11:14:42 2022] GET /compute/v2.1/os-volumes/1bcb3388-e6d8-4d5b-85e6-1de60cea5fca => generated 109 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 11:14:43.051835 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-01b4cbe0-3fb4-4fa1-9485-ffa459a5bd02 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Action: 'create', calling method: .version_select at 0x7f04249d0820>, body: {"keypair": {"name": "tempest-keypair-1181798372"}} {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:14:43.102805 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.quota [None req-01b4cbe0-3fb4-4fa1-9485-ffa459a5bd02 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Getting quotas for project a5dd9671a5114358a9c0b092a8f1ac1b. Resources: {'key_pairs'} {{(pid=117801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 11:14:43.116256 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.quota [None req-01b4cbe0-3fb4-4fa1-9485-ffa459a5bd02 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Getting quotas for user bc136334416c403780722f1c3bb6bc7e and project a5dd9671a5114358a9c0b092a8f1ac1b. Resources: {'key_pairs'} {{(pid=117801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 11:14:43.386948 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-2a93dae1-8b7b-44a0-b5fe-7f2e3979d881 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Flavor limits 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 11:14:43.388077 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-2a93dae1-8b7b-44a0-b5fe-7f2e3979d881 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Image limits 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 11:14:43.388771 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-2a93dae1-8b7b-44a0-b5fe-7f2e3979d881 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Flavor pref 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 11:14:43.389399 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-2a93dae1-8b7b-44a0-b5fe-7f2e3979d881 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Image pref 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 11:14:43.389995 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-2a93dae1-8b7b-44a0-b5fe-7f2e3979d881 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 11:14:43.410278 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2a93dae1-8b7b-44a0-b5fe-7f2e3979d881 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:43.411263 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2a93dae1-8b7b-44a0-b5fe-7f2e3979d881 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:43.412955 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2a93dae1-8b7b-44a0-b5fe-7f2e3979d881 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:43.414318 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2a93dae1-8b7b-44a0-b5fe-7f2e3979d881 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:43.444568 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-2a93dae1-8b7b-44a0-b5fe-7f2e3979d881 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Getting quotas for project 53fe2dc297a34f0281e7a165efea5957. Resources: {'instances', 'ram', 'cores'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 11:14:43.449728 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-2a93dae1-8b7b-44a0-b5fe-7f2e3979d881 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Getting quotas for user 6b5bdfdda63241d284449c6b2ec5c46b and project 53fe2dc297a34f0281e7a165efea5957. Resources: {'instances', 'ram', 'cores'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 11:14:43.466228 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2a93dae1-8b7b-44a0-b5fe-7f2e3979d881 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Going to run 1 instances... {{(pid=117800) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 08 11:14:43.474860 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2a93dae1-8b7b-44a0-b5fe-7f2e3979d881 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='35b8d8d2-a0e9-4c3e-8586-5e088dec27e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 08 11:14:43.663574 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2a93dae1-8b7b-44a0-b5fe-7f2e3979d881 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.115561 Apr 08 11:14:43.675600 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 24/48] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Apr 8 11:14:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 2128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 11:14:43.688537 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-962591e8-cf69-4d3e-bd51-ea408ab33ce5 tempest-VolumesTestJSON-441933602 tempest-VolumesTestJSON-441933602-project] Calling method '.version_select at 0x7f042420eb80>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:43.970938 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-962591e8-cf69-4d3e-bd51-ea408ab33ce5 tempest-VolumesTestJSON-441933602 tempest-VolumesTestJSON-441933602-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.294064 Apr 08 11:14:43.979173 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 25/49] 10.222.0.46 () {58 vars in 1148 bytes} [Fri Apr 8 11:14:43 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:14:43.990065 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8a2c4a0a-8ae1-44f4-af63-4c257da774a0 tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] Calling method '.version_select at 0x7f04241cb0d0>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:44.393990 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.quota [None req-01b4cbe0-3fb4-4fa1-9485-ffa459a5bd02 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Getting quotas for project a5dd9671a5114358a9c0b092a8f1ac1b. Resources: {'key_pairs'} {{(pid=117801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 11:14:44.412718 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.quota [None req-01b4cbe0-3fb4-4fa1-9485-ffa459a5bd02 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Getting quotas for user bc136334416c403780722f1c3bb6bc7e and project a5dd9671a5114358a9c0b092a8f1ac1b. Resources: {'key_pairs'} {{(pid=117801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 11:14:44.445569 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8a2c4a0a-8ae1-44f4-af63-4c257da774a0 tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/153f2aee-608f-4c18-99a6-8eae740bab4b" status: 202 len: 0 microversion: 2.1 time: 0.462721 Apr 08 11:14:44.447159 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 26/50] 10.222.0.46 () {58 vars in 1247 bytes} [Fri Apr 8 11:14:43 2022] DELETE /compute/v2.1/os-volumes/153f2aee-608f-4c18-99a6-8eae740bab4b => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 11:14:44.464120 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e63edc31-bc8e-4080-9bad-bd5674b08142 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:44.472192 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e63edc31-bc8e-4080-9bad-bd5674b08142 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:14:44.479645 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-01b4cbe0-3fb4-4fa1-9485-ffa459a5bd02 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 1.678392 Apr 08 11:14:44.482058 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 25/51] 10.222.0.46 () {62 vars in 1198 bytes} [Fri Apr 8 11:14:42 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1683 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 08 11:14:44.513523 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e82af7b1-90b6-4193-a085-26549dbea6a5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:44.518260 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e82af7b1-90b6-4193-a085-26549dbea6a5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:14:44.534650 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e63edc31-bc8e-4080-9bad-bd5674b08142 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:44.536841 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e63edc31-bc8e-4080-9bad-bd5674b08142 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:44.539089 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e63edc31-bc8e-4080-9bad-bd5674b08142 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:44.544347 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e63edc31-bc8e-4080-9bad-bd5674b08142 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:44.724381 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e82af7b1-90b6-4193-a085-26549dbea6a5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:44.734101 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e82af7b1-90b6-4193-a085-26549dbea6a5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1221 microversion: 2.1 time: 0.241229 Apr 08 11:14:44.735106 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 26/52] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:14:44 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1221 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:14:44.743325 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-5b7849d5-386a-435b-ba88-6dde5bc0a088 tempest-VolumesTestJSON-441933602 tempest-VolumesTestJSON-441933602-project] Calling method '.version_select at 0x7f042419bdc0>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:45.005426 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-5b7849d5-386a-435b-ba88-6dde5bc0a088 tempest-VolumesTestJSON-441933602 tempest-VolumesTestJSON-441933602-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.264086 Apr 08 11:14:45.018875 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 27/53] 10.222.0.46 () {58 vars in 1133 bytes} [Fri Apr 8 11:14:44 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:14:45.028370 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-53137c73-af84-48d4-9c40-74fd69803b29 tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] Calling method '.version_select at 0x7f042419c8b0>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:45.160759 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.wsgi [None req-53137c73-af84-48d4-9c40-74fd69803b29 tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] HTTP exception thrown: Volume 153f2aee-608f-4c18-99a6-8eae740bab4b could not be found. Apr 08 11:14:45.162017 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-53137c73-af84-48d4-9c40-74fd69803b29 tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] Returning 404 to user: Volume 153f2aee-608f-4c18-99a6-8eae740bab4b could not be found. {{(pid=117801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:14:45.163563 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-53137c73-af84-48d4-9c40-74fd69803b29 tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/153f2aee-608f-4c18-99a6-8eae740bab4b" status: 404 len: 109 microversion: 2.1 time: 0.141557 Apr 08 11:14:45.164572 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 28/54] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Apr 8 11:14:45 2022] GET /compute/v2.1/os-volumes/153f2aee-608f-4c18-99a6-8eae740bab4b => generated 109 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 11:14:45.178445 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-24803dbe-e0e1-460d-873c-e40bda4d3e9c tempest-VolumesTestJSON-441933602 tempest-VolumesTestJSON-441933602-project] Calling method '.version_select at 0x7f042419b670>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:45.190462 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e63edc31-bc8e-4080-9bad-bd5674b08142 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44deb9de4511458ba769ad2b8b26651c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a05f833c354a00a03d62f49c9e3402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:45.218053 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e63edc31-bc8e-4080-9bad-bd5674b08142 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 200 len: 1314 microversion: 2.1 time: 0.766619 Apr 08 11:14:45.220091 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 27/55] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:14:44 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 1314 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:14:45.229666 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-037a03ab-e987-4720-86d7-34dd3388db54 tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] Calling method '.version_select at 0x7f04241ce5e0>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:45.528078 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-24803dbe-e0e1-460d-873c-e40bda4d3e9c tempest-VolumesTestJSON-441933602 tempest-VolumesTestJSON-441933602-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.362238 Apr 08 11:14:45.528690 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 29/56] 10.222.0.46 () {58 vars in 1166 bytes} [Fri Apr 8 11:14:45 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:14:45.542220 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-68bf8a04-338c-4b51-aee3-395143a8637c tempest-VolumesTestJSON-441933602 tempest-VolumesTestJSON-441933602-project] Calling method '.version_select at 0x7f042418dee0>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:45.616288 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-037a03ab-e987-4720-86d7-34dd3388db54 tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] HTTP exception thrown: Volume 153f2aee-608f-4c18-99a6-8eae740bab4b could not be found. Apr 08 11:14:45.617020 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-037a03ab-e987-4720-86d7-34dd3388db54 tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] Returning 404 to user: Volume 153f2aee-608f-4c18-99a6-8eae740bab4b could not be found. {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:14:45.618234 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-037a03ab-e987-4720-86d7-34dd3388db54 tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/153f2aee-608f-4c18-99a6-8eae740bab4b" status: 404 len: 109 microversion: 2.1 time: 0.396962 Apr 08 11:14:45.618814 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 28/57] 10.222.0.46 () {58 vars in 1247 bytes} [Fri Apr 8 11:14:45 2022] DELETE /compute/v2.1/os-volumes/153f2aee-608f-4c18-99a6-8eae740bab4b => generated 109 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 11:14:45.629334 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b49b200c-061f-4922-971d-b7e3abaa40fd tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] Calling method '.version_select at 0x7f04241ce3a0>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:45.788313 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-68bf8a04-338c-4b51-aee3-395143a8637c tempest-VolumesTestJSON-441933602 tempest-VolumesTestJSON-441933602-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.246620 Apr 08 11:14:45.797816 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 30/58] 10.222.0.46 () {58 vars in 1169 bytes} [Fri Apr 8 11:14:45 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:14:45.805928 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-bb9420fa-f2f8-4f72-9488-46482bd16691 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:45.807618 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-bb9420fa-f2f8-4f72-9488-46482bd16691 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:14:45.824321 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bb9420fa-f2f8-4f72-9488-46482bd16691 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:45.825496 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bb9420fa-f2f8-4f72-9488-46482bd16691 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:45.827012 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bb9420fa-f2f8-4f72-9488-46482bd16691 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:46.091484 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bb9420fa-f2f8-4f72-9488-46482bd16691 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:46.095993 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-b49b200c-061f-4922-971d-b7e3abaa40fd tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] HTTP exception thrown: Volume 153f2aee-608f-4c18-99a6-8eae740bab4b could not be found. Apr 08 11:14:46.095993 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b49b200c-061f-4922-971d-b7e3abaa40fd tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] Returning 404 to user: Volume 153f2aee-608f-4c18-99a6-8eae740bab4b could not be found. {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:14:46.095993 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b49b200c-061f-4922-971d-b7e3abaa40fd tempest-VolumesSnapshotsTestJSON-316835273 tempest-VolumesSnapshotsTestJSON-316835273-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/153f2aee-608f-4c18-99a6-8eae740bab4b" status: 404 len: 109 microversion: 2.1 time: 0.218904 Apr 08 11:14:46.095993 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 29/59] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Apr 8 11:14:45 2022] GET /compute/v2.1/os-volumes/153f2aee-608f-4c18-99a6-8eae740bab4b => generated 109 bytes in 221 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 11:14:46.095993 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f27b1f20-9c5d-49a1-a138-eb95d2d93f37 tempest-VolumesTestJSON-441933602 tempest-VolumesTestJSON-441933602-project] Calling method '.version_select at 0x7f0424aa0670>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:46.098049 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-bb9420fa-f2f8-4f72-9488-46482bd16691 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:46.098049 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-bb9420fa-f2f8-4f72-9488-46482bd16691 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1225 microversion: 2.1 time: 0.248757 Apr 08 11:14:46.098049 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 31/60] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:14:45 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1225 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:14:46.098736 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f27b1f20-9c5d-49a1-a138-eb95d2d93f37 tempest-VolumesTestJSON-441933602 tempest-VolumesTestJSON-441933602-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.208478 Apr 08 11:14:46.098736 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 30/61] 10.222.0.46 () {58 vars in 1154 bytes} [Fri Apr 8 11:14:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:14:46.128557 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-07b7d459-e303-4542-89aa-98b3391769f3 tempest-VolumesTestJSON-441933602 tempest-VolumesTestJSON-441933602-project] Calling method '.version_select at 0x7f042419b5e0>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:46.243493 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7f7512b8-e117-4de5-bacb-370c5ad34144 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:46.247288 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7f7512b8-e117-4de5-bacb-370c5ad34144 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:14:46.259801 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7f7512b8-e117-4de5-bacb-370c5ad34144 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:46.260880 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7f7512b8-e117-4de5-bacb-370c5ad34144 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:46.263165 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7f7512b8-e117-4de5-bacb-370c5ad34144 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:46.263832 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7f7512b8-e117-4de5-bacb-370c5ad34144 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:46.375696 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-07b7d459-e303-4542-89aa-98b3391769f3 tempest-VolumesTestJSON-441933602 tempest-VolumesTestJSON-441933602-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.251010 Apr 08 11:14:46.376620 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 32/62] 10.222.0.46 () {58 vars in 1187 bytes} [Fri Apr 8 11:14:46 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:14:46.390860 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-52e14fc2-8774-4fdc-b7fd-32da408e1f5f tempest-VolumesTestJSON-441933602 tempest-VolumesTestJSON-441933602-project] Calling method '.version_select at 0x7f042418d670>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:46.660895 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-52e14fc2-8774-4fdc-b7fd-32da408e1f5f tempest-VolumesTestJSON-441933602 tempest-VolumesTestJSON-441933602-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.276000 Apr 08 11:14:46.662166 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 33/63] 10.222.0.46 () {58 vars in 1154 bytes} [Fri Apr 8 11:14:46 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:14:46.920264 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7f7512b8-e117-4de5-bacb-370c5ad34144 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44deb9de4511458ba769ad2b8b26651c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a05f833c354a00a03d62f49c9e3402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:46.930634 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7f7512b8-e117-4de5-bacb-370c5ad34144 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 200 len: 1314 microversion: 2.1 time: 0.696152 Apr 08 11:14:46.933889 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 31/64] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:14:46 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 1314 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:14:47.104026 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-29d138c2-7b42-42c8-a94b-b3ff629c8691 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:47.106058 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-29d138c2-7b42-42c8-a94b-b3ff629c8691 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:14:47.133445 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-29d138c2-7b42-42c8-a94b-b3ff629c8691 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:47.134362 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-29d138c2-7b42-42c8-a94b-b3ff629c8691 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:47.142712 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-29d138c2-7b42-42c8-a94b-b3ff629c8691 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:47.143846 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-29d138c2-7b42-42c8-a94b-b3ff629c8691 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:47.324691 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-29d138c2-7b42-42c8-a94b-b3ff629c8691 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:47.336226 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-29d138c2-7b42-42c8-a94b-b3ff629c8691 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1217 microversion: 2.1 time: 0.236623 Apr 08 11:14:47.337346 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 34/65] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:14:47 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1217 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:14:47.947838 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-347a167f-d181-4eaa-8921-01a96d3fc9e0 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:47.948463 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-347a167f-d181-4eaa-8921-01a96d3fc9e0 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:14:47.962352 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-347a167f-d181-4eaa-8921-01a96d3fc9e0 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:47.963995 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-347a167f-d181-4eaa-8921-01a96d3fc9e0 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:47.968824 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-347a167f-d181-4eaa-8921-01a96d3fc9e0 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:47.969312 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-347a167f-d181-4eaa-8921-01a96d3fc9e0 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:48.359342 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a351054b-0cda-498b-9461-8bd300ce04c4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:48.360835 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a351054b-0cda-498b-9461-8bd300ce04c4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:14:48.377005 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a351054b-0cda-498b-9461-8bd300ce04c4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:48.377655 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a351054b-0cda-498b-9461-8bd300ce04c4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:48.378667 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a351054b-0cda-498b-9461-8bd300ce04c4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:48.379281 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a351054b-0cda-498b-9461-8bd300ce04c4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:48.623298 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a351054b-0cda-498b-9461-8bd300ce04c4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:48.632633 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a351054b-0cda-498b-9461-8bd300ce04c4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1217 microversion: 2.1 time: 0.277952 Apr 08 11:14:48.638137 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 35/66] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:14:48 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1217 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:14:48.977432 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-347a167f-d181-4eaa-8921-01a96d3fc9e0 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44deb9de4511458ba769ad2b8b26651c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a05f833c354a00a03d62f49c9e3402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:48.987569 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-347a167f-d181-4eaa-8921-01a96d3fc9e0 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 200 len: 1314 microversion: 2.1 time: 1.044421 Apr 08 11:14:48.989566 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 32/67] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:14:47 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 1314 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:14:49.008385 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [req-912079b8-998e-4650-bdcc-0d2d1d12741e req-6851ffa3-ba1b-4cc3-8734-8c1df203aa23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04fd539f-d648-4fd7-b824-351f408a0327", "tag": "e997b977-c6eb-4b8f-b12d-f27072ee34f1"}]} {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:14:49.031566 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-912079b8-998e-4650-bdcc-0d2d1d12741e req-6851ffa3-ba1b-4cc3-8734-8c1df203aa23 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:49.032032 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-912079b8-998e-4650-bdcc-0d2d1d12741e req-6851ffa3-ba1b-4cc3-8734-8c1df203aa23 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:49.086377 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.compute.server_external_events [req-912079b8-998e-4650-bdcc-0d2d1d12741e req-6851ffa3-ba1b-4cc3-8734-8c1df203aa23 service nova] Creating event network-changed:e997b977-c6eb-4b8f-b12d-f27072ee34f1 for instance 04fd539f-d648-4fd7-b824-351f408a0327 on hv-cinder-83607 Apr 08 11:14:49.086377 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-912079b8-998e-4650-bdcc-0d2d1d12741e req-6851ffa3-ba1b-4cc3-8734-8c1df203aa23 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 08 11:14:49.087445 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6d838c39-0fa8-406c-b09f-fa19826bc68c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:49.088324 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6d838c39-0fa8-406c-b09f-fa19826bc68c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:49.104728 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6d838c39-0fa8-406c-b09f-fa19826bc68c None None] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:49.105210 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6d838c39-0fa8-406c-b09f-fa19826bc68c None None] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:49.139013 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.compute.rpcapi [None req-6d838c39-0fa8-406c-b09f-fa19826bc68c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 08 11:14:49.143177 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6d838c39-0fa8-406c-b09f-fa19826bc68c None None] Releasing lock "compute-rpcapi-router" {{(pid=117801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 08 11:14:49.188126 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-6d838c39-0fa8-406c-b09f-fa19826bc68c None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.546799 Apr 08 11:14:49.188126 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 36/68] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:14:49.659701 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6aff0f73-197d-4531-bad4-c10cb09e8565 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:49.660344 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6aff0f73-197d-4531-bad4-c10cb09e8565 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:14:49.668945 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6aff0f73-197d-4531-bad4-c10cb09e8565 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:49.669900 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6aff0f73-197d-4531-bad4-c10cb09e8565 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:49.671027 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6aff0f73-197d-4531-bad4-c10cb09e8565 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:49.671635 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6aff0f73-197d-4531-bad4-c10cb09e8565 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:49.751294 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6aff0f73-197d-4531-bad4-c10cb09e8565 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:49.761249 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6aff0f73-197d-4531-bad4-c10cb09e8565 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1217 microversion: 2.1 time: 0.106011 Apr 08 11:14:49.762263 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 33/69] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:14:49 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1217 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:14:50.007633 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-df60823d-5eee-49ec-849d-c17693ede962 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:50.009314 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-df60823d-5eee-49ec-849d-c17693ede962 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:14:50.026495 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-df60823d-5eee-49ec-849d-c17693ede962 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:50.027169 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-df60823d-5eee-49ec-849d-c17693ede962 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:50.028243 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-df60823d-5eee-49ec-849d-c17693ede962 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:50.029388 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-df60823d-5eee-49ec-849d-c17693ede962 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:50.369420 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-df60823d-5eee-49ec-849d-c17693ede962 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44deb9de4511458ba769ad2b8b26651c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a05f833c354a00a03d62f49c9e3402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:50.388375 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-df60823d-5eee-49ec-849d-c17693ede962 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 200 len: 1314 microversion: 2.1 time: 0.385599 Apr 08 11:14:50.388989 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 37/70] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:14:50 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:14:50.519641 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c0081b97-bf33-4d32-880f-bf9439080b7f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2112418113", "imageRef": "35b8d8d2-a0e9-4c3e-8586-5e088dec27e6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21532aea-6123-4104-bb2d-623657c68d39"}], "security_groups": [{"name": "tempest-securitygroup--289464430"}], "key_name": "tempest-keypair-1755896538", "user_data": "}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:14:50.693218 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.network.neutron [None req-c0081b97-bf33-4d32-880f-bf9439080b7f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] validate_networks() for [('21532aea-6123-4104-bb2d-623657c68d39', None, None, None, None, None)] {{(pid=117800) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 08 11:14:50.779820 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2857d14b-64f9-4c24-aa1e-48e5735e7427 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:50.780777 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-2857d14b-64f9-4c24-aa1e-48e5735e7427 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:14:50.794282 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2857d14b-64f9-4c24-aa1e-48e5735e7427 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:50.795299 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2857d14b-64f9-4c24-aa1e-48e5735e7427 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:50.796447 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2857d14b-64f9-4c24-aa1e-48e5735e7427 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:50.797115 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2857d14b-64f9-4c24-aa1e-48e5735e7427 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:50.919130 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2857d14b-64f9-4c24-aa1e-48e5735e7427 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:50.930806 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-2857d14b-64f9-4c24-aa1e-48e5735e7427 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1217 microversion: 2.1 time: 0.155830 Apr 08 11:14:50.933278 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 38/71] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:14:50 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1217 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:14:51.405889 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-d2277e63-8943-41bd-9ea0-27721fcd2797 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:51.406600 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-d2277e63-8943-41bd-9ea0-27721fcd2797 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:14:51.425164 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d2277e63-8943-41bd-9ea0-27721fcd2797 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:51.430150 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d2277e63-8943-41bd-9ea0-27721fcd2797 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:51.432138 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d2277e63-8943-41bd-9ea0-27721fcd2797 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:51.444574 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d2277e63-8943-41bd-9ea0-27721fcd2797 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:52.618262 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d2277e63-8943-41bd-9ea0-27721fcd2797 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44deb9de4511458ba769ad2b8b26651c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a05f833c354a00a03d62f49c9e3402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:52.627764 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-d2277e63-8943-41bd-9ea0-27721fcd2797 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 200 len: 1314 microversion: 2.1 time: 1.226789 Apr 08 11:14:52.628801 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 39/72] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:14:51 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 1314 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:14:52.635111 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-39fc9622-887e-41f5-b284-0ac52d79d55a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:52.636115 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-39fc9622-887e-41f5-b284-0ac52d79d55a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:14:52.666603 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-39fc9622-887e-41f5-b284-0ac52d79d55a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:52.667469 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-39fc9622-887e-41f5-b284-0ac52d79d55a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:52.669218 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-39fc9622-887e-41f5-b284-0ac52d79d55a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:52.669989 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-39fc9622-887e-41f5-b284-0ac52d79d55a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:52.795449 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-c0081b97-bf33-4d32-880f-bf9439080b7f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Flavor limits 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 11:14:52.796695 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-c0081b97-bf33-4d32-880f-bf9439080b7f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Image limits 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 11:14:52.797791 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-c0081b97-bf33-4d32-880f-bf9439080b7f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Flavor pref 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 11:14:52.798432 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-c0081b97-bf33-4d32-880f-bf9439080b7f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Image pref 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 11:14:52.799233 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-c0081b97-bf33-4d32-880f-bf9439080b7f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 11:14:52.815224 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c0081b97-bf33-4d32-880f-bf9439080b7f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:52.820226 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c0081b97-bf33-4d32-880f-bf9439080b7f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:52.822897 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c0081b97-bf33-4d32-880f-bf9439080b7f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:52.824893 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c0081b97-bf33-4d32-880f-bf9439080b7f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:52.917704 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-c0081b97-bf33-4d32-880f-bf9439080b7f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Getting quotas for project bab0811e055f46b98a70790223b64a13. Resources: {'instances', 'ram', 'cores'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 11:14:52.929522 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-c0081b97-bf33-4d32-880f-bf9439080b7f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Getting quotas for user af7f5f8b5df94835ae32b80a106ede09 and project bab0811e055f46b98a70790223b64a13. Resources: {'instances', 'ram', 'cores'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 11:14:52.956093 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c0081b97-bf33-4d32-880f-bf9439080b7f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Going to run 1 instances... {{(pid=117800) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 08 11:14:52.960389 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c0081b97-bf33-4d32-880f-bf9439080b7f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='35b8d8d2-a0e9-4c3e-8586-5e088dec27e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 08 11:14:53.104184 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-39fc9622-887e-41f5-b284-0ac52d79d55a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:53.114633 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-39fc9622-887e-41f5-b284-0ac52d79d55a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1291 microversion: 2.1 time: 0.484310 Apr 08 11:14:53.121403 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 40/73] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:14:52 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1291 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:14:53.258851 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c0081b97-bf33-4d32-880f-bf9439080b7f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.743598 Apr 08 11:14:53.271049 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 34/74] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Apr 8 11:14:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 2757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 11:14:53.273930 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2186fd62-5dbf-4f8d-977d-3f28df95679b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:53.274728 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-2186fd62-5dbf-4f8d-977d-3f28df95679b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:14:53.351536 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-25bb5a46-fad7-4740-9925-75662cd09a18 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1115334889", "imageRef": "35b8d8d2-a0e9-4c3e-8586-5e088dec27e6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d2ff69fa-d82a-41b3-8cb1-2e8417495ebf"}], "security_groups": [{"name": "tempest-securitygroup--462140861"}], "key_name": "tempest-keypair-1181798372", "user_data": "}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:14:53.712915 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2186fd62-5dbf-4f8d-977d-3f28df95679b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:53.730093 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-2186fd62-5dbf-4f8d-977d-3f28df95679b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1238 microversion: 2.1 time: 0.461622 Apr 08 11:14:53.742131 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 41/75] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:14:53 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1238 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:14:53.748450 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-1b18e990-b363-4059-99de-72fcde1b6f6a tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:53.750057 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-1b18e990-b363-4059-99de-72fcde1b6f6a tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:14:53.762915 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1b18e990-b363-4059-99de-72fcde1b6f6a tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:53.763611 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1b18e990-b363-4059-99de-72fcde1b6f6a tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:53.778884 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1b18e990-b363-4059-99de-72fcde1b6f6a tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:53.778884 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1b18e990-b363-4059-99de-72fcde1b6f6a tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:54.075853 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.network.neutron [None req-25bb5a46-fad7-4740-9925-75662cd09a18 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] validate_networks() for [('d2ff69fa-d82a-41b3-8cb1-2e8417495ebf', None, None, None, None, None)] {{(pid=117800) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 08 11:14:54.562943 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1b18e990-b363-4059-99de-72fcde1b6f6a tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44deb9de4511458ba769ad2b8b26651c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a05f833c354a00a03d62f49c9e3402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:54.578199 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-1b18e990-b363-4059-99de-72fcde1b6f6a tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 200 len: 1314 microversion: 2.1 time: 0.831933 Apr 08 11:14:54.579602 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 42/76] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:14:53 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 1314 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:14:54.586940 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-c4f3b9c4-4d32-400f-a251-9a714ecb40de tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:54.588588 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-c4f3b9c4-4d32-400f-a251-9a714ecb40de tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:14:54.614178 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c4f3b9c4-4d32-400f-a251-9a714ecb40de tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:54.615170 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c4f3b9c4-4d32-400f-a251-9a714ecb40de tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:54.616903 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c4f3b9c4-4d32-400f-a251-9a714ecb40de tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:54.617496 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c4f3b9c4-4d32-400f-a251-9a714ecb40de tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:55.087087 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-c4f3b9c4-4d32-400f-a251-9a714ecb40de tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:55.106988 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-c4f3b9c4-4d32-400f-a251-9a714ecb40de tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1321 microversion: 2.1 time: 0.523928 Apr 08 11:14:55.109708 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 43/77] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:14:54 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1321 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:14:55.125049 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-055d4b37-5b59-443b-ba2a-3ae86401acbe tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:55.126054 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-055d4b37-5b59-443b-ba2a-3ae86401acbe tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:14:55.422065 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-055d4b37-5b59-443b-ba2a-3ae86401acbe tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:55.448288 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-055d4b37-5b59-443b-ba2a-3ae86401acbe tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1238 microversion: 2.1 time: 0.334850 Apr 08 11:14:55.453995 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 44/78] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:14:55 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1238 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:14:55.598627 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-b649e99a-ed1a-40c7-b495-1046e3293dd3 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:55.599262 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-b649e99a-ed1a-40c7-b495-1046e3293dd3 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:14:55.611833 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b649e99a-ed1a-40c7-b495-1046e3293dd3 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:55.614837 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b649e99a-ed1a-40c7-b495-1046e3293dd3 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:55.616557 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b649e99a-ed1a-40c7-b495-1046e3293dd3 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:55.617194 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b649e99a-ed1a-40c7-b495-1046e3293dd3 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:56.157399 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b649e99a-ed1a-40c7-b495-1046e3293dd3 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44deb9de4511458ba769ad2b8b26651c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a05f833c354a00a03d62f49c9e3402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:56.171971 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-25bb5a46-fad7-4740-9925-75662cd09a18 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Flavor limits 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 11:14:56.172544 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-b649e99a-ed1a-40c7-b495-1046e3293dd3 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 200 len: 1314 microversion: 2.1 time: 0.573947 Apr 08 11:14:56.172624 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-25bb5a46-fad7-4740-9925-75662cd09a18 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Image limits 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 11:14:56.172692 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 45/79] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:14:55 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 1314 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:14:56.172775 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-25bb5a46-fad7-4740-9925-75662cd09a18 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Flavor pref 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 11:14:56.172775 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-25bb5a46-fad7-4740-9925-75662cd09a18 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Image pref 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 11:14:56.172775 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-25bb5a46-fad7-4740-9925-75662cd09a18 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 11:14:56.209398 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-25bb5a46-fad7-4740-9925-75662cd09a18 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:56.211072 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-25bb5a46-fad7-4740-9925-75662cd09a18 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:56.215645 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-25bb5a46-fad7-4740-9925-75662cd09a18 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:56.216361 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-25bb5a46-fad7-4740-9925-75662cd09a18 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:56.252068 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-25bb5a46-fad7-4740-9925-75662cd09a18 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Getting quotas for project a5dd9671a5114358a9c0b092a8f1ac1b. Resources: {'instances', 'ram', 'cores'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 11:14:56.257550 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-25bb5a46-fad7-4740-9925-75662cd09a18 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Getting quotas for user bc136334416c403780722f1c3bb6bc7e and project a5dd9671a5114358a9c0b092a8f1ac1b. Resources: {'instances', 'ram', 'cores'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 11:14:56.278873 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [req-98f6abff-fce4-494e-aa22-29ed14da0024 req-fde8c875-77ae-4378-abe3-0713ced93ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea2b616a-165e-4f06-9017-37a69bc2a874", "tag": "e2a58113-a345-4b0a-9d62-117d6974817e"}]} {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:14:56.292085 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-25bb5a46-fad7-4740-9925-75662cd09a18 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Going to run 1 instances... {{(pid=117800) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 08 11:14:56.298586 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-98f6abff-fce4-494e-aa22-29ed14da0024 req-fde8c875-77ae-4378-abe3-0713ced93ea6 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:56.299303 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-25bb5a46-fad7-4740-9925-75662cd09a18 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='35b8d8d2-a0e9-4c3e-8586-5e088dec27e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 08 11:14:56.300497 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-98f6abff-fce4-494e-aa22-29ed14da0024 req-fde8c875-77ae-4378-abe3-0713ced93ea6 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:56.326839 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.compute.server_external_events [req-98f6abff-fce4-494e-aa22-29ed14da0024 req-fde8c875-77ae-4378-abe3-0713ced93ea6 service nova] Creating event network-changed:e2a58113-a345-4b0a-9d62-117d6974817e for instance ea2b616a-165e-4f06-9017-37a69bc2a874 on hv-cinder-83607 Apr 08 11:14:56.333609 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [req-98f6abff-fce4-494e-aa22-29ed14da0024 req-fde8c875-77ae-4378-abe3-0713ced93ea6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163626 Apr 08 11:14:56.334876 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 46/80] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:14:56.341543 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-64eb8162-83a1-4504-9f09-a7f628bb04d1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:56.348212 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-64eb8162-83a1-4504-9f09-a7f628bb04d1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:14:56.354416 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-64eb8162-83a1-4504-9f09-a7f628bb04d1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:56.355512 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-64eb8162-83a1-4504-9f09-a7f628bb04d1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:56.356571 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-64eb8162-83a1-4504-9f09-a7f628bb04d1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:56.357461 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-64eb8162-83a1-4504-9f09-a7f628bb04d1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:56.623864 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-25bb5a46-fad7-4740-9925-75662cd09a18 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.277091 Apr 08 11:14:56.634113 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 35/81] 10.222.0.46 () {62 vars in 1187 bytes} [Fri Apr 8 11:14:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 3283 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Apr 08 11:14:56.648026 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-60dbfb6b-d713-4214-a4da-531abd7056f7 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:56.653828 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-60dbfb6b-d713-4214-a4da-531abd7056f7 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:14:56.680978 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-60dbfb6b-d713-4214-a4da-531abd7056f7 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:56.682807 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-60dbfb6b-d713-4214-a4da-531abd7056f7 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:56.684214 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-60dbfb6b-d713-4214-a4da-531abd7056f7 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:56.684735 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-60dbfb6b-d713-4214-a4da-531abd7056f7 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:56.859043 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-60dbfb6b-d713-4214-a4da-531abd7056f7 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:57.071503 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-60dbfb6b-d713-4214-a4da-531abd7056f7 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1242 microversion: 2.1 time: 0.242985 Apr 08 11:14:57.071503 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 36/82] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:14:56 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1242 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:14:57.071503 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0221cdf4-e05a-47f1-8e59-c96c2ad82177 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:57.071503 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0221cdf4-e05a-47f1-8e59-c96c2ad82177 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:14:57.075552 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-64eb8162-83a1-4504-9f09-a7f628bb04d1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:57.075552 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-64eb8162-83a1-4504-9f09-a7f628bb04d1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1321 microversion: 2.1 time: 0.587916 Apr 08 11:14:57.075552 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 47/83] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:14:56 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1321 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:14:57.077288 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0221cdf4-e05a-47f1-8e59-c96c2ad82177 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:57.077288 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0221cdf4-e05a-47f1-8e59-c96c2ad82177 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:57.079223 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0221cdf4-e05a-47f1-8e59-c96c2ad82177 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:57.079223 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0221cdf4-e05a-47f1-8e59-c96c2ad82177 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1282 microversion: 2.20 time: 0.149654 Apr 08 11:14:57.079223 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 37/84] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:14:56 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1282 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:14:57.210704 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-01cb770f-db48-4ee4-b87c-2db2d561b2a6 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:57.210704 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-01cb770f-db48-4ee4-b87c-2db2d561b2a6 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:14:57.210704 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-01cb770f-db48-4ee4-b87c-2db2d561b2a6 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:57.210704 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-01cb770f-db48-4ee4-b87c-2db2d561b2a6 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:57.211305 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-01cb770f-db48-4ee4-b87c-2db2d561b2a6 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:57.211305 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-01cb770f-db48-4ee4-b87c-2db2d561b2a6 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:57.676301 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-01cb770f-db48-4ee4-b87c-2db2d561b2a6 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44deb9de4511458ba769ad2b8b26651c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a05f833c354a00a03d62f49c9e3402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:57.685653 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-01cb770f-db48-4ee4-b87c-2db2d561b2a6 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 200 len: 1314 microversion: 2.1 time: 0.504491 Apr 08 11:14:57.697029 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 48/85] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:14:57 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 1314 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:14:57.949738 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-2d81bbc8-070e-41e4-8945-70306f1a25e1 req-42cfd300-0f61-469e-8b67-0f0678c78739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b429d21-2abe-46ac-9148-962da31e1c3d", "tag": "288e9577-3c88-4dea-b291-aa1cf2450316"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:14:57.975960 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-2d81bbc8-070e-41e4-8945-70306f1a25e1 req-42cfd300-0f61-469e-8b67-0f0678c78739 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:57.976408 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-2d81bbc8-070e-41e4-8945-70306f1a25e1 req-42cfd300-0f61-469e-8b67-0f0678c78739 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:58.009076 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-2d81bbc8-070e-41e4-8945-70306f1a25e1 req-42cfd300-0f61-469e-8b67-0f0678c78739 service nova] Creating event network-changed:288e9577-3c88-4dea-b291-aa1cf2450316 for instance 6b429d21-2abe-46ac-9148-962da31e1c3d on hv-cinder-83607 Apr 08 11:14:58.009761 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-2d81bbc8-070e-41e4-8945-70306f1a25e1 req-42cfd300-0f61-469e-8b67-0f0678c78739 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117800) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 08 11:14:58.011340 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4f28dd79-0d3a-4523-b6b3-0a0a217e0883 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:58.011825 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4f28dd79-0d3a-4523-b6b3-0a0a217e0883 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:58.020372 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4f28dd79-0d3a-4523-b6b3-0a0a217e0883 None None] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:58.021081 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4f28dd79-0d3a-4523-b6b3-0a0a217e0883 None None] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:58.030076 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a262cb4e-2b5a-4beb-ba9f-4580340a77ea tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:58.030927 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a262cb4e-2b5a-4beb-ba9f-4580340a77ea tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:14:58.032907 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.compute.rpcapi [None req-4f28dd79-0d3a-4523-b6b3-0a0a217e0883 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 08 11:14:58.034630 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4f28dd79-0d3a-4523-b6b3-0a0a217e0883 None None] Releasing lock "compute-rpcapi-router" {{(pid=117800) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 08 11:14:58.042006 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a262cb4e-2b5a-4beb-ba9f-4580340a77ea tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:58.045343 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a262cb4e-2b5a-4beb-ba9f-4580340a77ea tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:58.046256 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a262cb4e-2b5a-4beb-ba9f-4580340a77ea tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:58.046724 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a262cb4e-2b5a-4beb-ba9f-4580340a77ea tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:58.071463 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4f28dd79-0d3a-4523-b6b3-0a0a217e0883 None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126152 Apr 08 11:14:58.072636 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 38/86] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:14:58.082137 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b2cba3cf-9397-4ae8-b760-787c7c66a00c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:58.083020 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b2cba3cf-9397-4ae8-b760-787c7c66a00c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:14:58.094645 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b2cba3cf-9397-4ae8-b760-787c7c66a00c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:58.095482 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b2cba3cf-9397-4ae8-b760-787c7c66a00c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:58.096886 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b2cba3cf-9397-4ae8-b760-787c7c66a00c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:58.098078 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b2cba3cf-9397-4ae8-b760-787c7c66a00c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:58.239948 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b2cba3cf-9397-4ae8-b760-787c7c66a00c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:58.256689 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b2cba3cf-9397-4ae8-b760-787c7c66a00c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1234 microversion: 2.1 time: 0.176760 Apr 08 11:14:58.256689 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 39/87] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:14:58 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1234 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:14:58.272192 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-faa3e444-2854-46b1-873b-478da9fbefcf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:58.272864 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-faa3e444-2854-46b1-873b-478da9fbefcf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:14:58.449599 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-faa3e444-2854-46b1-873b-478da9fbefcf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:58.460160 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-faa3e444-2854-46b1-873b-478da9fbefcf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:58.464391 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-faa3e444-2854-46b1-873b-478da9fbefcf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:58.467552 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-faa3e444-2854-46b1-873b-478da9fbefcf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1282 microversion: 2.20 time: 0.213752 Apr 08 11:14:58.474964 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 40/88] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:14:58 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1282 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:14:58.562879 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a262cb4e-2b5a-4beb-ba9f-4580340a77ea tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:58.571843 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a262cb4e-2b5a-4beb-ba9f-4580340a77ea tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1321 microversion: 2.1 time: 0.550357 Apr 08 11:14:58.572430 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 49/89] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:14:58 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1321 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:14:58.704220 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3137a97e-e9d1-43de-abb7-1e06404bdcdd tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:58.705321 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3137a97e-e9d1-43de-abb7-1e06404bdcdd tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:14:58.715297 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3137a97e-e9d1-43de-abb7-1e06404bdcdd tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:58.715823 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3137a97e-e9d1-43de-abb7-1e06404bdcdd tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:58.716754 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3137a97e-e9d1-43de-abb7-1e06404bdcdd tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:58.717601 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3137a97e-e9d1-43de-abb7-1e06404bdcdd tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:58.961524 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3137a97e-e9d1-43de-abb7-1e06404bdcdd tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44deb9de4511458ba769ad2b8b26651c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a05f833c354a00a03d62f49c9e3402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:58.972253 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3137a97e-e9d1-43de-abb7-1e06404bdcdd tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 200 len: 1314 microversion: 2.1 time: 0.272940 Apr 08 11:14:58.981940 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 41/90] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:14:58 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:14:59.269717 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-4b52ccbb-99f0-4b57-9c3d-179618dbc41a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:59.270347 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-4b52ccbb-99f0-4b57-9c3d-179618dbc41a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:14:59.276557 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4b52ccbb-99f0-4b57-9c3d-179618dbc41a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:59.277307 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4b52ccbb-99f0-4b57-9c3d-179618dbc41a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:59.278412 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4b52ccbb-99f0-4b57-9c3d-179618dbc41a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:59.279153 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4b52ccbb-99f0-4b57-9c3d-179618dbc41a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:59.342280 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-4b52ccbb-99f0-4b57-9c3d-179618dbc41a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:59.350682 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-4b52ccbb-99f0-4b57-9c3d-179618dbc41a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1234 microversion: 2.1 time: 0.084810 Apr 08 11:14:59.351395 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 50/91] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:14:59 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1234 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:14:59.492581 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-fe4793b7-10e1-4cdc-8d56-7e464001d734 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:59.493063 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-fe4793b7-10e1-4cdc-8d56-7e464001d734 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:14:59.548889 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-fe4793b7-10e1-4cdc-8d56-7e464001d734 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:59.557301 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-fe4793b7-10e1-4cdc-8d56-7e464001d734 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:59.558840 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-fe4793b7-10e1-4cdc-8d56-7e464001d734 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:59.560553 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-fe4793b7-10e1-4cdc-8d56-7e464001d734 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1282 microversion: 2.20 time: 0.071953 Apr 08 11:14:59.571140 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 42/92] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:14:59 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1282 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:14:59.604403 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-27e9f3a7-4b81-4124-9173-90b3bf466f08 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:59.604403 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-27e9f3a7-4b81-4124-9173-90b3bf466f08 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:14:59.609165 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-27e9f3a7-4b81-4124-9173-90b3bf466f08 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:59.609927 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-27e9f3a7-4b81-4124-9173-90b3bf466f08 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:59.610730 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-27e9f3a7-4b81-4124-9173-90b3bf466f08 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:59.611366 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-27e9f3a7-4b81-4124-9173-90b3bf466f08 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:14:59.767482 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-27e9f3a7-4b81-4124-9173-90b3bf466f08 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:14:59.775130 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-27e9f3a7-4b81-4124-9173-90b3bf466f08 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1321 microversion: 2.1 time: 0.188364 Apr 08 11:14:59.775700 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 51/93] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:14:59 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:14:59.989107 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a332f6f6-962f-49b6-9433-9dae6ff34381 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:14:59.989725 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a332f6f6-962f-49b6-9433-9dae6ff34381 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:14:59.996005 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a332f6f6-962f-49b6-9433-9dae6ff34381 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:14:59.996412 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a332f6f6-962f-49b6-9433-9dae6ff34381 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:00.000097 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a332f6f6-962f-49b6-9433-9dae6ff34381 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:00.001108 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a332f6f6-962f-49b6-9433-9dae6ff34381 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:00.196667 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a332f6f6-962f-49b6-9433-9dae6ff34381 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44deb9de4511458ba769ad2b8b26651c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a05f833c354a00a03d62f49c9e3402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:00.207827 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a332f6f6-962f-49b6-9433-9dae6ff34381 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 200 len: 1314 microversion: 2.1 time: 0.222610 Apr 08 11:15:00.209037 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 43/94] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:14:59 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:00.368736 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-19e9fc00-013d-42b9-9658-a511d14b6095 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:00.369345 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-19e9fc00-013d-42b9-9658-a511d14b6095 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:00.376046 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-19e9fc00-013d-42b9-9658-a511d14b6095 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:00.381277 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-19e9fc00-013d-42b9-9658-a511d14b6095 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:00.381277 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-19e9fc00-013d-42b9-9658-a511d14b6095 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:00.381277 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-19e9fc00-013d-42b9-9658-a511d14b6095 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:00.447825 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-19e9fc00-013d-42b9-9658-a511d14b6095 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:00.455797 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-19e9fc00-013d-42b9-9658-a511d14b6095 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1234 microversion: 2.1 time: 0.090969 Apr 08 11:15:00.456609 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 52/95] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:00 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1234 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:15:00.578888 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b1437285-f3e8-45a2-87b6-9642cf3c4976 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:00.579501 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b1437285-f3e8-45a2-87b6-9642cf3c4976 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:00.585836 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b1437285-f3e8-45a2-87b6-9642cf3c4976 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:00.593218 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b1437285-f3e8-45a2-87b6-9642cf3c4976 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:00.593218 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b1437285-f3e8-45a2-87b6-9642cf3c4976 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:00.593218 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b1437285-f3e8-45a2-87b6-9642cf3c4976 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:00.663628 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b1437285-f3e8-45a2-87b6-9642cf3c4976 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:00.673620 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b1437285-f3e8-45a2-87b6-9642cf3c4976 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:00.675555 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b1437285-f3e8-45a2-87b6-9642cf3c4976 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:00.676755 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b1437285-f3e8-45a2-87b6-9642cf3c4976 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1286 microversion: 2.20 time: 0.101873 Apr 08 11:15:00.677391 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 44/96] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:15:00 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1286 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:15:00.805127 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-f83deea0-4a97-4e11-97bc-63e75546ab7d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:00.805127 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-f83deea0-4a97-4e11-97bc-63e75546ab7d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:00.805127 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f83deea0-4a97-4e11-97bc-63e75546ab7d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:00.805744 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f83deea0-4a97-4e11-97bc-63e75546ab7d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:00.806441 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f83deea0-4a97-4e11-97bc-63e75546ab7d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:00.806876 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f83deea0-4a97-4e11-97bc-63e75546ab7d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:00.957554 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f83deea0-4a97-4e11-97bc-63e75546ab7d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:00.967208 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-f83deea0-4a97-4e11-97bc-63e75546ab7d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1321 microversion: 2.1 time: 0.178081 Apr 08 11:15:00.968170 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 53/97] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:00 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:01.227949 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d6a6a626-7d5b-4c6d-876a-03984f416d39 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:01.228626 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d6a6a626-7d5b-4c6d-876a-03984f416d39 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:01.242353 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d6a6a626-7d5b-4c6d-876a-03984f416d39 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:01.243156 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d6a6a626-7d5b-4c6d-876a-03984f416d39 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:01.246151 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d6a6a626-7d5b-4c6d-876a-03984f416d39 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:01.248433 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d6a6a626-7d5b-4c6d-876a-03984f416d39 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:01.415326 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d6a6a626-7d5b-4c6d-876a-03984f416d39 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44deb9de4511458ba769ad2b8b26651c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a05f833c354a00a03d62f49c9e3402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:01.422662 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d6a6a626-7d5b-4c6d-876a-03984f416d39 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 200 len: 1314 microversion: 2.1 time: 0.201210 Apr 08 11:15:01.423322 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 45/98] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:01 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:01.472544 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-07aa8039-73b0-4c85-84a3-5be3d45ae54e tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:01.473451 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-07aa8039-73b0-4c85-84a3-5be3d45ae54e tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:01.481403 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-07aa8039-73b0-4c85-84a3-5be3d45ae54e tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:01.482163 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-07aa8039-73b0-4c85-84a3-5be3d45ae54e tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:01.484195 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-07aa8039-73b0-4c85-84a3-5be3d45ae54e tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:01.484748 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-07aa8039-73b0-4c85-84a3-5be3d45ae54e tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:01.557539 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-07aa8039-73b0-4c85-84a3-5be3d45ae54e tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:01.565972 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-07aa8039-73b0-4c85-84a3-5be3d45ae54e tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1234 microversion: 2.1 time: 0.097362 Apr 08 11:15:01.572657 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 54/99] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:01 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1234 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:01.695475 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-138d8ea8-f390-43db-9380-f057ae6f2485 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:01.696275 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-138d8ea8-f390-43db-9380-f057ae6f2485 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:01.719199 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-138d8ea8-f390-43db-9380-f057ae6f2485 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:01.719199 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-138d8ea8-f390-43db-9380-f057ae6f2485 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:01.719199 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-138d8ea8-f390-43db-9380-f057ae6f2485 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:01.719199 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-138d8ea8-f390-43db-9380-f057ae6f2485 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:01.865039 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-138d8ea8-f390-43db-9380-f057ae6f2485 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:01.876261 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-138d8ea8-f390-43db-9380-f057ae6f2485 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:01.878828 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-138d8ea8-f390-43db-9380-f057ae6f2485 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:01.880908 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-138d8ea8-f390-43db-9380-f057ae6f2485 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1286 microversion: 2.20 time: 0.189321 Apr 08 11:15:01.882062 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 46/100] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:15:01 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1286 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:15:01.985597 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-cf8a8ffd-ece5-460e-ac1a-98a7da90f2da tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:01.986247 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-cf8a8ffd-ece5-460e-ac1a-98a7da90f2da tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:01.992389 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cf8a8ffd-ece5-460e-ac1a-98a7da90f2da tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:01.993119 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cf8a8ffd-ece5-460e-ac1a-98a7da90f2da tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:01.994109 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cf8a8ffd-ece5-460e-ac1a-98a7da90f2da tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:01.994546 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cf8a8ffd-ece5-460e-ac1a-98a7da90f2da tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:02.294038 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-cf8a8ffd-ece5-460e-ac1a-98a7da90f2da tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:02.304192 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-cf8a8ffd-ece5-460e-ac1a-98a7da90f2da tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1321 microversion: 2.1 time: 0.323423 Apr 08 11:15:02.305283 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 55/101] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:01 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1321 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:02.442032 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0eba4524-40cf-46a1-afe2-5879cd7472dc tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:02.443242 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0eba4524-40cf-46a1-afe2-5879cd7472dc tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:02.451743 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0eba4524-40cf-46a1-afe2-5879cd7472dc tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:02.464436 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0eba4524-40cf-46a1-afe2-5879cd7472dc tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:02.464436 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0eba4524-40cf-46a1-afe2-5879cd7472dc tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:02.464436 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0eba4524-40cf-46a1-afe2-5879cd7472dc tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:02.583603 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-3ad93aa2-2e7e-4ec6-8b84-b2984f754401 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:02.584146 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-3ad93aa2-2e7e-4ec6-8b84-b2984f754401 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:02.590639 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3ad93aa2-2e7e-4ec6-8b84-b2984f754401 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:02.591522 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3ad93aa2-2e7e-4ec6-8b84-b2984f754401 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:02.592326 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3ad93aa2-2e7e-4ec6-8b84-b2984f754401 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:02.592773 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3ad93aa2-2e7e-4ec6-8b84-b2984f754401 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:02.596642 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0eba4524-40cf-46a1-afe2-5879cd7472dc tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44deb9de4511458ba769ad2b8b26651c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a05f833c354a00a03d62f49c9e3402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:02.604140 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0eba4524-40cf-46a1-afe2-5879cd7472dc tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 200 len: 1314 microversion: 2.1 time: 0.167727 Apr 08 11:15:02.604718 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 47/102] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:02 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:02.654342 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-3ad93aa2-2e7e-4ec6-8b84-b2984f754401 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:02.661530 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-3ad93aa2-2e7e-4ec6-8b84-b2984f754401 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1290 microversion: 2.1 time: 0.082470 Apr 08 11:15:02.662131 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 56/103] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:02 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1290 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:15:02.900261 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6ece7956-6117-4608-ba0c-ca94796cbe8a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:02.900261 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6ece7956-6117-4608-ba0c-ca94796cbe8a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:02.906664 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6ece7956-6117-4608-ba0c-ca94796cbe8a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:02.907145 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6ece7956-6117-4608-ba0c-ca94796cbe8a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:02.907941 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6ece7956-6117-4608-ba0c-ca94796cbe8a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:02.908382 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6ece7956-6117-4608-ba0c-ca94796cbe8a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:02.969569 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6ece7956-6117-4608-ba0c-ca94796cbe8a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:02.977361 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6ece7956-6117-4608-ba0c-ca94796cbe8a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:02.978899 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6ece7956-6117-4608-ba0c-ca94796cbe8a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:02.979998 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6ece7956-6117-4608-ba0c-ca94796cbe8a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1286 microversion: 2.20 time: 0.084552 Apr 08 11:15:02.980613 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 48/104] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:15:02 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:15:03.322576 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-693b07f9-68e7-4f35-bcaa-f0f7490c2ca8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:03.323224 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-693b07f9-68e7-4f35-bcaa-f0f7490c2ca8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:03.330224 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-693b07f9-68e7-4f35-bcaa-f0f7490c2ca8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:03.330707 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-693b07f9-68e7-4f35-bcaa-f0f7490c2ca8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:03.331502 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-693b07f9-68e7-4f35-bcaa-f0f7490c2ca8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:03.331915 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-693b07f9-68e7-4f35-bcaa-f0f7490c2ca8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:03.621833 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d67df407-7fdd-4a6b-8667-84b2bb9fbbdf tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:03.622458 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d67df407-7fdd-4a6b-8667-84b2bb9fbbdf tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:03.628538 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d67df407-7fdd-4a6b-8667-84b2bb9fbbdf tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:03.628995 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d67df407-7fdd-4a6b-8667-84b2bb9fbbdf tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:03.629818 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d67df407-7fdd-4a6b-8667-84b2bb9fbbdf tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:03.630264 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d67df407-7fdd-4a6b-8667-84b2bb9fbbdf tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:03.694772 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-693b07f9-68e7-4f35-bcaa-f0f7490c2ca8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:03.702884 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-693b07f9-68e7-4f35-bcaa-f0f7490c2ca8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1321 microversion: 2.1 time: 0.384118 Apr 08 11:15:03.703466 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 57/105] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:03 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1321 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:15:03.716107 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-ffdbe8dc-a958-49e6-b726-1d07645d15ef tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:03.716766 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-ffdbe8dc-a958-49e6-b726-1d07645d15ef tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:03.722610 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ffdbe8dc-a958-49e6-b726-1d07645d15ef tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:03.723104 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ffdbe8dc-a958-49e6-b726-1d07645d15ef tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:03.723886 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ffdbe8dc-a958-49e6-b726-1d07645d15ef tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:03.724318 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ffdbe8dc-a958-49e6-b726-1d07645d15ef tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:03.817144 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-ffdbe8dc-a958-49e6-b726-1d07645d15ef tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:03.825756 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-ffdbe8dc-a958-49e6-b726-1d07645d15ef tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1290 microversion: 2.1 time: 0.113525 Apr 08 11:15:03.826475 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 58/106] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:03 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1290 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:03.997263 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-74dcbdc2-e8ff-4a6d-98af-080cfa0b04a3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:03.997856 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-74dcbdc2-e8ff-4a6d-98af-080cfa0b04a3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:04.003955 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-74dcbdc2-e8ff-4a6d-98af-080cfa0b04a3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:04.004405 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-74dcbdc2-e8ff-4a6d-98af-080cfa0b04a3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:04.005195 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-74dcbdc2-e8ff-4a6d-98af-080cfa0b04a3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:04.005629 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-74dcbdc2-e8ff-4a6d-98af-080cfa0b04a3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:04.058984 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d67df407-7fdd-4a6b-8667-84b2bb9fbbdf tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44deb9de4511458ba769ad2b8b26651c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a05f833c354a00a03d62f49c9e3402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:04.068405 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d67df407-7fdd-4a6b-8667-84b2bb9fbbdf tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 200 len: 1314 microversion: 2.1 time: 0.451086 Apr 08 11:15:04.068884 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 49/107] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:03 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 1314 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:15:04.075112 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-74dcbdc2-e8ff-4a6d-98af-080cfa0b04a3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:04.083829 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-74dcbdc2-e8ff-4a6d-98af-080cfa0b04a3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:04.085398 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-74dcbdc2-e8ff-4a6d-98af-080cfa0b04a3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:04.086522 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-74dcbdc2-e8ff-4a6d-98af-080cfa0b04a3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1286 microversion: 2.20 time: 0.093174 Apr 08 11:15:04.087116 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 59/108] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:15:03 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:15:04.719644 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-26dd9159-2c97-47e9-bfe7-d1b486bd55be tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:04.720264 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-26dd9159-2c97-47e9-bfe7-d1b486bd55be tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:04.732010 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-26dd9159-2c97-47e9-bfe7-d1b486bd55be tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:04.732010 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-26dd9159-2c97-47e9-bfe7-d1b486bd55be tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:04.732010 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-26dd9159-2c97-47e9-bfe7-d1b486bd55be tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:04.732010 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-26dd9159-2c97-47e9-bfe7-d1b486bd55be tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:04.846053 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-93ccd249-6bf6-47ba-a8b2-466404914c6c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:04.846865 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-93ccd249-6bf6-47ba-a8b2-466404914c6c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:04.855244 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-93ccd249-6bf6-47ba-a8b2-466404914c6c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:04.855923 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-93ccd249-6bf6-47ba-a8b2-466404914c6c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:04.856710 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-93ccd249-6bf6-47ba-a8b2-466404914c6c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:04.857318 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-93ccd249-6bf6-47ba-a8b2-466404914c6c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:04.961627 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-93ccd249-6bf6-47ba-a8b2-466404914c6c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:04.969012 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-93ccd249-6bf6-47ba-a8b2-466404914c6c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1290 microversion: 2.1 time: 0.129533 Apr 08 11:15:04.969782 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 60/109] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:04 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1290 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:04.995131 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-26dd9159-2c97-47e9-bfe7-d1b486bd55be tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:05.003204 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-26dd9159-2c97-47e9-bfe7-d1b486bd55be tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1321 microversion: 2.1 time: 0.287272 Apr 08 11:15:05.003880 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 50/110] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:04 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1321 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:05.086041 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-b77fb968-79f0-4e7f-bd42-74bc7a06db7d tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:05.086672 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-b77fb968-79f0-4e7f-bd42-74bc7a06db7d tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:05.092629 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b77fb968-79f0-4e7f-bd42-74bc7a06db7d tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:05.093085 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b77fb968-79f0-4e7f-bd42-74bc7a06db7d tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:05.094001 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b77fb968-79f0-4e7f-bd42-74bc7a06db7d tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:05.094778 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b77fb968-79f0-4e7f-bd42-74bc7a06db7d tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:05.107773 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5b3912bd-723e-4e47-9563-43f57059a173 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:05.108391 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5b3912bd-723e-4e47-9563-43f57059a173 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:05.114981 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5b3912bd-723e-4e47-9563-43f57059a173 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:05.115442 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5b3912bd-723e-4e47-9563-43f57059a173 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:05.116226 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5b3912bd-723e-4e47-9563-43f57059a173 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:05.116665 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5b3912bd-723e-4e47-9563-43f57059a173 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:05.194560 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5b3912bd-723e-4e47-9563-43f57059a173 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:05.203162 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5b3912bd-723e-4e47-9563-43f57059a173 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:05.204650 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5b3912bd-723e-4e47-9563-43f57059a173 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:05.205967 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5b3912bd-723e-4e47-9563-43f57059a173 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1286 microversion: 2.20 time: 0.103644 Apr 08 11:15:05.206916 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 51/111] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:15:05 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1286 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:15:05.313143 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b77fb968-79f0-4e7f-bd42-74bc7a06db7d tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44deb9de4511458ba769ad2b8b26651c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a05f833c354a00a03d62f49c9e3402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:05.321298 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-b77fb968-79f0-4e7f-bd42-74bc7a06db7d tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 200 len: 1314 microversion: 2.1 time: 0.239108 Apr 08 11:15:05.321941 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 61/112] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:05 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:05.986011 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f0136047-bf55-4674-83d6-97deb0681d08 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:05.986623 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f0136047-bf55-4674-83d6-97deb0681d08 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:05.992662 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f0136047-bf55-4674-83d6-97deb0681d08 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:05.993153 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f0136047-bf55-4674-83d6-97deb0681d08 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:05.993975 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f0136047-bf55-4674-83d6-97deb0681d08 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:05.994418 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f0136047-bf55-4674-83d6-97deb0681d08 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:06.020475 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-1c661688-c265-495a-aa1f-209cf893bde4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:06.021058 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-1c661688-c265-495a-aa1f-209cf893bde4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:06.027904 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1c661688-c265-495a-aa1f-209cf893bde4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:06.035116 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1c661688-c265-495a-aa1f-209cf893bde4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:06.035116 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1c661688-c265-495a-aa1f-209cf893bde4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:06.035116 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1c661688-c265-495a-aa1f-209cf893bde4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:06.064262 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f0136047-bf55-4674-83d6-97deb0681d08 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:06.072495 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f0136047-bf55-4674-83d6-97deb0681d08 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1290 microversion: 2.1 time: 0.090848 Apr 08 11:15:06.073617 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 52/113] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:05 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1290 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:06.190761 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1c661688-c265-495a-aa1f-209cf893bde4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:06.200442 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-1c661688-c265-495a-aa1f-209cf893bde4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1321 microversion: 2.1 time: 0.184161 Apr 08 11:15:06.201450 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 62/114] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:06 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:15:06.225027 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4536adfc-0618-4fae-af35-20cb685ca380 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:06.225560 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4536adfc-0618-4fae-af35-20cb685ca380 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:06.235015 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4536adfc-0618-4fae-af35-20cb685ca380 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:06.235502 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4536adfc-0618-4fae-af35-20cb685ca380 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:06.236550 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4536adfc-0618-4fae-af35-20cb685ca380 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:06.236758 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4536adfc-0618-4fae-af35-20cb685ca380 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:06.327447 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4536adfc-0618-4fae-af35-20cb685ca380 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:06.339217 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-7203b7f8-fb0e-4961-90ea-f19ff56f76c0 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:06.340128 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-7203b7f8-fb0e-4961-90ea-f19ff56f76c0 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:06.340684 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4536adfc-0618-4fae-af35-20cb685ca380 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:06.343156 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4536adfc-0618-4fae-af35-20cb685ca380 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:06.344976 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4536adfc-0618-4fae-af35-20cb685ca380 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1278 microversion: 2.20 time: 0.124212 Apr 08 11:15:06.348683 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7203b7f8-fb0e-4961-90ea-f19ff56f76c0 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:06.350415 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7203b7f8-fb0e-4961-90ea-f19ff56f76c0 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:06.351404 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7203b7f8-fb0e-4961-90ea-f19ff56f76c0 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:06.352018 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7203b7f8-fb0e-4961-90ea-f19ff56f76c0 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:06.356701 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 53/115] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:15:06 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1278 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:15:06.508061 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-7203b7f8-fb0e-4961-90ea-f19ff56f76c0 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44deb9de4511458ba769ad2b8b26651c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a05f833c354a00a03d62f49c9e3402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:06.516689 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-7203b7f8-fb0e-4961-90ea-f19ff56f76c0 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 200 len: 1314 microversion: 2.1 time: 0.181355 Apr 08 11:15:06.519822 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 63/116] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:06 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:07.089609 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5e239b6d-bc67-4351-9dd1-f5b1fcbff23a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:07.091065 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5e239b6d-bc67-4351-9dd1-f5b1fcbff23a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:07.097230 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5e239b6d-bc67-4351-9dd1-f5b1fcbff23a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:07.098009 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5e239b6d-bc67-4351-9dd1-f5b1fcbff23a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:07.100062 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5e239b6d-bc67-4351-9dd1-f5b1fcbff23a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:07.101238 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5e239b6d-bc67-4351-9dd1-f5b1fcbff23a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:07.170751 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5e239b6d-bc67-4351-9dd1-f5b1fcbff23a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:07.176802 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5e239b6d-bc67-4351-9dd1-f5b1fcbff23a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1290 microversion: 2.1 time: 0.090915 Apr 08 11:15:07.178168 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 54/117] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:07 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1290 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:07.220403 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-c1d55d2a-4ca6-41d5-8d5b-f84ef0b76847 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:07.221551 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-c1d55d2a-4ca6-41d5-8d5b-f84ef0b76847 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:07.229396 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c1d55d2a-4ca6-41d5-8d5b-f84ef0b76847 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:07.229938 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c1d55d2a-4ca6-41d5-8d5b-f84ef0b76847 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:07.231244 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c1d55d2a-4ca6-41d5-8d5b-f84ef0b76847 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:07.231746 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c1d55d2a-4ca6-41d5-8d5b-f84ef0b76847 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:07.363603 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-df1e346b-9e8a-440d-b33e-e519b2e9e190 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:07.365730 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-df1e346b-9e8a-440d-b33e-e519b2e9e190 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:07.373746 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-df1e346b-9e8a-440d-b33e-e519b2e9e190 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:07.374387 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-df1e346b-9e8a-440d-b33e-e519b2e9e190 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:07.375689 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-df1e346b-9e8a-440d-b33e-e519b2e9e190 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:07.376207 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-df1e346b-9e8a-440d-b33e-e519b2e9e190 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:07.470969 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-df1e346b-9e8a-440d-b33e-e519b2e9e190 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:07.476304 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-c1d55d2a-4ca6-41d5-8d5b-f84ef0b76847 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:07.481647 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-df1e346b-9e8a-440d-b33e-e519b2e9e190 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:07.484003 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-df1e346b-9e8a-440d-b33e-e519b2e9e190 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:07.484145 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-c1d55d2a-4ca6-41d5-8d5b-f84ef0b76847 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1321 microversion: 2.1 time: 0.268845 Apr 08 11:15:07.484725 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 64/118] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:07 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1321 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:07.485057 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-df1e346b-9e8a-440d-b33e-e519b2e9e190 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1278 microversion: 2.20 time: 0.124987 Apr 08 11:15:07.486325 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 55/119] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:15:07 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1278 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:15:07.538377 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-1fccc81e-d7d9-4e8e-8d9d-8c0dc49e0b9a tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:07.539153 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-1fccc81e-d7d9-4e8e-8d9d-8c0dc49e0b9a tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:07.551580 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1fccc81e-d7d9-4e8e-8d9d-8c0dc49e0b9a tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:07.552439 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1fccc81e-d7d9-4e8e-8d9d-8c0dc49e0b9a tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:07.553617 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1fccc81e-d7d9-4e8e-8d9d-8c0dc49e0b9a tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:07.554251 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1fccc81e-d7d9-4e8e-8d9d-8c0dc49e0b9a tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:07.959036 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1fccc81e-d7d9-4e8e-8d9d-8c0dc49e0b9a tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44deb9de4511458ba769ad2b8b26651c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a05f833c354a00a03d62f49c9e3402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:07.976410 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-1fccc81e-d7d9-4e8e-8d9d-8c0dc49e0b9a tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 200 len: 1314 microversion: 2.1 time: 0.441828 Apr 08 11:15:07.978242 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 65/120] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:07 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:08.196165 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6a90539a-26db-41f2-aea5-72dba57a3b54 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:08.197527 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6a90539a-26db-41f2-aea5-72dba57a3b54 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:08.213116 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6a90539a-26db-41f2-aea5-72dba57a3b54 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:08.213634 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6a90539a-26db-41f2-aea5-72dba57a3b54 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:08.216263 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6a90539a-26db-41f2-aea5-72dba57a3b54 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:08.216754 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6a90539a-26db-41f2-aea5-72dba57a3b54 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:08.317684 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6a90539a-26db-41f2-aea5-72dba57a3b54 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:08.325577 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6a90539a-26db-41f2-aea5-72dba57a3b54 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1290 microversion: 2.1 time: 0.134808 Apr 08 11:15:08.326524 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 56/121] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:08 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1290 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:08.506606 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-3f651771-e62b-4c74-9857-98b5dd1880ce tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:08.508929 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-3f651771-e62b-4c74-9857-98b5dd1880ce tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:08.530071 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-baba1d70-4ea9-41d9-9a76-92ca678ed2b0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:08.530473 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-baba1d70-4ea9-41d9-9a76-92ca678ed2b0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:08.547552 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3f651771-e62b-4c74-9857-98b5dd1880ce tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:08.550421 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3f651771-e62b-4c74-9857-98b5dd1880ce tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:08.562384 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3f651771-e62b-4c74-9857-98b5dd1880ce tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:08.562384 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3f651771-e62b-4c74-9857-98b5dd1880ce tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:08.562871 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-baba1d70-4ea9-41d9-9a76-92ca678ed2b0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:08.562871 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-baba1d70-4ea9-41d9-9a76-92ca678ed2b0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:08.567412 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-baba1d70-4ea9-41d9-9a76-92ca678ed2b0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:08.586535 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-baba1d70-4ea9-41d9-9a76-92ca678ed2b0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:08.760303 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-baba1d70-4ea9-41d9-9a76-92ca678ed2b0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:08.775632 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-baba1d70-4ea9-41d9-9a76-92ca678ed2b0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:08.775632 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-baba1d70-4ea9-41d9-9a76-92ca678ed2b0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:08.775632 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-baba1d70-4ea9-41d9-9a76-92ca678ed2b0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1334 microversion: 2.20 time: 0.256966 Apr 08 11:15:08.785910 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 57/122] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:15:08 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1334 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:15:08.905756 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-3f651771-e62b-4c74-9857-98b5dd1880ce tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:08.917915 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-3f651771-e62b-4c74-9857-98b5dd1880ce tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1321 microversion: 2.1 time: 0.420028 Apr 08 11:15:08.919084 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 66/123] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:08 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1321 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:09.019036 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7a6f9560-b58d-412f-b61d-2d35222c9f5e tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:09.021002 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7a6f9560-b58d-412f-b61d-2d35222c9f5e tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:09.032991 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7a6f9560-b58d-412f-b61d-2d35222c9f5e tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:09.039283 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7a6f9560-b58d-412f-b61d-2d35222c9f5e tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:09.039283 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7a6f9560-b58d-412f-b61d-2d35222c9f5e tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:09.039283 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7a6f9560-b58d-412f-b61d-2d35222c9f5e tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:09.262025 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7a6f9560-b58d-412f-b61d-2d35222c9f5e tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44deb9de4511458ba769ad2b8b26651c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a05f833c354a00a03d62f49c9e3402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:09.278546 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7a6f9560-b58d-412f-b61d-2d35222c9f5e tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 200 len: 1314 microversion: 2.1 time: 0.265585 Apr 08 11:15:09.290050 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 58/124] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:09 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:09.350372 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-89f360d7-21df-4a81-ae99-67722290ee13 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:09.351158 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-89f360d7-21df-4a81-ae99-67722290ee13 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:09.357813 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [req-7974957c-b534-40a2-b396-822acbb4e457 req-9460e7b1-27fb-44a1-94b9-d82e2bf1dd64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04fd539f-d648-4fd7-b824-351f408a0327", "name": "network-vif-plugged", "status": "completed", "tag": "e997b977-c6eb-4b8f-b12d-f27072ee34f1"}]} {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:15:09.361524 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-89f360d7-21df-4a81-ae99-67722290ee13 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:09.362079 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-89f360d7-21df-4a81-ae99-67722290ee13 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:09.363053 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-89f360d7-21df-4a81-ae99-67722290ee13 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:09.363778 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-89f360d7-21df-4a81-ae99-67722290ee13 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:09.367508 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-7974957c-b534-40a2-b396-822acbb4e457 req-9460e7b1-27fb-44a1-94b9-d82e2bf1dd64 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:09.368007 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-7974957c-b534-40a2-b396-822acbb4e457 req-9460e7b1-27fb-44a1-94b9-d82e2bf1dd64 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:09.380493 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.compute.server_external_events [req-7974957c-b534-40a2-b396-822acbb4e457 req-9460e7b1-27fb-44a1-94b9-d82e2bf1dd64 service nova] Creating event network-vif-plugged:e997b977-c6eb-4b8f-b12d-f27072ee34f1 for instance 04fd539f-d648-4fd7-b824-351f408a0327 on hv-cinder-83607 Apr 08 11:15:09.386518 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [req-7974957c-b534-40a2-b396-822acbb4e457 req-9460e7b1-27fb-44a1-94b9-d82e2bf1dd64 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.315930 Apr 08 11:15:09.387878 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 67/125] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:15:09.452208 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-89f360d7-21df-4a81-ae99-67722290ee13 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:09.474368 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-89f360d7-21df-4a81-ae99-67722290ee13 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1298 microversion: 2.1 time: 0.122569 Apr 08 11:15:09.474368 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 59/126] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:09 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1298 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:15:09.793504 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-f4392fd5-b674-4db3-9b52-b500c275028a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:09.794801 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-f4392fd5-b674-4db3-9b52-b500c275028a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:09.803346 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f4392fd5-b674-4db3-9b52-b500c275028a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:09.804251 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f4392fd5-b674-4db3-9b52-b500c275028a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:09.805239 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f4392fd5-b674-4db3-9b52-b500c275028a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:09.806049 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f4392fd5-b674-4db3-9b52-b500c275028a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:09.878152 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f4392fd5-b674-4db3-9b52-b500c275028a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:09.886927 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f4392fd5-b674-4db3-9b52-b500c275028a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:09.888596 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f4392fd5-b674-4db3-9b52-b500c275028a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:09.889641 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-f4392fd5-b674-4db3-9b52-b500c275028a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1342 microversion: 2.20 time: 0.100809 Apr 08 11:15:09.890378 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 68/127] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:15:09 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1342 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:15:09.935128 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-54e7d977-1a4f-43a4-aae9-4eaa8b3069a4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:09.935737 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-54e7d977-1a4f-43a4-aae9-4eaa8b3069a4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:09.942348 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-54e7d977-1a4f-43a4-aae9-4eaa8b3069a4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:09.942846 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-54e7d977-1a4f-43a4-aae9-4eaa8b3069a4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:09.943807 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-54e7d977-1a4f-43a4-aae9-4eaa8b3069a4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:09.944245 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-54e7d977-1a4f-43a4-aae9-4eaa8b3069a4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:10.146820 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-54e7d977-1a4f-43a4-aae9-4eaa8b3069a4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:10.158241 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-54e7d977-1a4f-43a4-aae9-4eaa8b3069a4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1321 microversion: 2.1 time: 0.225902 Apr 08 11:15:10.158860 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 60/128] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:09 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:10.304354 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-01eb41fe-321e-4a6e-85b4-c570216ab1dc tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:10.305153 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-01eb41fe-321e-4a6e-85b4-c570216ab1dc tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:10.311365 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-01eb41fe-321e-4a6e-85b4-c570216ab1dc tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:10.311986 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-01eb41fe-321e-4a6e-85b4-c570216ab1dc tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:10.312788 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-01eb41fe-321e-4a6e-85b4-c570216ab1dc tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:10.313288 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-01eb41fe-321e-4a6e-85b4-c570216ab1dc tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:10.464678 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-01eb41fe-321e-4a6e-85b4-c570216ab1dc tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44deb9de4511458ba769ad2b8b26651c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a05f833c354a00a03d62f49c9e3402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:10.473695 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-01eb41fe-321e-4a6e-85b4-c570216ab1dc tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 200 len: 1314 microversion: 2.1 time: 0.172503 Apr 08 11:15:10.474574 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 69/129] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:10 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:10.484457 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f69bca34-bdeb-4e68-a706-a06234af3daa tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:10.485075 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f69bca34-bdeb-4e68-a706-a06234af3daa tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:10.492223 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f69bca34-bdeb-4e68-a706-a06234af3daa tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:10.492638 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f69bca34-bdeb-4e68-a706-a06234af3daa tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:10.493432 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f69bca34-bdeb-4e68-a706-a06234af3daa tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:10.493890 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f69bca34-bdeb-4e68-a706-a06234af3daa tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:10.564093 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f69bca34-bdeb-4e68-a706-a06234af3daa tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:10.571943 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f69bca34-bdeb-4e68-a706-a06234af3daa tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1298 microversion: 2.1 time: 0.091636 Apr 08 11:15:10.572502 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 61/130] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:10 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1298 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:10.909407 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-f415e138-a90c-4d5f-9b27-45dd0c7ac4f4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:10.910654 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-f415e138-a90c-4d5f-9b27-45dd0c7ac4f4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:10.923132 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f415e138-a90c-4d5f-9b27-45dd0c7ac4f4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:10.923581 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f415e138-a90c-4d5f-9b27-45dd0c7ac4f4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:10.924434 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f415e138-a90c-4d5f-9b27-45dd0c7ac4f4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:10.924831 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f415e138-a90c-4d5f-9b27-45dd0c7ac4f4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:10.999231 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f415e138-a90c-4d5f-9b27-45dd0c7ac4f4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:11.007112 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f415e138-a90c-4d5f-9b27-45dd0c7ac4f4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:11.008677 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f415e138-a90c-4d5f-9b27-45dd0c7ac4f4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:11.009799 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-f415e138-a90c-4d5f-9b27-45dd0c7ac4f4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1342 microversion: 2.20 time: 0.104285 Apr 08 11:15:11.010512 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 70/131] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:15:10 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1342 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:15:11.176978 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e83bfe2c-0ea8-4ca5-a5c1-0853a918f283 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:11.177808 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e83bfe2c-0ea8-4ca5-a5c1-0853a918f283 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:11.186342 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e83bfe2c-0ea8-4ca5-a5c1-0853a918f283 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:11.187309 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e83bfe2c-0ea8-4ca5-a5c1-0853a918f283 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:11.188671 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e83bfe2c-0ea8-4ca5-a5c1-0853a918f283 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:11.189373 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e83bfe2c-0ea8-4ca5-a5c1-0853a918f283 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:11.495644 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-4a408aae-ed5c-430b-929f-c535f333ce5f tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:11.497305 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-4a408aae-ed5c-430b-929f-c535f333ce5f tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:11.519592 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4a408aae-ed5c-430b-929f-c535f333ce5f tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:11.520634 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4a408aae-ed5c-430b-929f-c535f333ce5f tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:11.526003 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4a408aae-ed5c-430b-929f-c535f333ce5f tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:11.526003 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4a408aae-ed5c-430b-929f-c535f333ce5f tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:11.673659 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e83bfe2c-0ea8-4ca5-a5c1-0853a918f283 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:11.692147 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e83bfe2c-0ea8-4ca5-a5c1-0853a918f283 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1321 microversion: 2.1 time: 0.520237 Apr 08 11:15:11.692952 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 62/132] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:11 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1321 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:11.697749 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2a7375aa-f692-4c15-a10b-e31c0a3a938b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:11.698393 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2a7375aa-f692-4c15-a10b-e31c0a3a938b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:11.714740 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2a7375aa-f692-4c15-a10b-e31c0a3a938b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:11.715208 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2a7375aa-f692-4c15-a10b-e31c0a3a938b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:11.715995 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2a7375aa-f692-4c15-a10b-e31c0a3a938b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:11.716441 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2a7375aa-f692-4c15-a10b-e31c0a3a938b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:11.904192 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2a7375aa-f692-4c15-a10b-e31c0a3a938b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:11.913635 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2a7375aa-f692-4c15-a10b-e31c0a3a938b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1308 microversion: 2.1 time: 0.219481 Apr 08 11:15:11.914250 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 63/133] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:11 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1308 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:11.983223 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-4a408aae-ed5c-430b-929f-c535f333ce5f tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44deb9de4511458ba769ad2b8b26651c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a05f833c354a00a03d62f49c9e3402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:11.991441 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-4a408aae-ed5c-430b-929f-c535f333ce5f tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 200 len: 1314 microversion: 2.1 time: 0.503301 Apr 08 11:15:12.003236 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 71/134] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:11 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 1314 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:15:12.040679 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-78154c09-c5b8-43fd-a2a2-cc2c6a04dc95 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:12.041309 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-78154c09-c5b8-43fd-a2a2-cc2c6a04dc95 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:12.052383 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-78154c09-c5b8-43fd-a2a2-cc2c6a04dc95 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:12.052801 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-78154c09-c5b8-43fd-a2a2-cc2c6a04dc95 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:12.053608 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-78154c09-c5b8-43fd-a2a2-cc2c6a04dc95 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:12.054077 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-78154c09-c5b8-43fd-a2a2-cc2c6a04dc95 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:12.188861 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-78154c09-c5b8-43fd-a2a2-cc2c6a04dc95 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:12.206419 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-78154c09-c5b8-43fd-a2a2-cc2c6a04dc95 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:12.208707 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-78154c09-c5b8-43fd-a2a2-cc2c6a04dc95 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:12.210632 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-78154c09-c5b8-43fd-a2a2-cc2c6a04dc95 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1352 microversion: 2.20 time: 0.182963 Apr 08 11:15:12.224446 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 64/135] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:15:12 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1352 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:15:12.724242 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-be468cd3-967e-402c-aa11-53413c856635 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:12.724989 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-be468cd3-967e-402c-aa11-53413c856635 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:12.732963 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-687d8fcc-798e-4410-b459-29af17dba528 req-d57c2cdc-c1c4-4b0e-95e8-2e31fbb06e5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea2b616a-165e-4f06-9017-37a69bc2a874", "name": "network-vif-plugged", "status": "completed", "tag": "e2a58113-a345-4b0a-9d62-117d6974817e"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:15:12.735873 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-be468cd3-967e-402c-aa11-53413c856635 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:12.738217 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-be468cd3-967e-402c-aa11-53413c856635 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:12.739223 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-be468cd3-967e-402c-aa11-53413c856635 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:12.746904 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-be468cd3-967e-402c-aa11-53413c856635 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:12.752787 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-687d8fcc-798e-4410-b459-29af17dba528 req-d57c2cdc-c1c4-4b0e-95e8-2e31fbb06e5c service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:12.755433 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-687d8fcc-798e-4410-b459-29af17dba528 req-d57c2cdc-c1c4-4b0e-95e8-2e31fbb06e5c service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:12.791289 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-687d8fcc-798e-4410-b459-29af17dba528 req-d57c2cdc-c1c4-4b0e-95e8-2e31fbb06e5c service nova] Creating event network-vif-plugged:e2a58113-a345-4b0a-9d62-117d6974817e for instance ea2b616a-165e-4f06-9017-37a69bc2a874 on hv-cinder-83607 Apr 08 11:15:12.804436 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-687d8fcc-798e-4410-b459-29af17dba528 req-d57c2cdc-c1c4-4b0e-95e8-2e31fbb06e5c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075260 Apr 08 11:15:12.808533 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 65/136] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:15:12.935803 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-09b55fd3-6323-40f9-ad10-243e6aba9d28 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:12.936608 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-09b55fd3-6323-40f9-ad10-243e6aba9d28 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:12.947983 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-09b55fd3-6323-40f9-ad10-243e6aba9d28 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:12.950893 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-09b55fd3-6323-40f9-ad10-243e6aba9d28 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:12.952405 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-09b55fd3-6323-40f9-ad10-243e6aba9d28 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:12.954235 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-09b55fd3-6323-40f9-ad10-243e6aba9d28 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:13.196492 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-be468cd3-967e-402c-aa11-53413c856635 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:13.206754 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-be468cd3-967e-402c-aa11-53413c856635 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1321 microversion: 2.1 time: 0.488681 Apr 08 11:15:13.211464 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 72/137] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:12 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1321 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:13.227891 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-d0a88712-134f-438a-9eec-9fae7716a10f tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:13.228754 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-d0a88712-134f-438a-9eec-9fae7716a10f tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:13.238397 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d0a88712-134f-438a-9eec-9fae7716a10f tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:13.239068 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d0a88712-134f-438a-9eec-9fae7716a10f tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:13.240224 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d0a88712-134f-438a-9eec-9fae7716a10f tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:13.240815 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d0a88712-134f-438a-9eec-9fae7716a10f tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:13.393925 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-09b55fd3-6323-40f9-ad10-243e6aba9d28 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:13.402276 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-09b55fd3-6323-40f9-ad10-243e6aba9d28 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1363 microversion: 2.1 time: 0.471128 Apr 08 11:15:13.412832 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 66/138] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:12 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1363 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:13.418639 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e0831b29-8289-45d1-a162-5c7fe6505737 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:13.419137 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e0831b29-8289-45d1-a162-5c7fe6505737 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:13.427092 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e0831b29-8289-45d1-a162-5c7fe6505737 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:13.427717 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e0831b29-8289-45d1-a162-5c7fe6505737 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:13.429050 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e0831b29-8289-45d1-a162-5c7fe6505737 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:13.429636 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e0831b29-8289-45d1-a162-5c7fe6505737 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:13.628525 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d0a88712-134f-438a-9eec-9fae7716a10f tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44deb9de4511458ba769ad2b8b26651c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a05f833c354a00a03d62f49c9e3402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:13.640148 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-d0a88712-134f-438a-9eec-9fae7716a10f tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 200 len: 1314 microversion: 2.1 time: 0.417754 Apr 08 11:15:13.647397 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 73/139] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:13 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:13.692473 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e0831b29-8289-45d1-a162-5c7fe6505737 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:13.701639 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e0831b29-8289-45d1-a162-5c7fe6505737 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:13.703311 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e0831b29-8289-45d1-a162-5c7fe6505737 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:13.704465 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e0831b29-8289-45d1-a162-5c7fe6505737 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1407 microversion: 2.20 time: 0.290352 Apr 08 11:15:13.705034 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 67/140] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:15:13 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1407 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:15:14.228219 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-9e9bf16b-664e-4305-b7ff-6d082c5eaed9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:14.229550 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-9e9bf16b-664e-4305-b7ff-6d082c5eaed9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:14.240253 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9e9bf16b-664e-4305-b7ff-6d082c5eaed9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:14.241102 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9e9bf16b-664e-4305-b7ff-6d082c5eaed9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:14.242155 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9e9bf16b-664e-4305-b7ff-6d082c5eaed9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:14.243065 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9e9bf16b-664e-4305-b7ff-6d082c5eaed9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:14.422571 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0b2771e7-64e3-4f58-846a-1df7a46cca07 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:14.423968 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0b2771e7-64e3-4f58-846a-1df7a46cca07 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:14.437684 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0b2771e7-64e3-4f58-846a-1df7a46cca07 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:14.443639 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0b2771e7-64e3-4f58-846a-1df7a46cca07 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:14.446181 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0b2771e7-64e3-4f58-846a-1df7a46cca07 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:14.447256 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0b2771e7-64e3-4f58-846a-1df7a46cca07 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:14.518867 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-9e9bf16b-664e-4305-b7ff-6d082c5eaed9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:14.531207 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-9e9bf16b-664e-4305-b7ff-6d082c5eaed9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1321 microversion: 2.1 time: 0.307070 Apr 08 11:15:14.531811 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 74/141] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:14 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1321 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:14.648160 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [req-f1295d04-de21-4242-8e90-1261441af461 req-d8a81d8d-9cfe-4395-8969-f2b614f1dc2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eff1b1a4-3738-43db-86ce-a17e2f08ffc0", "tag": "e41cba02-8f69-4396-ac0c-333ff20bdcbe"}]} {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:15:14.670201 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-f1295d04-de21-4242-8e90-1261441af461 req-d8a81d8d-9cfe-4395-8969-f2b614f1dc2d service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:14.670652 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-f1295d04-de21-4242-8e90-1261441af461 req-d8a81d8d-9cfe-4395-8969-f2b614f1dc2d service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:14.708511 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.compute.server_external_events [req-f1295d04-de21-4242-8e90-1261441af461 req-d8a81d8d-9cfe-4395-8969-f2b614f1dc2d service nova] Creating event network-changed:e41cba02-8f69-4396-ac0c-333ff20bdcbe for instance eff1b1a4-3738-43db-86ce-a17e2f08ffc0 on hv-cinder-83607 Apr 08 11:15:14.716305 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [req-f1295d04-de21-4242-8e90-1261441af461 req-d8a81d8d-9cfe-4395-8969-f2b614f1dc2d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074208 Apr 08 11:15:14.717077 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 75/142] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:15:14.735138 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-41d75d20-ee1c-4659-8ab1-fea0f397235a tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:14.737717 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-41d75d20-ee1c-4659-8ab1-fea0f397235a tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:14.749155 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-41d75d20-ee1c-4659-8ab1-fea0f397235a tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:14.750354 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-41d75d20-ee1c-4659-8ab1-fea0f397235a tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:14.755178 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-41d75d20-ee1c-4659-8ab1-fea0f397235a tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:14.755802 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-41d75d20-ee1c-4659-8ab1-fea0f397235a tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:14.955193 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0b2771e7-64e3-4f58-846a-1df7a46cca07 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:14.967796 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0b2771e7-64e3-4f58-846a-1df7a46cca07 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1363 microversion: 2.1 time: 0.548957 Apr 08 11:15:14.978570 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 68/143] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:14 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1363 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:15:14.990148 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-314e61bc-ead2-4f3d-87ef-a6a4558ca3e4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:14.990148 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-314e61bc-ead2-4f3d-87ef-a6a4558ca3e4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:14.995184 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-314e61bc-ead2-4f3d-87ef-a6a4558ca3e4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:14.995785 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-314e61bc-ead2-4f3d-87ef-a6a4558ca3e4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:14.998050 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-314e61bc-ead2-4f3d-87ef-a6a4558ca3e4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:14.998050 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-314e61bc-ead2-4f3d-87ef-a6a4558ca3e4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:15.138802 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-41d75d20-ee1c-4659-8ab1-fea0f397235a tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44deb9de4511458ba769ad2b8b26651c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a05f833c354a00a03d62f49c9e3402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:15.146629 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-41d75d20-ee1c-4659-8ab1-fea0f397235a tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 200 len: 1314 microversion: 2.1 time: 0.425503 Apr 08 11:15:15.147230 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 76/144] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:14 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 1314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:15.157585 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [req-4dee8f4c-bafd-4c7a-8586-8ca0e39c88d5 req-ea54baa0-b0a2-4798-beec-405aba225da4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b429d21-2abe-46ac-9148-962da31e1c3d", "name": "network-vif-plugged", "status": "completed", "tag": "288e9577-3c88-4dea-b291-aa1cf2450316"}]} {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:15:15.177133 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-4dee8f4c-bafd-4c7a-8586-8ca0e39c88d5 req-ea54baa0-b0a2-4798-beec-405aba225da4 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:15.177502 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-4dee8f4c-bafd-4c7a-8586-8ca0e39c88d5 req-ea54baa0-b0a2-4798-beec-405aba225da4 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:15.192692 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.compute.server_external_events [req-4dee8f4c-bafd-4c7a-8586-8ca0e39c88d5 req-ea54baa0-b0a2-4798-beec-405aba225da4 service nova] Creating event network-vif-plugged:288e9577-3c88-4dea-b291-aa1cf2450316 for instance 6b429d21-2abe-46ac-9148-962da31e1c3d on hv-cinder-83607 Apr 08 11:15:15.199419 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [req-4dee8f4c-bafd-4c7a-8586-8ca0e39c88d5 req-ea54baa0-b0a2-4798-beec-405aba225da4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047400 Apr 08 11:15:15.202764 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 77/145] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:15:15.266933 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-314e61bc-ead2-4f3d-87ef-a6a4558ca3e4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:15.280763 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-314e61bc-ead2-4f3d-87ef-a6a4558ca3e4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:15.284995 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-314e61bc-ead2-4f3d-87ef-a6a4558ca3e4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:15.286754 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-314e61bc-ead2-4f3d-87ef-a6a4558ca3e4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1407 microversion: 2.20 time: 0.304768 Apr 08 11:15:15.290902 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 69/146] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:15:14 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1407 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:15:15.310999 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [req-09496865-787e-4c2b-81e6-575ba1af7bdf req-82fe272f-9009-4193-b420-1c62c9b9ab56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "594ceb52-9d1f-494f-818d-eb66144bc49d", "tag": "0095761d-6242-494c-b486-fc86278e0746"}]} {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:15:15.326223 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-09496865-787e-4c2b-81e6-575ba1af7bdf req-82fe272f-9009-4193-b420-1c62c9b9ab56 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:15.326963 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-09496865-787e-4c2b-81e6-575ba1af7bdf req-82fe272f-9009-4193-b420-1c62c9b9ab56 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:15.342504 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.compute.server_external_events [req-09496865-787e-4c2b-81e6-575ba1af7bdf req-82fe272f-9009-4193-b420-1c62c9b9ab56 service nova] Creating event network-changed:0095761d-6242-494c-b486-fc86278e0746 for instance 594ceb52-9d1f-494f-818d-eb66144bc49d on hv-cinder-83607 Apr 08 11:15:15.349735 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [req-09496865-787e-4c2b-81e6-575ba1af7bdf req-82fe272f-9009-4193-b420-1c62c9b9ab56 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043132 Apr 08 11:15:15.351224 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 78/147] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:15:15.547912 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bbba8353-1830-4d26-b633-ab8cae0eb5b2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:15.553551 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-bbba8353-1830-4d26-b633-ab8cae0eb5b2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:15.554845 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bbba8353-1830-4d26-b633-ab8cae0eb5b2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:15.555299 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bbba8353-1830-4d26-b633-ab8cae0eb5b2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:15.556091 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bbba8353-1830-4d26-b633-ab8cae0eb5b2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:15.556530 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bbba8353-1830-4d26-b633-ab8cae0eb5b2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:15.760826 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-bbba8353-1830-4d26-b633-ab8cae0eb5b2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:15.769647 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-bbba8353-1830-4d26-b633-ab8cae0eb5b2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1321 microversion: 2.1 time: 0.225549 Apr 08 11:15:15.773708 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 70/148] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:15 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:15:15.987399 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-9e51e00f-07bc-4fc4-a994-ec8828fc878e tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:15.988453 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-9e51e00f-07bc-4fc4-a994-ec8828fc878e tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:15.996692 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9e51e00f-07bc-4fc4-a994-ec8828fc878e tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:15.997331 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9e51e00f-07bc-4fc4-a994-ec8828fc878e tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:15.998287 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9e51e00f-07bc-4fc4-a994-ec8828fc878e tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:15.999090 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9e51e00f-07bc-4fc4-a994-ec8828fc878e tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:16.170889 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-207db3e3-a95c-41f1-b8ae-1e7989b75cd9 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:16.171611 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-207db3e3-a95c-41f1-b8ae-1e7989b75cd9 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:16.184073 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-207db3e3-a95c-41f1-b8ae-1e7989b75cd9 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:16.185022 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-207db3e3-a95c-41f1-b8ae-1e7989b75cd9 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:16.187050 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-207db3e3-a95c-41f1-b8ae-1e7989b75cd9 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:16.187825 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-207db3e3-a95c-41f1-b8ae-1e7989b75cd9 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:16.271542 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-9e51e00f-07bc-4fc4-a994-ec8828fc878e tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:16.283311 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-9e51e00f-07bc-4fc4-a994-ec8828fc878e tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1363 microversion: 2.1 time: 0.300438 Apr 08 11:15:16.284318 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 79/149] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:15 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1363 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:16.307689 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-c1e87f8a-0404-4833-9d15-caa80349f30f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:16.308663 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-c1e87f8a-0404-4833-9d15-caa80349f30f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:16.315400 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c1e87f8a-0404-4833-9d15-caa80349f30f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:16.319321 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c1e87f8a-0404-4833-9d15-caa80349f30f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:16.320157 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c1e87f8a-0404-4833-9d15-caa80349f30f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:16.320602 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c1e87f8a-0404-4833-9d15-caa80349f30f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:16.448046 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-207db3e3-a95c-41f1-b8ae-1e7989b75cd9 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44deb9de4511458ba769ad2b8b26651c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a05f833c354a00a03d62f49c9e3402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:16.456680 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-207db3e3-a95c-41f1-b8ae-1e7989b75cd9 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 200 len: 1501 microversion: 2.1 time: 0.290930 Apr 08 11:15:16.457863 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 71/150] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:16 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 1501 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:15:16.630394 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-c1e87f8a-0404-4833-9d15-caa80349f30f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:16.656060 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-c1e87f8a-0404-4833-9d15-caa80349f30f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:16.658861 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-c1e87f8a-0404-4833-9d15-caa80349f30f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:16.660552 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-c1e87f8a-0404-4833-9d15-caa80349f30f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1407 microversion: 2.20 time: 0.356641 Apr 08 11:15:16.661949 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 80/151] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:15:16 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1407 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:15:16.800488 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5845fc77-606f-4011-b0fa-efda279781bd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:16.809254 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5845fc77-606f-4011-b0fa-efda279781bd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:16.814461 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5845fc77-606f-4011-b0fa-efda279781bd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:16.817213 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5845fc77-606f-4011-b0fa-efda279781bd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:16.820054 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5845fc77-606f-4011-b0fa-efda279781bd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:16.826597 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5845fc77-606f-4011-b0fa-efda279781bd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:17.081278 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5845fc77-606f-4011-b0fa-efda279781bd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:17.091264 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5845fc77-606f-4011-b0fa-efda279781bd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1321 microversion: 2.1 time: 0.296205 Apr 08 11:15:17.101431 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 72/152] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:16 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1321 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:17.300171 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-5b6e2e5c-f036-4367-8bb4-ca590a6836c6 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:17.300790 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-5b6e2e5c-f036-4367-8bb4-ca590a6836c6 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:17.306866 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5b6e2e5c-f036-4367-8bb4-ca590a6836c6 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:17.307566 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5b6e2e5c-f036-4367-8bb4-ca590a6836c6 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:17.309166 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5b6e2e5c-f036-4367-8bb4-ca590a6836c6 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:17.309637 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5b6e2e5c-f036-4367-8bb4-ca590a6836c6 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:17.616981 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-5b6e2e5c-f036-4367-8bb4-ca590a6836c6 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:17.633263 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-5b6e2e5c-f036-4367-8bb4-ca590a6836c6 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1363 microversion: 2.1 time: 0.336547 Apr 08 11:15:17.634615 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 81/153] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:17 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1363 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:17.694810 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-03a3da63-859e-4b19-9d1d-ab3bebb3c3a0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:17.695686 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-03a3da63-859e-4b19-9d1d-ab3bebb3c3a0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:17.703194 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-03a3da63-859e-4b19-9d1d-ab3bebb3c3a0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:17.703900 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-03a3da63-859e-4b19-9d1d-ab3bebb3c3a0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:17.705029 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-03a3da63-859e-4b19-9d1d-ab3bebb3c3a0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:17.705630 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-03a3da63-859e-4b19-9d1d-ab3bebb3c3a0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:17.866961 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-03a3da63-859e-4b19-9d1d-ab3bebb3c3a0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:17.885428 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-03a3da63-859e-4b19-9d1d-ab3bebb3c3a0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:17.888816 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-03a3da63-859e-4b19-9d1d-ab3bebb3c3a0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:17.890908 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-03a3da63-859e-4b19-9d1d-ab3bebb3c3a0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1407 microversion: 2.20 time: 0.199911 Apr 08 11:15:17.892132 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 73/154] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:15:17 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:15:18.110477 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-cd8a8e54-89cf-4822-abf5-c9ed83efa435 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:18.111619 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-cd8a8e54-89cf-4822-abf5-c9ed83efa435 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:18.122132 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cd8a8e54-89cf-4822-abf5-c9ed83efa435 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:18.122906 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cd8a8e54-89cf-4822-abf5-c9ed83efa435 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:18.124589 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cd8a8e54-89cf-4822-abf5-c9ed83efa435 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:18.125377 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cd8a8e54-89cf-4822-abf5-c9ed83efa435 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:18.314627 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-cd8a8e54-89cf-4822-abf5-c9ed83efa435 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:18.323905 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-cd8a8e54-89cf-4822-abf5-c9ed83efa435 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1321 microversion: 2.1 time: 0.218769 Apr 08 11:15:18.325071 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 82/155] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:18 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:18.662448 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4f1773b8-dc46-4850-8c71-dd636fab1cc0 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:18.663257 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4f1773b8-dc46-4850-8c71-dd636fab1cc0 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:18.676989 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4f1773b8-dc46-4850-8c71-dd636fab1cc0 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:18.682162 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4f1773b8-dc46-4850-8c71-dd636fab1cc0 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:18.682162 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4f1773b8-dc46-4850-8c71-dd636fab1cc0 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:18.682162 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4f1773b8-dc46-4850-8c71-dd636fab1cc0 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:18.869275 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4f1773b8-dc46-4850-8c71-dd636fab1cc0 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:18.877152 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4f1773b8-dc46-4850-8c71-dd636fab1cc0 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1363 microversion: 2.1 time: 0.225662 Apr 08 11:15:18.877740 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 74/156] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:18 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:18.909157 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-b485d74d-3a7e-4f25-8879-01df3d01eed3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:18.909813 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-b485d74d-3a7e-4f25-8879-01df3d01eed3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:18.915912 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b485d74d-3a7e-4f25-8879-01df3d01eed3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:18.916372 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b485d74d-3a7e-4f25-8879-01df3d01eed3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:18.917163 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b485d74d-3a7e-4f25-8879-01df3d01eed3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:18.917609 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b485d74d-3a7e-4f25-8879-01df3d01eed3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:19.077244 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b485d74d-3a7e-4f25-8879-01df3d01eed3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:19.085488 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b485d74d-3a7e-4f25-8879-01df3d01eed3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:19.087056 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b485d74d-3a7e-4f25-8879-01df3d01eed3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:19.088185 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-b485d74d-3a7e-4f25-8879-01df3d01eed3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1407 microversion: 2.20 time: 0.182982 Apr 08 11:15:19.088745 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 83/157] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:15:18 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:15:19.347160 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-75c775b1-01b5-4361-8181-92e017a9ae66 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:19.348003 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-75c775b1-01b5-4361-8181-92e017a9ae66 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:19.355576 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-75c775b1-01b5-4361-8181-92e017a9ae66 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:19.356157 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-75c775b1-01b5-4361-8181-92e017a9ae66 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:19.357060 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-75c775b1-01b5-4361-8181-92e017a9ae66 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:19.357826 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-75c775b1-01b5-4361-8181-92e017a9ae66 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:19.515893 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-75c775b1-01b5-4361-8181-92e017a9ae66 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:19.526265 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-75c775b1-01b5-4361-8181-92e017a9ae66 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1321 microversion: 2.1 time: 0.187271 Apr 08 11:15:19.526945 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 75/158] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:19 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:19.658484 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-fc746245-a418-4577-812e-898da3760366 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba785c13-b89d-41ad-8a2c-d2e8624111a8"}} {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:15:19.659646 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-fc746245-a418-4577-812e-898da3760366 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:19.666281 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fc746245-a418-4577-812e-898da3760366 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:19.666792 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fc746245-a418-4577-812e-898da3760366 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:19.667593 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fc746245-a418-4577-812e-898da3760366 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:19.668037 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fc746245-a418-4577-812e-898da3760366 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:19.894641 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5cc09dbd-d8f7-47c4-887b-a07d389d1ae8 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:19.895256 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5cc09dbd-d8f7-47c4-887b-a07d389d1ae8 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:19.901372 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5cc09dbd-d8f7-47c4-887b-a07d389d1ae8 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:19.901853 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5cc09dbd-d8f7-47c4-887b-a07d389d1ae8 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:19.903183 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5cc09dbd-d8f7-47c4-887b-a07d389d1ae8 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:19.903625 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5cc09dbd-d8f7-47c4-887b-a07d389d1ae8 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:20.068678 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5cc09dbd-d8f7-47c4-887b-a07d389d1ae8 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:20.079364 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5cc09dbd-d8f7-47c4-887b-a07d389d1ae8 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1363 microversion: 2.1 time: 0.188444 Apr 08 11:15:20.080169 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 76/159] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:19 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:15:20.107665 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-64e187bb-e255-4f7e-b452-73e32fcbb6ea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:20.108263 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-64e187bb-e255-4f7e-b452-73e32fcbb6ea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:20.114702 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-64e187bb-e255-4f7e-b452-73e32fcbb6ea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:20.115155 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-64e187bb-e255-4f7e-b452-73e32fcbb6ea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:20.116023 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-64e187bb-e255-4f7e-b452-73e32fcbb6ea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:20.116520 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-64e187bb-e255-4f7e-b452-73e32fcbb6ea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:20.263621 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-64e187bb-e255-4f7e-b452-73e32fcbb6ea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:20.271469 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-64e187bb-e255-4f7e-b452-73e32fcbb6ea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:20.273597 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-64e187bb-e255-4f7e-b452-73e32fcbb6ea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:20.274753 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-64e187bb-e255-4f7e-b452-73e32fcbb6ea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1407 microversion: 2.20 time: 0.171327 Apr 08 11:15:20.275314 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 77/160] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:15:20 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:15:20.543921 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-55227810-f674-4adb-8f01-f613dee8f5d3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:20.544546 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-55227810-f674-4adb-8f01-f613dee8f5d3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:20.551151 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-55227810-f674-4adb-8f01-f613dee8f5d3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:20.551151 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-55227810-f674-4adb-8f01-f613dee8f5d3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:20.552021 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-55227810-f674-4adb-8f01-f613dee8f5d3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:20.552717 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-55227810-f674-4adb-8f01-f613dee8f5d3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:20.736486 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-55227810-f674-4adb-8f01-f613dee8f5d3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:20.744433 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-55227810-f674-4adb-8f01-f613dee8f5d3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1321 microversion: 2.1 time: 0.204559 Apr 08 11:15:20.745091 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 78/161] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:20 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:15:21.099039 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6e7b778c-4943-4195-8ad3-16a937256384 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:21.099039 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6e7b778c-4943-4195-8ad3-16a937256384 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:21.107965 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6e7b778c-4943-4195-8ad3-16a937256384 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:21.108411 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6e7b778c-4943-4195-8ad3-16a937256384 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:21.109206 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6e7b778c-4943-4195-8ad3-16a937256384 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:21.109982 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6e7b778c-4943-4195-8ad3-16a937256384 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:21.310829 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6e7b778c-4943-4195-8ad3-16a937256384 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:21.318353 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6e7b778c-4943-4195-8ad3-16a937256384 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1363 microversion: 2.1 time: 0.225224 Apr 08 11:15:21.318942 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 79/162] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:21 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:21.326924 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-46497112-4873-4651-9b3c-c527ea08e91a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:21.329696 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-46497112-4873-4651-9b3c-c527ea08e91a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:21.336049 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-46497112-4873-4651-9b3c-c527ea08e91a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:21.336504 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-46497112-4873-4651-9b3c-c527ea08e91a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:21.339136 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-46497112-4873-4651-9b3c-c527ea08e91a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:21.339136 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-46497112-4873-4651-9b3c-c527ea08e91a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:21.596468 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-46497112-4873-4651-9b3c-c527ea08e91a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:21.605934 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-46497112-4873-4651-9b3c-c527ea08e91a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:21.607454 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-46497112-4873-4651-9b3c-c527ea08e91a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:21.608560 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-46497112-4873-4651-9b3c-c527ea08e91a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1407 microversion: 2.20 time: 0.285459 Apr 08 11:15:21.609119 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 80/163] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:15:21 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1407 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:15:21.763183 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5502da84-a68a-4f54-b380-07197aa53a9a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:21.763981 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5502da84-a68a-4f54-b380-07197aa53a9a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:21.770209 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5502da84-a68a-4f54-b380-07197aa53a9a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:21.770663 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5502da84-a68a-4f54-b380-07197aa53a9a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:21.771456 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5502da84-a68a-4f54-b380-07197aa53a9a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:21.771892 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5502da84-a68a-4f54-b380-07197aa53a9a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:21.912858 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5502da84-a68a-4f54-b380-07197aa53a9a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:21.920464 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5502da84-a68a-4f54-b380-07197aa53a9a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1514 microversion: 2.1 time: 0.161957 Apr 08 11:15:21.925707 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 81/164] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:21 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:15:21.941271 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4e97c295-d6d5-49ee-8cc5-578b15465476 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:15:21.942334 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4e97c295-d6d5-49ee-8cc5-578b15465476 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:21.948718 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4e97c295-d6d5-49ee-8cc5-578b15465476 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:21.949221 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4e97c295-d6d5-49ee-8cc5-578b15465476 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:21.950537 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4e97c295-d6d5-49ee-8cc5-578b15465476 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:21.950971 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4e97c295-d6d5-49ee-8cc5-578b15465476 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:22.014671 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-4e97c295-d6d5-49ee-8cc5-578b15465476 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lazy-loading 'flavor' on Instance uuid 6b429d21-2abe-46ac-9148-962da31e1c3d {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 11:15:22.193010 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-fc746245-a418-4577-812e-898da3760366 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "POST /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.538318 Apr 08 11:15:22.194795 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 84/165] 10.222.0.46 () {60 vars in 1322 bytes} [Fri Apr 8 11:15:19 2022] POST /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327/os-volume_attachments => generated 194 bytes in 2540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:15:22.336565 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-c512b57b-3f0a-479c-92f8-41428c59de0d tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:22.337160 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-c512b57b-3f0a-479c-92f8-41428c59de0d tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:22.343677 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c512b57b-3f0a-479c-92f8-41428c59de0d tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:22.344135 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c512b57b-3f0a-479c-92f8-41428c59de0d tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:22.344932 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c512b57b-3f0a-479c-92f8-41428c59de0d tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:22.345376 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c512b57b-3f0a-479c-92f8-41428c59de0d tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:22.502584 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-c512b57b-3f0a-479c-92f8-41428c59de0d tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:22.510208 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-c512b57b-3f0a-479c-92f8-41428c59de0d tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1363 microversion: 2.1 time: 0.178143 Apr 08 11:15:22.510803 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 85/166] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:22 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:15:22.639136 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-4406a3dd-8b69-4869-a6e5-9371bf88cc26 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:22.639136 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-4406a3dd-8b69-4869-a6e5-9371bf88cc26 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:22.639136 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4406a3dd-8b69-4869-a6e5-9371bf88cc26 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:22.639136 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4406a3dd-8b69-4869-a6e5-9371bf88cc26 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:22.639430 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4406a3dd-8b69-4869-a6e5-9371bf88cc26 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:22.639430 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4406a3dd-8b69-4869-a6e5-9371bf88cc26 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:23.214252 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-4406a3dd-8b69-4869-a6e5-9371bf88cc26 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:23.214252 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-4406a3dd-8b69-4869-a6e5-9371bf88cc26 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:23.217863 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-4406a3dd-8b69-4869-a6e5-9371bf88cc26 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:23.217863 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-4406a3dd-8b69-4869-a6e5-9371bf88cc26 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1407 microversion: 2.20 time: 0.173638 Apr 08 11:15:23.217863 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 86/167] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:15:22 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:15:23.220267 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4e97c295-d6d5-49ee-8cc5-578b15465476 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "POST /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d/action" status: 200 len: 32 microversion: 2.1 time: 0.931764 Apr 08 11:15:23.220267 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 82/168] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Apr 8 11:15:21 2022] POST /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d/action => generated 32 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 08 11:15:23.221217 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-96230478-f624-4c3b-b06f-1058255476c4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:23.221217 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-96230478-f624-4c3b-b06f-1058255476c4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:23.221217 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-96230478-f624-4c3b-b06f-1058255476c4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:23.221217 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-96230478-f624-4c3b-b06f-1058255476c4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:23.222150 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-96230478-f624-4c3b-b06f-1058255476c4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:23.222150 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-96230478-f624-4c3b-b06f-1058255476c4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:23.222150 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-96230478-f624-4c3b-b06f-1058255476c4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:23.222799 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-96230478-f624-4c3b-b06f-1058255476c4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1520 microversion: 2.1 time: 0.162773 Apr 08 11:15:23.222799 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 87/169] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:22 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:23.528808 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-23d7284b-8ca5-4fa9-a3c5-d3dba698caab tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:23.529891 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-23d7284b-8ca5-4fa9-a3c5-d3dba698caab tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:23.536256 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-23d7284b-8ca5-4fa9-a3c5-d3dba698caab tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:23.536715 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-23d7284b-8ca5-4fa9-a3c5-d3dba698caab tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:23.537490 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-23d7284b-8ca5-4fa9-a3c5-d3dba698caab tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:23.538119 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-23d7284b-8ca5-4fa9-a3c5-d3dba698caab tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:23.705891 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-23d7284b-8ca5-4fa9-a3c5-d3dba698caab tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:23.714628 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-23d7284b-8ca5-4fa9-a3c5-d3dba698caab tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1363 microversion: 2.1 time: 0.190297 Apr 08 11:15:23.715960 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 83/170] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:23 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:23.814601 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a197be33-7b85-41a6-947a-820010b89116 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:23.815207 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a197be33-7b85-41a6-947a-820010b89116 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:23.821675 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a197be33-7b85-41a6-947a-820010b89116 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:23.822155 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a197be33-7b85-41a6-947a-820010b89116 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:23.823223 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a197be33-7b85-41a6-947a-820010b89116 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:23.823898 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a197be33-7b85-41a6-947a-820010b89116 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:24.002625 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a197be33-7b85-41a6-947a-820010b89116 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:24.011182 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a197be33-7b85-41a6-947a-820010b89116 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:24.013998 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a197be33-7b85-41a6-947a-820010b89116 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:24.023558 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a197be33-7b85-41a6-947a-820010b89116 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1407 microversion: 2.20 time: 0.212749 Apr 08 11:15:24.030155 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 88/171] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:15:23 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:15:24.057277 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8a6def5a-70e3-40e7-91fb-3f3243ef77ae tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:24.057940 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8a6def5a-70e3-40e7-91fb-3f3243ef77ae tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:24.063919 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8a6def5a-70e3-40e7-91fb-3f3243ef77ae tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:24.064369 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8a6def5a-70e3-40e7-91fb-3f3243ef77ae tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:24.078395 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8a6def5a-70e3-40e7-91fb-3f3243ef77ae tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:24.078395 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8a6def5a-70e3-40e7-91fb-3f3243ef77ae tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:24.216973 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8a6def5a-70e3-40e7-91fb-3f3243ef77ae tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:24.220928 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8a6def5a-70e3-40e7-91fb-3f3243ef77ae tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1520 microversion: 2.1 time: 0.168245 Apr 08 11:15:24.221567 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 84/172] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:24 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:24.731824 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e66a9517-9c1c-44db-b275-ce8a5a0ca554 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:24.732590 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e66a9517-9c1c-44db-b275-ce8a5a0ca554 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:24.739504 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e66a9517-9c1c-44db-b275-ce8a5a0ca554 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:24.740196 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e66a9517-9c1c-44db-b275-ce8a5a0ca554 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:24.741165 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e66a9517-9c1c-44db-b275-ce8a5a0ca554 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:24.741608 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e66a9517-9c1c-44db-b275-ce8a5a0ca554 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:24.900220 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e66a9517-9c1c-44db-b275-ce8a5a0ca554 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:24.900220 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e66a9517-9c1c-44db-b275-ce8a5a0ca554 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1363 microversion: 2.1 time: 0.168681 Apr 08 11:15:24.900220 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 89/173] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:24 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:25.048253 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c38a927b-401d-4f00-9ed8-7d5ef4421521 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:25.048863 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c38a927b-401d-4f00-9ed8-7d5ef4421521 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:25.054881 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c38a927b-401d-4f00-9ed8-7d5ef4421521 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:25.055335 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c38a927b-401d-4f00-9ed8-7d5ef4421521 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:25.056144 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c38a927b-401d-4f00-9ed8-7d5ef4421521 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:25.056533 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c38a927b-401d-4f00-9ed8-7d5ef4421521 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:25.193983 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c38a927b-401d-4f00-9ed8-7d5ef4421521 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:25.201798 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c38a927b-401d-4f00-9ed8-7d5ef4421521 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:25.203305 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c38a927b-401d-4f00-9ed8-7d5ef4421521 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:25.204404 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c38a927b-401d-4f00-9ed8-7d5ef4421521 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1407 microversion: 2.20 time: 0.160129 Apr 08 11:15:25.204970 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 85/174] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:15:25 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:15:25.237963 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-8c8368ec-79f2-454f-97ef-ea64a518860b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:25.238870 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-8c8368ec-79f2-454f-97ef-ea64a518860b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:25.244945 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8c8368ec-79f2-454f-97ef-ea64a518860b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:25.254171 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8c8368ec-79f2-454f-97ef-ea64a518860b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:25.254171 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8c8368ec-79f2-454f-97ef-ea64a518860b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:25.254171 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8c8368ec-79f2-454f-97ef-ea64a518860b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:25.393256 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-8c8368ec-79f2-454f-97ef-ea64a518860b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:25.400689 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-8c8368ec-79f2-454f-97ef-ea64a518860b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1520 microversion: 2.1 time: 0.166817 Apr 08 11:15:25.401254 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 90/175] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:25 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:25.914165 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-54e5b33c-4e45-41b2-9ccf-e79ef75b9c78 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:25.914874 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-54e5b33c-4e45-41b2-9ccf-e79ef75b9c78 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:25.920854 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-54e5b33c-4e45-41b2-9ccf-e79ef75b9c78 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:25.921490 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-54e5b33c-4e45-41b2-9ccf-e79ef75b9c78 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:25.922301 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-54e5b33c-4e45-41b2-9ccf-e79ef75b9c78 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:25.922741 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-54e5b33c-4e45-41b2-9ccf-e79ef75b9c78 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:26.060688 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-54e5b33c-4e45-41b2-9ccf-e79ef75b9c78 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:26.069052 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-54e5b33c-4e45-41b2-9ccf-e79ef75b9c78 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1363 microversion: 2.1 time: 0.158124 Apr 08 11:15:26.069052 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 86/176] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:25 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:26.222140 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-d316e516-cfba-46de-aac5-52b17c564d1b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:26.222759 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-d316e516-cfba-46de-aac5-52b17c564d1b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:26.229795 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d316e516-cfba-46de-aac5-52b17c564d1b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:26.230258 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d316e516-cfba-46de-aac5-52b17c564d1b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:26.231653 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d316e516-cfba-46de-aac5-52b17c564d1b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:26.232018 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d316e516-cfba-46de-aac5-52b17c564d1b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:26.400555 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d316e516-cfba-46de-aac5-52b17c564d1b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:26.409208 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d316e516-cfba-46de-aac5-52b17c564d1b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:26.411085 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d316e516-cfba-46de-aac5-52b17c564d1b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:26.412073 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-d316e516-cfba-46de-aac5-52b17c564d1b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1407 microversion: 2.20 time: 0.194129 Apr 08 11:15:26.412792 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 91/177] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:15:26 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:15:26.427408 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1cf716f8-c02a-4c1c-8b0f-11ed89f2c315 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:26.427661 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1cf716f8-c02a-4c1c-8b0f-11ed89f2c315 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:26.433733 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1cf716f8-c02a-4c1c-8b0f-11ed89f2c315 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:26.434241 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1cf716f8-c02a-4c1c-8b0f-11ed89f2c315 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:26.435175 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1cf716f8-c02a-4c1c-8b0f-11ed89f2c315 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:26.435618 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1cf716f8-c02a-4c1c-8b0f-11ed89f2c315 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:26.590725 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1cf716f8-c02a-4c1c-8b0f-11ed89f2c315 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:26.598951 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1cf716f8-c02a-4c1c-8b0f-11ed89f2c315 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1520 microversion: 2.1 time: 0.176517 Apr 08 11:15:26.599540 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 87/178] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:26 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:27.085588 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-95765ef8-fa10-4aca-9cd9-3777661e94b3 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:27.086617 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-95765ef8-fa10-4aca-9cd9-3777661e94b3 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:27.093642 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-95765ef8-fa10-4aca-9cd9-3777661e94b3 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:27.094137 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-95765ef8-fa10-4aca-9cd9-3777661e94b3 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:27.099102 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-95765ef8-fa10-4aca-9cd9-3777661e94b3 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:27.099102 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-95765ef8-fa10-4aca-9cd9-3777661e94b3 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:27.234262 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-95765ef8-fa10-4aca-9cd9-3777661e94b3 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:27.241880 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-95765ef8-fa10-4aca-9cd9-3777661e94b3 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1363 microversion: 2.1 time: 0.160975 Apr 08 11:15:27.242447 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 92/179] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:27 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:27.430950 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-cb378903-6a79-421a-ae5b-b3822a44a452 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:27.431825 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-cb378903-6a79-421a-ae5b-b3822a44a452 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:27.438848 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cb378903-6a79-421a-ae5b-b3822a44a452 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:27.439307 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cb378903-6a79-421a-ae5b-b3822a44a452 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:27.440096 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cb378903-6a79-421a-ae5b-b3822a44a452 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:27.440529 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cb378903-6a79-421a-ae5b-b3822a44a452 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:27.624359 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-46b75f2c-fdb2-434c-8b8d-851e1737b296 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:27.626414 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-46b75f2c-fdb2-434c-8b8d-851e1737b296 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:27.634435 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-46b75f2c-fdb2-434c-8b8d-851e1737b296 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:27.635763 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-46b75f2c-fdb2-434c-8b8d-851e1737b296 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:27.637135 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-46b75f2c-fdb2-434c-8b8d-851e1737b296 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:27.637932 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-46b75f2c-fdb2-434c-8b8d-851e1737b296 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:27.881706 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-cb378903-6a79-421a-ae5b-b3822a44a452 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:27.890644 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-cb378903-6a79-421a-ae5b-b3822a44a452 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:27.892182 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-cb378903-6a79-421a-ae5b-b3822a44a452 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:27.893307 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-cb378903-6a79-421a-ae5b-b3822a44a452 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1407 microversion: 2.20 time: 0.466444 Apr 08 11:15:27.895475 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 88/180] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:15:27 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1407 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:15:27.907620 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-46b75f2c-fdb2-434c-8b8d-851e1737b296 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:27.917912 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-46b75f2c-fdb2-434c-8b8d-851e1737b296 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1520 microversion: 2.1 time: 0.304551 Apr 08 11:15:27.919238 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 93/181] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:27 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1520 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:15:28.258709 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3f2f365a-3344-4c81-81e5-efa1f98736e4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:28.259335 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3f2f365a-3344-4c81-81e5-efa1f98736e4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:28.265819 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3f2f365a-3344-4c81-81e5-efa1f98736e4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:28.266270 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3f2f365a-3344-4c81-81e5-efa1f98736e4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:28.267032 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3f2f365a-3344-4c81-81e5-efa1f98736e4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:28.267452 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3f2f365a-3344-4c81-81e5-efa1f98736e4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:28.405178 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3f2f365a-3344-4c81-81e5-efa1f98736e4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:28.413087 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3f2f365a-3344-4c81-81e5-efa1f98736e4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1363 microversion: 2.1 time: 0.158136 Apr 08 11:15:28.413600 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 89/182] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:28 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:28.911447 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-83777bc9-2a17-4042-bf0f-b7a33faf49b4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:28.912058 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-83777bc9-2a17-4042-bf0f-b7a33faf49b4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:28.919023 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-83777bc9-2a17-4042-bf0f-b7a33faf49b4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:28.919474 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-83777bc9-2a17-4042-bf0f-b7a33faf49b4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:28.920284 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-83777bc9-2a17-4042-bf0f-b7a33faf49b4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:28.920768 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-83777bc9-2a17-4042-bf0f-b7a33faf49b4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:28.936753 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b84e7637-771e-4116-b073-3b5173a024d9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:28.937549 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b84e7637-771e-4116-b073-3b5173a024d9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:28.944190 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b84e7637-771e-4116-b073-3b5173a024d9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:28.944743 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b84e7637-771e-4116-b073-3b5173a024d9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:28.945803 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b84e7637-771e-4116-b073-3b5173a024d9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:28.946435 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b84e7637-771e-4116-b073-3b5173a024d9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:29.134777 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-83777bc9-2a17-4042-bf0f-b7a33faf49b4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:29.144358 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-83777bc9-2a17-4042-bf0f-b7a33faf49b4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:29.146655 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-83777bc9-2a17-4042-bf0f-b7a33faf49b4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:29.147950 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-83777bc9-2a17-4042-bf0f-b7a33faf49b4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1407 microversion: 2.20 time: 0.240328 Apr 08 11:15:29.148829 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 94/183] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:15:28 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:15:29.162715 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b84e7637-771e-4116-b073-3b5173a024d9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:29.171312 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b84e7637-771e-4116-b073-3b5173a024d9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1520 microversion: 2.1 time: 0.238532 Apr 08 11:15:29.175023 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 90/184] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:28 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:29.430056 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-dedd0fce-febc-495e-bce9-4906cce08057 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:29.430666 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-dedd0fce-febc-495e-bce9-4906cce08057 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:29.437248 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dedd0fce-febc-495e-bce9-4906cce08057 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:29.437692 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dedd0fce-febc-495e-bce9-4906cce08057 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:29.438487 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dedd0fce-febc-495e-bce9-4906cce08057 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:29.438922 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dedd0fce-febc-495e-bce9-4906cce08057 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:29.610648 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-dedd0fce-febc-495e-bce9-4906cce08057 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:29.618423 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-dedd0fce-febc-495e-bce9-4906cce08057 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1363 microversion: 2.1 time: 0.192210 Apr 08 11:15:29.619094 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 95/185] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:29 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1363 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:30.173454 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e250dc5d-4a6d-4153-8ae4-a75915be2110 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:30.174140 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e250dc5d-4a6d-4153-8ae4-a75915be2110 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:30.180219 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e250dc5d-4a6d-4153-8ae4-a75915be2110 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:30.180689 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e250dc5d-4a6d-4153-8ae4-a75915be2110 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:30.181469 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e250dc5d-4a6d-4153-8ae4-a75915be2110 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:30.181939 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e250dc5d-4a6d-4153-8ae4-a75915be2110 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:30.194447 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-46c9cd90-f394-4b5d-9282-06c627cbcd24 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:30.195486 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-46c9cd90-f394-4b5d-9282-06c627cbcd24 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:30.207006 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-46c9cd90-f394-4b5d-9282-06c627cbcd24 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:30.207793 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-46c9cd90-f394-4b5d-9282-06c627cbcd24 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:30.209196 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-46c9cd90-f394-4b5d-9282-06c627cbcd24 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:30.209998 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-46c9cd90-f394-4b5d-9282-06c627cbcd24 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:30.399205 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e250dc5d-4a6d-4153-8ae4-a75915be2110 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:30.403784 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-46c9cd90-f394-4b5d-9282-06c627cbcd24 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:30.411563 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e250dc5d-4a6d-4153-8ae4-a75915be2110 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:30.411951 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-46c9cd90-f394-4b5d-9282-06c627cbcd24 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1520 microversion: 2.1 time: 0.224500 Apr 08 11:15:30.412632 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 96/186] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:30 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:30.413097 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e250dc5d-4a6d-4153-8ae4-a75915be2110 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:30.414299 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e250dc5d-4a6d-4153-8ae4-a75915be2110 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1407 microversion: 2.20 time: 0.245037 Apr 08 11:15:30.414864 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 91/187] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:15:30 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:15:30.643533 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-9ab6c8c2-b740-4213-a7f5-0bb23c44583d tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:30.644163 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-9ab6c8c2-b740-4213-a7f5-0bb23c44583d tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:30.650642 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9ab6c8c2-b740-4213-a7f5-0bb23c44583d tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:30.651096 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9ab6c8c2-b740-4213-a7f5-0bb23c44583d tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:30.652111 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9ab6c8c2-b740-4213-a7f5-0bb23c44583d tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:30.653117 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9ab6c8c2-b740-4213-a7f5-0bb23c44583d tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:30.801988 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-9ab6c8c2-b740-4213-a7f5-0bb23c44583d tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:30.809544 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-9ab6c8c2-b740-4213-a7f5-0bb23c44583d tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1363 microversion: 2.1 time: 0.169968 Apr 08 11:15:30.810164 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 97/188] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:30 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:31.444274 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f724b9ff-f9fb-4cdc-a34d-5cf1d54bea48 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:31.444274 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f724b9ff-f9fb-4cdc-a34d-5cf1d54bea48 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:31.444274 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f724b9ff-f9fb-4cdc-a34d-5cf1d54bea48 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:31.445042 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f724b9ff-f9fb-4cdc-a34d-5cf1d54bea48 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:31.445501 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f724b9ff-f9fb-4cdc-a34d-5cf1d54bea48 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:31.446115 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f724b9ff-f9fb-4cdc-a34d-5cf1d54bea48 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:31.450180 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-6ae19df6-9403-42f2-804d-2c0e9cb51f68 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:31.450816 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-6ae19df6-9403-42f2-804d-2c0e9cb51f68 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:31.457071 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6ae19df6-9403-42f2-804d-2c0e9cb51f68 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:31.457516 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6ae19df6-9403-42f2-804d-2c0e9cb51f68 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:31.458413 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6ae19df6-9403-42f2-804d-2c0e9cb51f68 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:31.458939 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6ae19df6-9403-42f2-804d-2c0e9cb51f68 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:31.663986 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f724b9ff-f9fb-4cdc-a34d-5cf1d54bea48 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:31.669523 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6ae19df6-9403-42f2-804d-2c0e9cb51f68 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:31.672685 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f724b9ff-f9fb-4cdc-a34d-5cf1d54bea48 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1520 microversion: 2.1 time: 0.239926 Apr 08 11:15:31.673568 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 92/189] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:31 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1520 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:31.682652 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6ae19df6-9403-42f2-804d-2c0e9cb51f68 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:31.686087 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6ae19df6-9403-42f2-804d-2c0e9cb51f68 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:31.688217 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-6ae19df6-9403-42f2-804d-2c0e9cb51f68 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1407 microversion: 2.20 time: 0.243516 Apr 08 11:15:31.689304 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 98/190] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:15:31 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:15:31.826689 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9ec02848-553d-4b32-90c4-a8d74e29af9a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:31.827320 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9ec02848-553d-4b32-90c4-a8d74e29af9a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:31.833294 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9ec02848-553d-4b32-90c4-a8d74e29af9a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:31.833734 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9ec02848-553d-4b32-90c4-a8d74e29af9a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:31.834527 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9ec02848-553d-4b32-90c4-a8d74e29af9a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:31.834954 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9ec02848-553d-4b32-90c4-a8d74e29af9a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:31.968952 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9ec02848-553d-4b32-90c4-a8d74e29af9a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:31.976331 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9ec02848-553d-4b32-90c4-a8d74e29af9a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1363 microversion: 2.1 time: 0.153588 Apr 08 11:15:31.977030 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 93/191] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:31 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:32.694689 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-02eecae5-44e0-4ce5-8aca-5f287ad536cc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:32.695286 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-02eecae5-44e0-4ce5-8aca-5f287ad536cc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:32.702528 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-02eecae5-44e0-4ce5-8aca-5f287ad536cc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:32.702987 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-02eecae5-44e0-4ce5-8aca-5f287ad536cc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:32.703804 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-02eecae5-44e0-4ce5-8aca-5f287ad536cc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:32.704248 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-02eecae5-44e0-4ce5-8aca-5f287ad536cc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:32.706405 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0254b3db-01a3-4cab-befa-11aab2776dd6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:32.707274 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0254b3db-01a3-4cab-befa-11aab2776dd6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:32.713707 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0254b3db-01a3-4cab-befa-11aab2776dd6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:32.714217 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0254b3db-01a3-4cab-befa-11aab2776dd6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:32.715109 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0254b3db-01a3-4cab-befa-11aab2776dd6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:32.715592 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0254b3db-01a3-4cab-befa-11aab2776dd6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:32.913671 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-02eecae5-44e0-4ce5-8aca-5f287ad536cc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:32.921877 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-02eecae5-44e0-4ce5-8aca-5f287ad536cc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1520 microversion: 2.1 time: 0.230966 Apr 08 11:15:32.922766 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 99/192] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:32 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:32.928515 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [req-df890208-6c0a-4d9f-98aa-238efb7c1573 req-4ebef04d-f61b-4d5f-b7da-31175c3062ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "594ceb52-9d1f-494f-818d-eb66144bc49d", "name": "network-vif-plugged", "status": "completed", "tag": "0095761d-6242-494c-b486-fc86278e0746"}]} {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:15:32.929106 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0254b3db-01a3-4cab-befa-11aab2776dd6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:32.937964 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-df890208-6c0a-4d9f-98aa-238efb7c1573 req-4ebef04d-f61b-4d5f-b7da-31175c3062ea service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:32.938404 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-df890208-6c0a-4d9f-98aa-238efb7c1573 req-4ebef04d-f61b-4d5f-b7da-31175c3062ea service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:32.938515 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0254b3db-01a3-4cab-befa-11aab2776dd6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:32.941215 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0254b3db-01a3-4cab-befa-11aab2776dd6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:32.941461 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0254b3db-01a3-4cab-befa-11aab2776dd6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1407 microversion: 2.20 time: 0.238854 Apr 08 11:15:32.942340 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 94/193] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:15:32 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1407 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:15:32.965824 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.compute.server_external_events [req-df890208-6c0a-4d9f-98aa-238efb7c1573 req-4ebef04d-f61b-4d5f-b7da-31175c3062ea service nova] Creating event network-vif-plugged:0095761d-6242-494c-b486-fc86278e0746 for instance 594ceb52-9d1f-494f-818d-eb66144bc49d on hv-cinder-83607 Apr 08 11:15:32.965824 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [req-df890208-6c0a-4d9f-98aa-238efb7c1573 req-4ebef04d-f61b-4d5f-b7da-31175c3062ea service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034953 Apr 08 11:15:32.965824 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 100/194] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:15:32.992912 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-be5ea9ee-1ad1-4dac-902b-4a1771e8e365 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:32.993675 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-be5ea9ee-1ad1-4dac-902b-4a1771e8e365 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:33.000326 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-be5ea9ee-1ad1-4dac-902b-4a1771e8e365 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:33.000813 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-be5ea9ee-1ad1-4dac-902b-4a1771e8e365 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:33.001543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-be5ea9ee-1ad1-4dac-902b-4a1771e8e365 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:33.002048 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-be5ea9ee-1ad1-4dac-902b-4a1771e8e365 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:33.167800 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-be5ea9ee-1ad1-4dac-902b-4a1771e8e365 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:33.176557 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-be5ea9ee-1ad1-4dac-902b-4a1771e8e365 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1363 microversion: 2.1 time: 0.187305 Apr 08 11:15:33.184122 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 95/195] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:32 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:33.952325 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-0cc6b65d-90fd-48ed-bffe-e3d0344d8c2f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:33.952325 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-0cc6b65d-90fd-48ed-bffe-e3d0344d8c2f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:33.954663 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0cc6b65d-90fd-48ed-bffe-e3d0344d8c2f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:33.954663 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0cc6b65d-90fd-48ed-bffe-e3d0344d8c2f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:33.955475 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0cc6b65d-90fd-48ed-bffe-e3d0344d8c2f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:33.956284 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0cc6b65d-90fd-48ed-bffe-e3d0344d8c2f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:33.960551 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4b124e85-bf12-4526-92e4-867895c3712d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:33.962221 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4b124e85-bf12-4526-92e4-867895c3712d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:33.987968 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4b124e85-bf12-4526-92e4-867895c3712d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:33.988506 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4b124e85-bf12-4526-92e4-867895c3712d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:33.989349 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4b124e85-bf12-4526-92e4-867895c3712d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:33.989814 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4b124e85-bf12-4526-92e4-867895c3712d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:34.353457 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-0cc6b65d-90fd-48ed-bffe-e3d0344d8c2f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:34.365242 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-0cc6b65d-90fd-48ed-bffe-e3d0344d8c2f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1520 microversion: 2.1 time: 0.425265 Apr 08 11:15:34.365242 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 101/196] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:33 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1520 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:34.367322 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-f9d0750d-b539-417b-8b91-a8f046143532 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:34.367927 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-f9d0750d-b539-417b-8b91-a8f046143532 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:34.374052 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f9d0750d-b539-417b-8b91-a8f046143532 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:34.374844 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f9d0750d-b539-417b-8b91-a8f046143532 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:34.376223 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f9d0750d-b539-417b-8b91-a8f046143532 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:34.376856 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f9d0750d-b539-417b-8b91-a8f046143532 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:34.381905 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4b124e85-bf12-4526-92e4-867895c3712d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:34.399547 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4b124e85-bf12-4526-92e4-867895c3712d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:34.402979 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4b124e85-bf12-4526-92e4-867895c3712d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:34.404316 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4b124e85-bf12-4526-92e4-867895c3712d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1407 microversion: 2.20 time: 0.448460 Apr 08 11:15:34.405673 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 96/197] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:15:33 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1407 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:15:34.520582 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f9d0750d-b539-417b-8b91-a8f046143532 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:34.528883 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-f9d0750d-b539-417b-8b91-a8f046143532 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1363 microversion: 2.1 time: 0.165414 Apr 08 11:15:34.529451 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 102/198] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:34 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:35.380670 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9b4eb8f1-1944-4b78-8c2c-f6cbfbd25f09 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:35.381524 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9b4eb8f1-1944-4b78-8c2c-f6cbfbd25f09 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:35.392115 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9b4eb8f1-1944-4b78-8c2c-f6cbfbd25f09 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:35.392115 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9b4eb8f1-1944-4b78-8c2c-f6cbfbd25f09 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:35.392115 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9b4eb8f1-1944-4b78-8c2c-f6cbfbd25f09 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:35.392115 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9b4eb8f1-1944-4b78-8c2c-f6cbfbd25f09 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:35.427496 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-b541a430-cc2f-416f-bea3-916b4748a027 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:35.428509 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-b541a430-cc2f-416f-bea3-916b4748a027 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:35.437958 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b541a430-cc2f-416f-bea3-916b4748a027 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:35.438522 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b541a430-cc2f-416f-bea3-916b4748a027 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:35.439407 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b541a430-cc2f-416f-bea3-916b4748a027 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:35.439843 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b541a430-cc2f-416f-bea3-916b4748a027 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:35.639475 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9b4eb8f1-1944-4b78-8c2c-f6cbfbd25f09 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:35.649529 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9b4eb8f1-1944-4b78-8c2c-f6cbfbd25f09 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1520 microversion: 2.1 time: 0.273379 Apr 08 11:15:35.650984 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 97/199] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:35 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1520 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:15:35.664888 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-79fcad0d-8b8d-4f8f-9ae6-dcca2d93324e tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:35.666168 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-79fcad0d-8b8d-4f8f-9ae6-dcca2d93324e tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:35.672229 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-79fcad0d-8b8d-4f8f-9ae6-dcca2d93324e tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:35.672683 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-79fcad0d-8b8d-4f8f-9ae6-dcca2d93324e tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:35.673610 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-79fcad0d-8b8d-4f8f-9ae6-dcca2d93324e tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:35.674089 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-79fcad0d-8b8d-4f8f-9ae6-dcca2d93324e tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:35.676999 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b541a430-cc2f-416f-bea3-916b4748a027 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:35.686221 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b541a430-cc2f-416f-bea3-916b4748a027 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:35.687841 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b541a430-cc2f-416f-bea3-916b4748a027 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:35.689057 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-b541a430-cc2f-416f-bea3-916b4748a027 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1407 microversion: 2.20 time: 0.269044 Apr 08 11:15:35.693844 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 103/200] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:15:35 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1407 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:15:35.846863 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-79fcad0d-8b8d-4f8f-9ae6-dcca2d93324e tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:35.858727 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-79fcad0d-8b8d-4f8f-9ae6-dcca2d93324e tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1363 microversion: 2.1 time: 0.206438 Apr 08 11:15:35.859317 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 98/201] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:35 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:36.668824 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e8d29334-af38-4962-a655-0d7d317051fd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:36.669509 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e8d29334-af38-4962-a655-0d7d317051fd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:36.676063 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e8d29334-af38-4962-a655-0d7d317051fd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:36.676519 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e8d29334-af38-4962-a655-0d7d317051fd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:36.677300 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e8d29334-af38-4962-a655-0d7d317051fd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:36.677792 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e8d29334-af38-4962-a655-0d7d317051fd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:36.707375 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c0451c78-c2d3-4101-811e-772c71dbf784 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:36.707991 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c0451c78-c2d3-4101-811e-772c71dbf784 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:36.714013 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c0451c78-c2d3-4101-811e-772c71dbf784 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:36.714471 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c0451c78-c2d3-4101-811e-772c71dbf784 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:36.715813 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c0451c78-c2d3-4101-811e-772c71dbf784 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:36.724482 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c0451c78-c2d3-4101-811e-772c71dbf784 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:36.851415 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e8d29334-af38-4962-a655-0d7d317051fd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:36.862303 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e8d29334-af38-4962-a655-0d7d317051fd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1520 microversion: 2.1 time: 0.198893 Apr 08 11:15:36.863126 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 104/202] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:36 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:36.881602 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-dcb806de-fd4d-4a96-9d70-de59954a470e tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:36.882261 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-dcb806de-fd4d-4a96-9d70-de59954a470e tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:36.889330 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dcb806de-fd4d-4a96-9d70-de59954a470e tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:36.889821 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dcb806de-fd4d-4a96-9d70-de59954a470e tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:36.891101 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dcb806de-fd4d-4a96-9d70-de59954a470e tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:36.891543 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dcb806de-fd4d-4a96-9d70-de59954a470e tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:36.919655 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c0451c78-c2d3-4101-811e-772c71dbf784 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:36.927914 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c0451c78-c2d3-4101-811e-772c71dbf784 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:36.929439 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c0451c78-c2d3-4101-811e-772c71dbf784 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:36.930566 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c0451c78-c2d3-4101-811e-772c71dbf784 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1407 microversion: 2.20 time: 0.227214 Apr 08 11:15:36.931134 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 99/203] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:15:36 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:15:37.023942 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-dcb806de-fd4d-4a96-9d70-de59954a470e tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:37.031407 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-dcb806de-fd4d-4a96-9d70-de59954a470e tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1363 microversion: 2.1 time: 0.154398 Apr 08 11:15:37.032031 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 105/204] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:36 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:37.883170 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-583668f7-3aae-4e71-af9e-f877956e26da tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:37.883796 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-583668f7-3aae-4e71-af9e-f877956e26da tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:37.890544 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-583668f7-3aae-4e71-af9e-f877956e26da tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:37.890980 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-583668f7-3aae-4e71-af9e-f877956e26da tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:37.891766 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-583668f7-3aae-4e71-af9e-f877956e26da tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:37.892208 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-583668f7-3aae-4e71-af9e-f877956e26da tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:37.949299 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-6af73916-afb6-41ae-bbeb-ea78346153e7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:37.954676 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-6af73916-afb6-41ae-bbeb-ea78346153e7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:37.958952 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6af73916-afb6-41ae-bbeb-ea78346153e7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:37.959655 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6af73916-afb6-41ae-bbeb-ea78346153e7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:37.960839 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6af73916-afb6-41ae-bbeb-ea78346153e7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:37.961386 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6af73916-afb6-41ae-bbeb-ea78346153e7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:38.082958 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-583668f7-3aae-4e71-af9e-f877956e26da tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:38.091344 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-583668f7-3aae-4e71-af9e-f877956e26da tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1520 microversion: 2.1 time: 0.211782 Apr 08 11:15:38.092645 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 100/205] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:37 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:38.097547 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8ea40cb7-7d72-4a35-923b-5358b620e581 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:38.098663 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8ea40cb7-7d72-4a35-923b-5358b620e581 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:38.105502 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8ea40cb7-7d72-4a35-923b-5358b620e581 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:38.106106 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8ea40cb7-7d72-4a35-923b-5358b620e581 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:38.106909 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8ea40cb7-7d72-4a35-923b-5358b620e581 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:38.107381 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8ea40cb7-7d72-4a35-923b-5358b620e581 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:38.161225 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6af73916-afb6-41ae-bbeb-ea78346153e7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:38.174654 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6af73916-afb6-41ae-bbeb-ea78346153e7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:38.176665 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6af73916-afb6-41ae-bbeb-ea78346153e7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:38.178155 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-6af73916-afb6-41ae-bbeb-ea78346153e7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1407 microversion: 2.20 time: 0.232891 Apr 08 11:15:38.179095 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 106/206] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:15:37 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:15:38.277730 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8ea40cb7-7d72-4a35-923b-5358b620e581 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:38.289649 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8ea40cb7-7d72-4a35-923b-5358b620e581 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1363 microversion: 2.1 time: 0.195666 Apr 08 11:15:38.290599 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 101/207] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:38 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:39.111171 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-689ed2d4-790f-43db-b9f3-cff3fc08ef2e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:39.111795 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-689ed2d4-790f-43db-b9f3-cff3fc08ef2e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:39.118393 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-689ed2d4-790f-43db-b9f3-cff3fc08ef2e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:39.118846 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-689ed2d4-790f-43db-b9f3-cff3fc08ef2e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:39.119638 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-689ed2d4-790f-43db-b9f3-cff3fc08ef2e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:39.120084 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-689ed2d4-790f-43db-b9f3-cff3fc08ef2e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:39.203091 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e01ccfb7-fd39-4a43-804c-24d7af1d61e5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:39.204351 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e01ccfb7-fd39-4a43-804c-24d7af1d61e5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:39.215063 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e01ccfb7-fd39-4a43-804c-24d7af1d61e5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:39.215590 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e01ccfb7-fd39-4a43-804c-24d7af1d61e5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:39.216398 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e01ccfb7-fd39-4a43-804c-24d7af1d61e5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:39.217329 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e01ccfb7-fd39-4a43-804c-24d7af1d61e5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:39.316727 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-689ed2d4-790f-43db-b9f3-cff3fc08ef2e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:39.324672 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-689ed2d4-790f-43db-b9f3-cff3fc08ef2e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1520 microversion: 2.1 time: 0.218772 Apr 08 11:15:39.325279 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 107/208] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:39 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:39.330157 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-84511bff-6531-4ee9-80e0-88600ac28422 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:39.330768 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-84511bff-6531-4ee9-80e0-88600ac28422 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:39.337985 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-84511bff-6531-4ee9-80e0-88600ac28422 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:39.338469 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-84511bff-6531-4ee9-80e0-88600ac28422 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:39.339285 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-84511bff-6531-4ee9-80e0-88600ac28422 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:39.339891 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-84511bff-6531-4ee9-80e0-88600ac28422 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:39.416026 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e01ccfb7-fd39-4a43-804c-24d7af1d61e5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:39.425560 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e01ccfb7-fd39-4a43-804c-24d7af1d61e5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:39.427135 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e01ccfb7-fd39-4a43-804c-24d7af1d61e5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:39.429801 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e01ccfb7-fd39-4a43-804c-24d7af1d61e5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1407 microversion: 2.20 time: 0.233354 Apr 08 11:15:39.429801 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 102/209] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:15:39 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:15:39.521970 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-84511bff-6531-4ee9-80e0-88600ac28422 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:39.530655 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-84511bff-6531-4ee9-80e0-88600ac28422 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1363 microversion: 2.1 time: 0.204297 Apr 08 11:15:39.531244 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 108/210] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:39 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:40.341486 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-87d12520-a66f-4c1a-8a20-a239fcd27f8a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:40.342685 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-87d12520-a66f-4c1a-8a20-a239fcd27f8a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:40.348775 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-87d12520-a66f-4c1a-8a20-a239fcd27f8a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:40.349221 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-87d12520-a66f-4c1a-8a20-a239fcd27f8a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:40.350011 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-87d12520-a66f-4c1a-8a20-a239fcd27f8a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:40.350446 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-87d12520-a66f-4c1a-8a20-a239fcd27f8a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:40.447974 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-1448b699-a896-481b-9015-b425378f8e80 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:40.449322 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-1448b699-a896-481b-9015-b425378f8e80 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:40.457200 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1448b699-a896-481b-9015-b425378f8e80 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:40.458051 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1448b699-a896-481b-9015-b425378f8e80 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:40.459286 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1448b699-a896-481b-9015-b425378f8e80 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:40.460274 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1448b699-a896-481b-9015-b425378f8e80 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:40.499700 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-87d12520-a66f-4c1a-8a20-a239fcd27f8a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:40.509457 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-87d12520-a66f-4c1a-8a20-a239fcd27f8a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1520 microversion: 2.1 time: 0.171592 Apr 08 11:15:40.510733 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 103/211] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:40 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:40.549877 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-56bcfd1b-df41-4c5b-adf1-5fcf88377532 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:40.550928 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-56bcfd1b-df41-4c5b-adf1-5fcf88377532 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:40.557969 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-56bcfd1b-df41-4c5b-adf1-5fcf88377532 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:40.561592 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-56bcfd1b-df41-4c5b-adf1-5fcf88377532 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:40.561592 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-56bcfd1b-df41-4c5b-adf1-5fcf88377532 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:40.561592 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-56bcfd1b-df41-4c5b-adf1-5fcf88377532 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:40.657634 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1448b699-a896-481b-9015-b425378f8e80 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:40.669536 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1448b699-a896-481b-9015-b425378f8e80 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:40.673134 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1448b699-a896-481b-9015-b425378f8e80 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:40.677956 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-1448b699-a896-481b-9015-b425378f8e80 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1407 microversion: 2.20 time: 0.231433 Apr 08 11:15:40.678827 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 109/212] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:15:40 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:15:40.801991 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-56bcfd1b-df41-4c5b-adf1-5fcf88377532 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:40.813894 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-56bcfd1b-df41-4c5b-adf1-5fcf88377532 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1363 microversion: 2.1 time: 0.268797 Apr 08 11:15:40.815132 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 104/213] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:40 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1363 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:15:41.528304 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-9039bb22-809c-4748-be3e-c9b478ee515f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:41.529501 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-9039bb22-809c-4748-be3e-c9b478ee515f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:41.539227 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9039bb22-809c-4748-be3e-c9b478ee515f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:41.539830 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9039bb22-809c-4748-be3e-c9b478ee515f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:41.541269 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9039bb22-809c-4748-be3e-c9b478ee515f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:41.541877 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9039bb22-809c-4748-be3e-c9b478ee515f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:41.651230 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-bb617fdd-5eb2-4334-92d8-50741af08646 req-078f9830-45f8-4449-8331-b3eb21acfb2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eff1b1a4-3738-43db-86ce-a17e2f08ffc0", "name": "network-vif-plugged", "status": "completed", "tag": "e41cba02-8f69-4396-ac0c-333ff20bdcbe"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:15:41.666358 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-bb617fdd-5eb2-4334-92d8-50741af08646 req-078f9830-45f8-4449-8331-b3eb21acfb2e service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:41.667162 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-bb617fdd-5eb2-4334-92d8-50741af08646 req-078f9830-45f8-4449-8331-b3eb21acfb2e service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:41.690185 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-bb617fdd-5eb2-4334-92d8-50741af08646 req-078f9830-45f8-4449-8331-b3eb21acfb2e service nova] Creating event network-vif-plugged:e41cba02-8f69-4396-ac0c-333ff20bdcbe for instance eff1b1a4-3738-43db-86ce-a17e2f08ffc0 on hv-cinder-83607 Apr 08 11:15:41.696930 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-bb617fdd-5eb2-4334-92d8-50741af08646 req-078f9830-45f8-4449-8331-b3eb21acfb2e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049905 Apr 08 11:15:41.697996 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 105/214] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:15:41.707164 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4816d360-c27c-4a29-8b50-8e64780b3b2d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:41.708201 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4816d360-c27c-4a29-8b50-8e64780b3b2d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:41.718393 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4816d360-c27c-4a29-8b50-8e64780b3b2d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:41.734943 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4816d360-c27c-4a29-8b50-8e64780b3b2d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:41.734943 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4816d360-c27c-4a29-8b50-8e64780b3b2d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:41.734943 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4816d360-c27c-4a29-8b50-8e64780b3b2d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:41.751141 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-9039bb22-809c-4748-be3e-c9b478ee515f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:41.769320 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-9039bb22-809c-4748-be3e-c9b478ee515f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1520 microversion: 2.1 time: 0.238231 Apr 08 11:15:41.787498 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 110/215] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:41 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1520 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:41.850604 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-91a86301-65b1-46bb-968f-b4c4475bf2f6 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:41.850604 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-91a86301-65b1-46bb-968f-b4c4475bf2f6 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:41.850604 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-91a86301-65b1-46bb-968f-b4c4475bf2f6 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:41.850604 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-91a86301-65b1-46bb-968f-b4c4475bf2f6 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:41.851960 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-91a86301-65b1-46bb-968f-b4c4475bf2f6 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:41.852675 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-91a86301-65b1-46bb-968f-b4c4475bf2f6 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:42.055823 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4816d360-c27c-4a29-8b50-8e64780b3b2d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:42.070034 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4816d360-c27c-4a29-8b50-8e64780b3b2d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:42.075320 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4816d360-c27c-4a29-8b50-8e64780b3b2d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:42.077600 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4816d360-c27c-4a29-8b50-8e64780b3b2d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1599 microversion: 2.20 time: 0.378096 Apr 08 11:15:42.092272 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 106/216] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:15:41 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1599 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:15:42.109910 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-06a34925-e261-43fa-beb6-7f000857fe79 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:42.110674 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-06a34925-e261-43fa-beb6-7f000857fe79 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:42.118063 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-06a34925-e261-43fa-beb6-7f000857fe79 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:42.118605 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-06a34925-e261-43fa-beb6-7f000857fe79 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:42.120359 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-06a34925-e261-43fa-beb6-7f000857fe79 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:42.120803 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-06a34925-e261-43fa-beb6-7f000857fe79 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:42.203250 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-91a86301-65b1-46bb-968f-b4c4475bf2f6 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:42.211579 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-91a86301-65b1-46bb-968f-b4c4475bf2f6 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1363 microversion: 2.1 time: 0.374623 Apr 08 11:15:42.212486 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 111/217] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:41 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1363 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:15:42.256862 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-06a34925-e261-43fa-beb6-7f000857fe79 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.151593 Apr 08 11:15:42.257569 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 107/218] 10.222.0.46 () {60 vars in 1315 bytes} [Fri Apr 8 11:15:42 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/os-interface => generated 284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 08 11:15:42.787558 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-054317a4-f848-49fc-a297-bdd9baf5b549 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:42.788218 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-054317a4-f848-49fc-a297-bdd9baf5b549 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:42.795944 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-054317a4-f848-49fc-a297-bdd9baf5b549 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:42.796395 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-054317a4-f848-49fc-a297-bdd9baf5b549 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:42.797490 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-054317a4-f848-49fc-a297-bdd9baf5b549 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:42.797617 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-054317a4-f848-49fc-a297-bdd9baf5b549 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:43.236476 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f9a881ad-321a-41d3-a41c-a15274686e1d tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:43.236476 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f9a881ad-321a-41d3-a41c-a15274686e1d tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:43.239068 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f9a881ad-321a-41d3-a41c-a15274686e1d tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:43.239346 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f9a881ad-321a-41d3-a41c-a15274686e1d tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:43.240464 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f9a881ad-321a-41d3-a41c-a15274686e1d tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:43.240464 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f9a881ad-321a-41d3-a41c-a15274686e1d tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:43.460158 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-054317a4-f848-49fc-a297-bdd9baf5b549 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:43.481884 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-054317a4-f848-49fc-a297-bdd9baf5b549 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1520 microversion: 2.1 time: 0.696130 Apr 08 11:15:43.481884 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 112/219] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:42 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1520 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:43.714695 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f9a881ad-321a-41d3-a41c-a15274686e1d tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:43.724047 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f9a881ad-321a-41d3-a41c-a15274686e1d tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1363 microversion: 2.1 time: 0.497887 Apr 08 11:15:43.725076 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 108/220] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:43 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1363 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:15:44.319030 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [req-23020b33-9deb-4c77-81c8-4ee042c7882b req-76141dba-8090-44f1-9f4a-61490bf5df49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "594ceb52-9d1f-494f-818d-eb66144bc49d", "tag": "0095761d-6242-494c-b486-fc86278e0746"}]} {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:15:44.336703 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-23020b33-9deb-4c77-81c8-4ee042c7882b req-76141dba-8090-44f1-9f4a-61490bf5df49 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:44.340521 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-23020b33-9deb-4c77-81c8-4ee042c7882b req-76141dba-8090-44f1-9f4a-61490bf5df49 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:44.350153 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.compute.server_external_events [req-23020b33-9deb-4c77-81c8-4ee042c7882b req-76141dba-8090-44f1-9f4a-61490bf5df49 service nova] Creating event network-changed:0095761d-6242-494c-b486-fc86278e0746 for instance 594ceb52-9d1f-494f-818d-eb66144bc49d on hv-cinder-83607 Apr 08 11:15:44.356077 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [req-23020b33-9deb-4c77-81c8-4ee042c7882b req-76141dba-8090-44f1-9f4a-61490bf5df49 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045650 Apr 08 11:15:44.356679 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 113/221] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:15:44.499931 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c13aa611-1c38-4868-bb50-93fb75f2e9e1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:44.500626 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c13aa611-1c38-4868-bb50-93fb75f2e9e1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:44.511463 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c13aa611-1c38-4868-bb50-93fb75f2e9e1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:44.511929 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c13aa611-1c38-4868-bb50-93fb75f2e9e1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:44.512729 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c13aa611-1c38-4868-bb50-93fb75f2e9e1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:44.513169 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c13aa611-1c38-4868-bb50-93fb75f2e9e1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:44.743977 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-65dd2676-1bd7-4d86-9f17-de53f73bf973 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:44.745351 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-65dd2676-1bd7-4d86-9f17-de53f73bf973 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:44.751371 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c13aa611-1c38-4868-bb50-93fb75f2e9e1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:44.752476 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-65dd2676-1bd7-4d86-9f17-de53f73bf973 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:44.753105 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-65dd2676-1bd7-4d86-9f17-de53f73bf973 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:44.756499 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-65dd2676-1bd7-4d86-9f17-de53f73bf973 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:44.757225 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-65dd2676-1bd7-4d86-9f17-de53f73bf973 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:44.770940 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c13aa611-1c38-4868-bb50-93fb75f2e9e1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1520 microversion: 2.1 time: 0.276428 Apr 08 11:15:44.772142 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 109/222] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:44 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:45.037693 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-65dd2676-1bd7-4d86-9f17-de53f73bf973 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:45.046556 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-65dd2676-1bd7-4d86-9f17-de53f73bf973 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1363 microversion: 2.1 time: 0.307079 Apr 08 11:15:45.056943 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 114/223] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:44 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1363 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:45.790422 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c5191c64-9b46-407f-ba70-d4ca267d7f4f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:45.791150 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c5191c64-9b46-407f-ba70-d4ca267d7f4f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:45.805363 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c5191c64-9b46-407f-ba70-d4ca267d7f4f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:45.809273 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c5191c64-9b46-407f-ba70-d4ca267d7f4f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:45.809273 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c5191c64-9b46-407f-ba70-d4ca267d7f4f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:45.809273 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c5191c64-9b46-407f-ba70-d4ca267d7f4f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:46.027726 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c5191c64-9b46-407f-ba70-d4ca267d7f4f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:46.027875 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c5191c64-9b46-407f-ba70-d4ca267d7f4f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1520 microversion: 2.1 time: 0.242554 Apr 08 11:15:46.040524 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 110/224] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:45 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1520 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:46.068139 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-21d92263-dfc5-4fe7-81fc-70eb924986d2 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:46.069802 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-21d92263-dfc5-4fe7-81fc-70eb924986d2 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:46.078948 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-21d92263-dfc5-4fe7-81fc-70eb924986d2 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:46.079798 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-21d92263-dfc5-4fe7-81fc-70eb924986d2 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:46.081164 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-21d92263-dfc5-4fe7-81fc-70eb924986d2 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:46.082008 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-21d92263-dfc5-4fe7-81fc-70eb924986d2 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:46.422931 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-21d92263-dfc5-4fe7-81fc-70eb924986d2 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:46.436164 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-21d92263-dfc5-4fe7-81fc-70eb924986d2 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1549 microversion: 2.1 time: 0.372584 Apr 08 11:15:46.448421 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 115/225] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:46 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1549 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:15:46.463589 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-fbec2bc8-7dab-40f6-b931-38bdf2672efd tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:46.464255 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-fbec2bc8-7dab-40f6-b931-38bdf2672efd tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:46.472106 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fbec2bc8-7dab-40f6-b931-38bdf2672efd tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:46.472882 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fbec2bc8-7dab-40f6-b931-38bdf2672efd tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:46.473973 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fbec2bc8-7dab-40f6-b931-38bdf2672efd tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:46.474531 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fbec2bc8-7dab-40f6-b931-38bdf2672efd tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:46.885899 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-fbec2bc8-7dab-40f6-b931-38bdf2672efd tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.435949 Apr 08 11:15:46.886493 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 111/226] 10.222.0.46 () {58 vars in 1274 bytes} [Fri Apr 8 11:15:46 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/os-interface => generated 285 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:15:47.048718 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-57139ccb-3624-4d21-9541-9bddf5559684 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:47.049459 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-57139ccb-3624-4d21-9541-9bddf5559684 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:47.056122 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-57139ccb-3624-4d21-9541-9bddf5559684 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:47.056575 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-57139ccb-3624-4d21-9541-9bddf5559684 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:47.057368 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-57139ccb-3624-4d21-9541-9bddf5559684 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:47.057834 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-57139ccb-3624-4d21-9541-9bddf5559684 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:47.275598 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-57139ccb-3624-4d21-9541-9bddf5559684 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:47.290722 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-57139ccb-3624-4d21-9541-9bddf5559684 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1520 microversion: 2.1 time: 0.246840 Apr 08 11:15:47.291993 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 116/227] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:47 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:48.323884 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1a2a5d39-5054-4fee-937e-fca8d511b374 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:48.323884 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1a2a5d39-5054-4fee-937e-fca8d511b374 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:48.334112 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1a2a5d39-5054-4fee-937e-fca8d511b374 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:48.334968 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1a2a5d39-5054-4fee-937e-fca8d511b374 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:48.336448 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1a2a5d39-5054-4fee-937e-fca8d511b374 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:48.336903 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1a2a5d39-5054-4fee-937e-fca8d511b374 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:48.550556 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1a2a5d39-5054-4fee-937e-fca8d511b374 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:48.558573 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1a2a5d39-5054-4fee-937e-fca8d511b374 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1520 microversion: 2.1 time: 0.245429 Apr 08 11:15:48.559224 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 112/228] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:48 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1520 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:48.897680 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [req-13af84c7-771a-422d-a643-017105b85b38 req-3e2f1a83-368a-43af-9ae9-60b0a9fee181 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eff1b1a4-3738-43db-86ce-a17e2f08ffc0", "tag": "e41cba02-8f69-4396-ac0c-333ff20bdcbe"}]} {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:15:48.907222 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-13af84c7-771a-422d-a643-017105b85b38 req-3e2f1a83-368a-43af-9ae9-60b0a9fee181 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:48.907772 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-13af84c7-771a-422d-a643-017105b85b38 req-3e2f1a83-368a-43af-9ae9-60b0a9fee181 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:48.920648 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.compute.server_external_events [req-13af84c7-771a-422d-a643-017105b85b38 req-3e2f1a83-368a-43af-9ae9-60b0a9fee181 service nova] Creating event network-changed:e41cba02-8f69-4396-ac0c-333ff20bdcbe for instance eff1b1a4-3738-43db-86ce-a17e2f08ffc0 on hv-cinder-83607 Apr 08 11:15:48.926398 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [req-13af84c7-771a-422d-a643-017105b85b38 req-3e2f1a83-368a-43af-9ae9-60b0a9fee181 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032886 Apr 08 11:15:48.927276 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 117/229] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:15:49.580916 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-81bb6ec1-5572-4627-9f8c-333fbc007a79 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:49.581514 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-81bb6ec1-5572-4627-9f8c-333fbc007a79 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:49.592707 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-81bb6ec1-5572-4627-9f8c-333fbc007a79 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:49.593461 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-81bb6ec1-5572-4627-9f8c-333fbc007a79 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:49.594443 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-81bb6ec1-5572-4627-9f8c-333fbc007a79 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:49.599097 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-81bb6ec1-5572-4627-9f8c-333fbc007a79 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:49.888868 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-81bb6ec1-5572-4627-9f8c-333fbc007a79 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:49.919090 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-81bb6ec1-5572-4627-9f8c-333fbc007a79 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1520 microversion: 2.1 time: 0.341757 Apr 08 11:15:49.929363 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 113/230] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:49 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1520 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:50.955680 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-7a1a7114-641e-4be4-b725-3b9b1fc8e058 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:50.955680 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-7a1a7114-641e-4be4-b725-3b9b1fc8e058 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:50.965089 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7a1a7114-641e-4be4-b725-3b9b1fc8e058 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:50.965672 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7a1a7114-641e-4be4-b725-3b9b1fc8e058 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:50.966695 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7a1a7114-641e-4be4-b725-3b9b1fc8e058 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:50.967266 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7a1a7114-641e-4be4-b725-3b9b1fc8e058 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:51.189202 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-7a1a7114-641e-4be4-b725-3b9b1fc8e058 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:51.203125 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-7a1a7114-641e-4be4-b725-3b9b1fc8e058 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1520 microversion: 2.1 time: 0.254895 Apr 08 11:15:51.203125 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 118/231] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:50 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1520 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:52.016828 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3bacb300-35d5-410e-9712-b566f525c23f tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:52.017365 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3bacb300-35d5-410e-9712-b566f525c23f tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:52.023655 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3bacb300-35d5-410e-9712-b566f525c23f tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:52.024024 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3bacb300-35d5-410e-9712-b566f525c23f tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:52.024853 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3bacb300-35d5-410e-9712-b566f525c23f tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:52.025373 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3bacb300-35d5-410e-9712-b566f525c23f tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:52.051739 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3bacb300-35d5-410e-9712-b566f525c23f tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Going to try to terminate instance {{(pid=117800) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 08 11:15:52.216969 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-27f8fa7b-752d-4e17-b4d6-ec268265ff41 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:52.218344 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-27f8fa7b-752d-4e17-b4d6-ec268265ff41 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:52.225436 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-27f8fa7b-752d-4e17-b4d6-ec268265ff41 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:52.226225 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-27f8fa7b-752d-4e17-b4d6-ec268265ff41 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:52.227227 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-27f8fa7b-752d-4e17-b4d6-ec268265ff41 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:52.227672 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-27f8fa7b-752d-4e17-b4d6-ec268265ff41 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:52.408582 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3bacb300-35d5-410e-9712-b566f525c23f tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "DELETE /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 204 len: 0 microversion: 2.1 time: 0.395366 Apr 08 11:15:52.409708 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 114/232] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 8 11:15:52 2022] DELETE /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 11:15:52.422124 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-409282d6-ba6b-4c42-b95a-2c0bbe8b4f58 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:52.423467 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-409282d6-ba6b-4c42-b95a-2c0bbe8b4f58 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:52.426551 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-27f8fa7b-752d-4e17-b4d6-ec268265ff41 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:52.432928 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-409282d6-ba6b-4c42-b95a-2c0bbe8b4f58 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:52.433471 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-409282d6-ba6b-4c42-b95a-2c0bbe8b4f58 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:52.434587 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-409282d6-ba6b-4c42-b95a-2c0bbe8b4f58 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:52.435287 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-409282d6-ba6b-4c42-b95a-2c0bbe8b4f58 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:52.437261 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-27f8fa7b-752d-4e17-b4d6-ec268265ff41 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1520 microversion: 2.1 time: 0.224618 Apr 08 11:15:52.438250 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 119/233] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:52 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:15:52.619143 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-409282d6-ba6b-4c42-b95a-2c0bbe8b4f58 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44deb9de4511458ba769ad2b8b26651c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a05f833c354a00a03d62f49c9e3402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:52.628093 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-409282d6-ba6b-4c42-b95a-2c0bbe8b4f58 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 200 len: 1553 microversion: 2.1 time: 0.212022 Apr 08 11:15:52.628692 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 115/234] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:52 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 1553 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:15:53.466364 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-b7292ad1-a6f8-4e4f-9777-be7d546b8380 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:53.467033 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-b7292ad1-a6f8-4e4f-9777-be7d546b8380 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:53.473279 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b7292ad1-a6f8-4e4f-9777-be7d546b8380 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:53.473726 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b7292ad1-a6f8-4e4f-9777-be7d546b8380 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:53.474532 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b7292ad1-a6f8-4e4f-9777-be7d546b8380 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:53.474969 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b7292ad1-a6f8-4e4f-9777-be7d546b8380 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:53.628355 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b7292ad1-a6f8-4e4f-9777-be7d546b8380 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:53.647643 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b029effe-7825-4cec-b515-d8c606ef82d0 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:53.648477 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b029effe-7825-4cec-b515-d8c606ef82d0 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:53.649341 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-b7292ad1-a6f8-4e4f-9777-be7d546b8380 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1520 microversion: 2.1 time: 0.185352 Apr 08 11:15:53.650667 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 120/235] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:53 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:53.654617 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b029effe-7825-4cec-b515-d8c606ef82d0 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:53.655062 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b029effe-7825-4cec-b515-d8c606ef82d0 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:53.655855 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b029effe-7825-4cec-b515-d8c606ef82d0 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:53.656284 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b029effe-7825-4cec-b515-d8c606ef82d0 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:53.826771 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b029effe-7825-4cec-b515-d8c606ef82d0 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44deb9de4511458ba769ad2b8b26651c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a05f833c354a00a03d62f49c9e3402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:53.837821 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b029effe-7825-4cec-b515-d8c606ef82d0 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 200 len: 1553 microversion: 2.1 time: 0.194537 Apr 08 11:15:53.838636 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 116/236] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:53 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 1553 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:15:54.675532 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-8f24914d-12f2-4711-8316-6523539ca6ca tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:54.676147 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-8f24914d-12f2-4711-8316-6523539ca6ca tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:54.683003 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8f24914d-12f2-4711-8316-6523539ca6ca tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:54.683512 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8f24914d-12f2-4711-8316-6523539ca6ca tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:54.684357 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8f24914d-12f2-4711-8316-6523539ca6ca tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:54.684842 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8f24914d-12f2-4711-8316-6523539ca6ca tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:54.836729 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-8f24914d-12f2-4711-8316-6523539ca6ca tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:54.848682 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-8f24914d-12f2-4711-8316-6523539ca6ca tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1520 microversion: 2.1 time: 0.176891 Apr 08 11:15:54.849867 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 121/237] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:54 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:54.864385 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-365bd641-bdde-4f90-9563-163591ecc426 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:54.865145 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-365bd641-bdde-4f90-9563-163591ecc426 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:54.871497 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-365bd641-bdde-4f90-9563-163591ecc426 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:54.871965 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-365bd641-bdde-4f90-9563-163591ecc426 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:54.872739 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-365bd641-bdde-4f90-9563-163591ecc426 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:54.873745 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-365bd641-bdde-4f90-9563-163591ecc426 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:55.034058 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-365bd641-bdde-4f90-9563-163591ecc426 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44deb9de4511458ba769ad2b8b26651c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a05f833c354a00a03d62f49c9e3402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:55.049440 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-365bd641-bdde-4f90-9563-163591ecc426 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 200 len: 1553 microversion: 2.1 time: 0.189139 Apr 08 11:15:55.050475 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 117/238] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:54 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 1553 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:55.871217 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-ff3248e5-4775-4095-80b1-2a7b19885c0e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:55.871852 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-ff3248e5-4775-4095-80b1-2a7b19885c0e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:55.879666 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ff3248e5-4775-4095-80b1-2a7b19885c0e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:55.880120 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ff3248e5-4775-4095-80b1-2a7b19885c0e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:55.880906 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ff3248e5-4775-4095-80b1-2a7b19885c0e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:55.881347 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ff3248e5-4775-4095-80b1-2a7b19885c0e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:56.036652 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-ff3248e5-4775-4095-80b1-2a7b19885c0e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:56.044551 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-ff3248e5-4775-4095-80b1-2a7b19885c0e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1520 microversion: 2.1 time: 0.177242 Apr 08 11:15:56.045178 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 122/239] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:55 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:56.083545 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5c8120db-91ea-4d7a-8c81-6dfdc2970df6 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:56.084197 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5c8120db-91ea-4d7a-8c81-6dfdc2970df6 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:56.090062 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5c8120db-91ea-4d7a-8c81-6dfdc2970df6 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:56.090508 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5c8120db-91ea-4d7a-8c81-6dfdc2970df6 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:56.091282 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5c8120db-91ea-4d7a-8c81-6dfdc2970df6 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:56.092306 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5c8120db-91ea-4d7a-8c81-6dfdc2970df6 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:56.239025 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5c8120db-91ea-4d7a-8c81-6dfdc2970df6 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44deb9de4511458ba769ad2b8b26651c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a05f833c354a00a03d62f49c9e3402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:56.247355 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5c8120db-91ea-4d7a-8c81-6dfdc2970df6 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 200 len: 1553 microversion: 2.1 time: 0.167708 Apr 08 11:15:56.247995 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 118/240] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:56 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:57.062233 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-ceb5e4f2-99eb-4d65-a7e9-e50f3f84a30c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:57.062963 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-ceb5e4f2-99eb-4d65-a7e9-e50f3f84a30c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:57.069530 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ceb5e4f2-99eb-4d65-a7e9-e50f3f84a30c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:57.070016 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ceb5e4f2-99eb-4d65-a7e9-e50f3f84a30c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:57.070779 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ceb5e4f2-99eb-4d65-a7e9-e50f3f84a30c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:57.071215 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ceb5e4f2-99eb-4d65-a7e9-e50f3f84a30c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:57.236394 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-ceb5e4f2-99eb-4d65-a7e9-e50f3f84a30c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:57.243066 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-ceb5e4f2-99eb-4d65-a7e9-e50f3f84a30c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1520 microversion: 2.1 time: 0.185221 Apr 08 11:15:57.243656 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 123/241] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:57 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:57.268286 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c8062838-e10a-4a5b-89cc-c628d12026e4 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:57.269373 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c8062838-e10a-4a5b-89cc-c628d12026e4 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:57.280689 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c8062838-e10a-4a5b-89cc-c628d12026e4 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:57.281486 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c8062838-e10a-4a5b-89cc-c628d12026e4 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:57.282983 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c8062838-e10a-4a5b-89cc-c628d12026e4 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:57.283794 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c8062838-e10a-4a5b-89cc-c628d12026e4 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:57.437498 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c8062838-e10a-4a5b-89cc-c628d12026e4 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44deb9de4511458ba769ad2b8b26651c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a05f833c354a00a03d62f49c9e3402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:57.445907 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c8062838-e10a-4a5b-89cc-c628d12026e4 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 200 len: 1553 microversion: 2.1 time: 0.184162 Apr 08 11:15:57.446471 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 119/242] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:57 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 1553 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:58.263945 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-9f7a6588-4db1-4ace-a540-aa68e0645bd9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:58.264664 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-9f7a6588-4db1-4ace-a540-aa68e0645bd9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:58.272221 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9f7a6588-4db1-4ace-a540-aa68e0645bd9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:58.277572 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9f7a6588-4db1-4ace-a540-aa68e0645bd9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:58.277572 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9f7a6588-4db1-4ace-a540-aa68e0645bd9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:58.277572 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9f7a6588-4db1-4ace-a540-aa68e0645bd9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:58.436478 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-9f7a6588-4db1-4ace-a540-aa68e0645bd9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:58.449832 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-9f7a6588-4db1-4ace-a540-aa68e0645bd9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1520 microversion: 2.1 time: 0.192489 Apr 08 11:15:58.451103 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 124/243] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:58 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:58.465083 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a7772cb7-951f-4029-ba48-efe79f31be4c tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:58.466711 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a7772cb7-951f-4029-ba48-efe79f31be4c tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:58.473465 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a7772cb7-951f-4029-ba48-efe79f31be4c tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:58.474074 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a7772cb7-951f-4029-ba48-efe79f31be4c tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:58.475018 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a7772cb7-951f-4029-ba48-efe79f31be4c tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:58.475533 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a7772cb7-951f-4029-ba48-efe79f31be4c tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:58.627688 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a7772cb7-951f-4029-ba48-efe79f31be4c tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44deb9de4511458ba769ad2b8b26651c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a05f833c354a00a03d62f49c9e3402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:58.635859 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a7772cb7-951f-4029-ba48-efe79f31be4c tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 200 len: 1553 microversion: 2.1 time: 0.174954 Apr 08 11:15:58.636432 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 120/244] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:58 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 1553 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:59.467059 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-71ed0f8e-b15b-4141-bf97-e2d65920b219 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:59.475231 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-71ed0f8e-b15b-4141-bf97-e2d65920b219 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:59.475231 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-71ed0f8e-b15b-4141-bf97-e2d65920b219 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:59.475231 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-71ed0f8e-b15b-4141-bf97-e2d65920b219 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:59.475703 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-71ed0f8e-b15b-4141-bf97-e2d65920b219 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:59.475829 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-71ed0f8e-b15b-4141-bf97-e2d65920b219 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:59.619601 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-71ed0f8e-b15b-4141-bf97-e2d65920b219 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:59.628021 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-71ed0f8e-b15b-4141-bf97-e2d65920b219 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1520 microversion: 2.1 time: 0.164675 Apr 08 11:15:59.628605 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 125/245] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:59 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:15:59.659982 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f2f2cc8d-8d88-4032-8a29-90bb98a24f6b tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:15:59.660588 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f2f2cc8d-8d88-4032-8a29-90bb98a24f6b tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:15:59.666876 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f2f2cc8d-8d88-4032-8a29-90bb98a24f6b tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:59.667377 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f2f2cc8d-8d88-4032-8a29-90bb98a24f6b tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:59.668135 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f2f2cc8d-8d88-4032-8a29-90bb98a24f6b tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:15:59.668631 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f2f2cc8d-8d88-4032-8a29-90bb98a24f6b tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:15:59.812392 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f2f2cc8d-8d88-4032-8a29-90bb98a24f6b tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44deb9de4511458ba769ad2b8b26651c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a05f833c354a00a03d62f49c9e3402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:15:59.820367 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f2f2cc8d-8d88-4032-8a29-90bb98a24f6b tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 200 len: 1553 microversion: 2.1 time: 0.164203 Apr 08 11:15:59.820954 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 121/246] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:15:59 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:00.521052 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [req-8ee18a11-5c1c-412d-bc4c-d20e4707c85d req-51b3e9dc-3d67-4c42-a4b7-4970cd49992e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04fd539f-d648-4fd7-b824-351f408a0327", "name": "network-vif-deleted", "tag": "e997b977-c6eb-4b8f-b12d-f27072ee34f1"}]} {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:16:00.530313 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-8ee18a11-5c1c-412d-bc4c-d20e4707c85d req-51b3e9dc-3d67-4c42-a4b7-4970cd49992e service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:00.530760 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-8ee18a11-5c1c-412d-bc4c-d20e4707c85d req-51b3e9dc-3d67-4c42-a4b7-4970cd49992e service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:00.541933 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.compute.server_external_events [req-8ee18a11-5c1c-412d-bc4c-d20e4707c85d req-51b3e9dc-3d67-4c42-a4b7-4970cd49992e service nova] Creating event network-vif-deleted:e997b977-c6eb-4b8f-b12d-f27072ee34f1 for instance 04fd539f-d648-4fd7-b824-351f408a0327 on hv-cinder-83607 Apr 08 11:16:00.547158 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [req-8ee18a11-5c1c-412d-bc4c-d20e4707c85d req-51b3e9dc-3d67-4c42-a4b7-4970cd49992e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029795 Apr 08 11:16:00.547958 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 126/247] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:16:00.656091 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6e2a6a76-0cf8-4316-90ac-d262af0c1d0f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:00.656884 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6e2a6a76-0cf8-4316-90ac-d262af0c1d0f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:00.665384 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6e2a6a76-0cf8-4316-90ac-d262af0c1d0f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:00.666028 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6e2a6a76-0cf8-4316-90ac-d262af0c1d0f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:00.666631 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6e2a6a76-0cf8-4316-90ac-d262af0c1d0f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:00.667063 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6e2a6a76-0cf8-4316-90ac-d262af0c1d0f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:00.802609 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6e2a6a76-0cf8-4316-90ac-d262af0c1d0f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:00.810086 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6e2a6a76-0cf8-4316-90ac-d262af0c1d0f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1520 microversion: 2.1 time: 0.160058 Apr 08 11:16:00.811154 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 122/248] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:00 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:00.837684 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-544b403c-d485-47cc-85c5-50aee9223ad4 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:00.838530 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-544b403c-d485-47cc-85c5-50aee9223ad4 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:00.844510 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-544b403c-d485-47cc-85c5-50aee9223ad4 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:00.844967 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-544b403c-d485-47cc-85c5-50aee9223ad4 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:00.845727 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-544b403c-d485-47cc-85c5-50aee9223ad4 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:00.846188 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-544b403c-d485-47cc-85c5-50aee9223ad4 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:00.910299 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-544b403c-d485-47cc-85c5-50aee9223ad4 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44deb9de4511458ba769ad2b8b26651c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a05f833c354a00a03d62f49c9e3402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:00.923437 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-544b403c-d485-47cc-85c5-50aee9223ad4 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 200 len: 1345 microversion: 2.1 time: 0.089850 Apr 08 11:16:00.924412 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 127/249] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:00 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 1345 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:01.828743 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-42940f2d-ea1e-4304-ab5c-5f95ce9cd1da tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:01.829375 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-42940f2d-ea1e-4304-ab5c-5f95ce9cd1da tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:01.835902 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-42940f2d-ea1e-4304-ab5c-5f95ce9cd1da tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:01.836474 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-42940f2d-ea1e-4304-ab5c-5f95ce9cd1da tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:01.840854 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-42940f2d-ea1e-4304-ab5c-5f95ce9cd1da tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:01.842020 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-42940f2d-ea1e-4304-ab5c-5f95ce9cd1da tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:01.946771 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2c9a24f8-aa7f-4d8a-9c86-6ff506c0872f tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:01.947583 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-2c9a24f8-aa7f-4d8a-9c86-6ff506c0872f tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:01.955169 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2c9a24f8-aa7f-4d8a-9c86-6ff506c0872f tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:01.955719 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2c9a24f8-aa7f-4d8a-9c86-6ff506c0872f tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:01.956607 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2c9a24f8-aa7f-4d8a-9c86-6ff506c0872f tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:01.957120 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2c9a24f8-aa7f-4d8a-9c86-6ff506c0872f tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:01.992893 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2c9a24f8-aa7f-4d8a-9c86-6ff506c0872f tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:01.993425 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2c9a24f8-aa7f-4d8a-9c86-6ff506c0872f tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:01.994144 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.objects.instance [None req-2c9a24f8-aa7f-4d8a-9c86-6ff506c0872f tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lazy-loading 'fault' on Instance uuid 04fd539f-d648-4fd7-b824-351f408a0327 {{(pid=117801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 11:16:02.016204 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-42940f2d-ea1e-4304-ab5c-5f95ce9cd1da tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:02.025797 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-42940f2d-ea1e-4304-ab5c-5f95ce9cd1da tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1520 microversion: 2.1 time: 0.202213 Apr 08 11:16:02.028223 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 123/250] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:01 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:02.069299 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2c9a24f8-aa7f-4d8a-9c86-6ff506c0872f tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44deb9de4511458ba769ad2b8b26651c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a05f833c354a00a03d62f49c9e3402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:02.092646 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-2c9a24f8-aa7f-4d8a-9c86-6ff506c0872f tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 200 len: 1350 microversion: 2.1 time: 0.150062 Apr 08 11:16:02.093868 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 128/251] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:01 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 1350 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:03.056433 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ce2150ca-17c3-4455-848a-d354600a78e0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:03.056973 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ce2150ca-17c3-4455-848a-d354600a78e0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:03.063570 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ce2150ca-17c3-4455-848a-d354600a78e0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:03.064028 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ce2150ca-17c3-4455-848a-d354600a78e0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:03.064798 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ce2150ca-17c3-4455-848a-d354600a78e0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:03.065269 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ce2150ca-17c3-4455-848a-d354600a78e0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:03.113144 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2dcbc90b-f6f9-4f45-996d-4906b11fcebc tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:03.113914 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-2dcbc90b-f6f9-4f45-996d-4906b11fcebc tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:03.121672 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2dcbc90b-f6f9-4f45-996d-4906b11fcebc tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:03.122664 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2dcbc90b-f6f9-4f45-996d-4906b11fcebc tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:03.123647 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2dcbc90b-f6f9-4f45-996d-4906b11fcebc tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:03.124865 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2dcbc90b-f6f9-4f45-996d-4906b11fcebc tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:03.142582 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.wsgi [None req-2dcbc90b-f6f9-4f45-996d-4906b11fcebc tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] HTTP exception thrown: Instance 04fd539f-d648-4fd7-b824-351f408a0327 could not be found. Apr 08 11:16:03.143387 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2dcbc90b-f6f9-4f45-996d-4906b11fcebc tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Returning 404 to user: Instance 04fd539f-d648-4fd7-b824-351f408a0327 could not be found. {{(pid=117801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:16:03.144562 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-2dcbc90b-f6f9-4f45-996d-4906b11fcebc tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 404 len: 111 microversion: 2.1 time: 0.035993 Apr 08 11:16:03.148645 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 129/252] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:03 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 11:16:03.215314 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ce2150ca-17c3-4455-848a-d354600a78e0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:03.223420 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ce2150ca-17c3-4455-848a-d354600a78e0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1520 microversion: 2.1 time: 0.170964 Apr 08 11:16:03.224002 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 124/253] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:03 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:03.312489 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-376935a8-cf54-4000-a49f-ba785af325fb tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:03.313423 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-376935a8-cf54-4000-a49f-ba785af325fb tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:03.320336 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-376935a8-cf54-4000-a49f-ba785af325fb tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:03.320336 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-376935a8-cf54-4000-a49f-ba785af325fb tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:03.320899 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-376935a8-cf54-4000-a49f-ba785af325fb tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:03.321337 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-376935a8-cf54-4000-a49f-ba785af325fb tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:03.336938 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.wsgi [None req-376935a8-cf54-4000-a49f-ba785af325fb tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] HTTP exception thrown: Instance 04fd539f-d648-4fd7-b824-351f408a0327 could not be found. Apr 08 11:16:03.337536 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-376935a8-cf54-4000-a49f-ba785af325fb tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Returning 404 to user: Instance 04fd539f-d648-4fd7-b824-351f408a0327 could not be found. {{(pid=117801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:16:03.338402 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-376935a8-cf54-4000-a49f-ba785af325fb tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.029914 Apr 08 11:16:03.338959 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 130/254] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:16:03 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327/os-volume_attachments => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 11:16:04.240788 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-39b202db-d484-4987-9e68-2289c9f0d057 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:04.241659 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-39b202db-d484-4987-9e68-2289c9f0d057 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:04.249605 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-39b202db-d484-4987-9e68-2289c9f0d057 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:04.251264 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-39b202db-d484-4987-9e68-2289c9f0d057 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:04.252753 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-39b202db-d484-4987-9e68-2289c9f0d057 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:04.253506 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-39b202db-d484-4987-9e68-2289c9f0d057 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:04.422669 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-39b202db-d484-4987-9e68-2289c9f0d057 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:04.433915 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-39b202db-d484-4987-9e68-2289c9f0d057 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1520 microversion: 2.1 time: 0.197203 Apr 08 11:16:04.434502 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 125/255] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:04 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:05.021940 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-735d19ae-d1d9-4f8e-aa7d-cbde9932fbde tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:05.022453 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-735d19ae-d1d9-4f8e-aa7d-cbde9932fbde tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:05.032084 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-735d19ae-d1d9-4f8e-aa7d-cbde9932fbde tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:05.033202 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-735d19ae-d1d9-4f8e-aa7d-cbde9932fbde tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:05.037972 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-735d19ae-d1d9-4f8e-aa7d-cbde9932fbde tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:05.038464 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-735d19ae-d1d9-4f8e-aa7d-cbde9932fbde tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:05.053584 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.wsgi [None req-735d19ae-d1d9-4f8e-aa7d-cbde9932fbde tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] HTTP exception thrown: Instance 04fd539f-d648-4fd7-b824-351f408a0327 could not be found. Apr 08 11:16:05.054006 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-735d19ae-d1d9-4f8e-aa7d-cbde9932fbde tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Returning 404 to user: Instance 04fd539f-d648-4fd7-b824-351f408a0327 could not be found. {{(pid=117801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:16:05.054845 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-735d19ae-d1d9-4f8e-aa7d-cbde9932fbde tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "DELETE /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 404 len: 111 microversion: 2.1 time: 0.037629 Apr 08 11:16:05.055684 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 131/256] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 8 11:16:05 2022] DELETE /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 11:16:05.063736 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e7a088c5-17b3-48e4-bcb6-832c4825d118 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:05.063736 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e7a088c5-17b3-48e4-bcb6-832c4825d118 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] [instance: 04fd539f-d648-4fd7-b824-351f408a0327] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:05.070792 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e7a088c5-17b3-48e4-bcb6-832c4825d118 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:05.071251 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e7a088c5-17b3-48e4-bcb6-832c4825d118 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:05.072029 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e7a088c5-17b3-48e4-bcb6-832c4825d118 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:05.072541 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e7a088c5-17b3-48e4-bcb6-832c4825d118 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:05.087021 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-e7a088c5-17b3-48e4-bcb6-832c4825d118 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] HTTP exception thrown: Instance 04fd539f-d648-4fd7-b824-351f408a0327 could not be found. Apr 08 11:16:05.087619 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e7a088c5-17b3-48e4-bcb6-832c4825d118 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] Returning 404 to user: Instance 04fd539f-d648-4fd7-b824-351f408a0327 could not be found. {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:16:05.088463 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e7a088c5-17b3-48e4-bcb6-832c4825d118 tempest-DeleteServersTestJSON-1729847374 tempest-DeleteServersTestJSON-1729847374-project] 10.222.0.46 "GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327" status: 404 len: 111 microversion: 2.1 time: 0.028756 Apr 08 11:16:05.089335 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 126/257] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:05 2022] GET /compute/v2.1/servers/04fd539f-d648-4fd7-b824-351f408a0327 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 11:16:05.450133 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-4eb7c3ee-4193-40dc-ba93-f235e085e82c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:05.450753 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-4eb7c3ee-4193-40dc-ba93-f235e085e82c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:05.456845 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4eb7c3ee-4193-40dc-ba93-f235e085e82c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:05.457307 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4eb7c3ee-4193-40dc-ba93-f235e085e82c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:05.458123 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4eb7c3ee-4193-40dc-ba93-f235e085e82c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:05.458574 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4eb7c3ee-4193-40dc-ba93-f235e085e82c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:05.829014 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-4eb7c3ee-4193-40dc-ba93-f235e085e82c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:05.836373 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-4eb7c3ee-4193-40dc-ba93-f235e085e82c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1520 microversion: 2.1 time: 0.390003 Apr 08 11:16:05.836959 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 132/258] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:05 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1520 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:06.854068 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-56825749-19d1-4a36-b7d6-8e335d90a942 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:06.854726 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-56825749-19d1-4a36-b7d6-8e335d90a942 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:06.861191 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-56825749-19d1-4a36-b7d6-8e335d90a942 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:06.861975 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-56825749-19d1-4a36-b7d6-8e335d90a942 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:06.862741 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-56825749-19d1-4a36-b7d6-8e335d90a942 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:06.863175 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-56825749-19d1-4a36-b7d6-8e335d90a942 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:07.025644 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-56825749-19d1-4a36-b7d6-8e335d90a942 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:07.034218 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-56825749-19d1-4a36-b7d6-8e335d90a942 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1500 microversion: 2.1 time: 0.183966 Apr 08 11:16:07.034809 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 127/259] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:06 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1500 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:07.051076 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-346a320f-dd7e-4b94-b07c-7b5a1f22890b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:07.052289 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-346a320f-dd7e-4b94-b07c-7b5a1f22890b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: ea2b616a-165e-4f06-9017-37a69bc2a874] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:07.059345 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-346a320f-dd7e-4b94-b07c-7b5a1f22890b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:07.059811 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-346a320f-dd7e-4b94-b07c-7b5a1f22890b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:07.060683 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-346a320f-dd7e-4b94-b07c-7b5a1f22890b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:07.065811 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-346a320f-dd7e-4b94-b07c-7b5a1f22890b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:07.225313 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-346a320f-dd7e-4b94-b07c-7b5a1f22890b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:07.233849 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-346a320f-dd7e-4b94-b07c-7b5a1f22890b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874" status: 200 len: 1515 microversion: 2.1 time: 0.186569 Apr 08 11:16:07.234625 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 133/260] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:07 2022] GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874 => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:10.584505 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-fc870b8c-5701-4bbe-825c-cbeee7598c41 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:16:10.585528 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-fc870b8c-5701-4bbe-825c-cbeee7598c41 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: ea2b616a-165e-4f06-9017-37a69bc2a874] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:10.593550 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fc870b8c-5701-4bbe-825c-cbeee7598c41 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:10.593550 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fc870b8c-5701-4bbe-825c-cbeee7598c41 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:10.594074 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fc870b8c-5701-4bbe-825c-cbeee7598c41 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:10.594174 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fc870b8c-5701-4bbe-825c-cbeee7598c41 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:10.620456 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-fc870b8c-5701-4bbe-825c-cbeee7598c41 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lazy-loading 'flavor' on Instance uuid ea2b616a-165e-4f06-9017-37a69bc2a874 {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 11:16:11.107594 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-fc870b8c-5701-4bbe-825c-cbeee7598c41 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "POST /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874/action" status: 200 len: 32 microversion: 2.1 time: 0.526952 Apr 08 11:16:11.107986 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 128/261] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Apr 8 11:16:10 2022] POST /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874/action => generated 32 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 11:16:11.121817 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-6656b9a4-0efd-46f1-8263-734e11e100d2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:11.123749 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-6656b9a4-0efd-46f1-8263-734e11e100d2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: ea2b616a-165e-4f06-9017-37a69bc2a874] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:11.132806 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6656b9a4-0efd-46f1-8263-734e11e100d2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:11.133680 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6656b9a4-0efd-46f1-8263-734e11e100d2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:11.134681 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6656b9a4-0efd-46f1-8263-734e11e100d2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:11.135748 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6656b9a4-0efd-46f1-8263-734e11e100d2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:11.347405 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6656b9a4-0efd-46f1-8263-734e11e100d2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:11.355244 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-6656b9a4-0efd-46f1-8263-734e11e100d2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874" status: 200 len: 1521 microversion: 2.1 time: 0.238843 Apr 08 11:16:11.355837 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 134/262] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:11 2022] GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:12.374426 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-add50e04-6ed3-482b-9e1f-4c5f7f072baf tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:12.375232 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-add50e04-6ed3-482b-9e1f-4c5f7f072baf tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: ea2b616a-165e-4f06-9017-37a69bc2a874] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:12.381407 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-add50e04-6ed3-482b-9e1f-4c5f7f072baf tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:12.381889 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-add50e04-6ed3-482b-9e1f-4c5f7f072baf tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:12.382665 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-add50e04-6ed3-482b-9e1f-4c5f7f072baf tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:12.389686 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-add50e04-6ed3-482b-9e1f-4c5f7f072baf tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:12.638058 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-add50e04-6ed3-482b-9e1f-4c5f7f072baf tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:12.649752 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-add50e04-6ed3-482b-9e1f-4c5f7f072baf tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874" status: 200 len: 1521 microversion: 2.1 time: 0.279570 Apr 08 11:16:12.673981 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 129/263] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:12 2022] GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874 => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:13.672922 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-7f1d1e98-8f8e-41d4-b341-17d240121971 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:13.672922 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-7f1d1e98-8f8e-41d4-b341-17d240121971 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: ea2b616a-165e-4f06-9017-37a69bc2a874] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:13.676288 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7f1d1e98-8f8e-41d4-b341-17d240121971 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:13.677581 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7f1d1e98-8f8e-41d4-b341-17d240121971 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:13.677581 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7f1d1e98-8f8e-41d4-b341-17d240121971 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:13.678010 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7f1d1e98-8f8e-41d4-b341-17d240121971 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:13.835873 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-7f1d1e98-8f8e-41d4-b341-17d240121971 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:13.844226 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-7f1d1e98-8f8e-41d4-b341-17d240121971 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874" status: 200 len: 1521 microversion: 2.1 time: 0.181156 Apr 08 11:16:13.844801 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 135/264] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:13 2022] GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:14.862960 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-745f6b83-2384-4b11-bce2-a5b303ec236c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:14.863581 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-745f6b83-2384-4b11-bce2-a5b303ec236c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: ea2b616a-165e-4f06-9017-37a69bc2a874] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:14.869863 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-745f6b83-2384-4b11-bce2-a5b303ec236c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:14.870312 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-745f6b83-2384-4b11-bce2-a5b303ec236c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:14.886103 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-745f6b83-2384-4b11-bce2-a5b303ec236c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:14.886103 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-745f6b83-2384-4b11-bce2-a5b303ec236c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:15.002535 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-745f6b83-2384-4b11-bce2-a5b303ec236c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:15.022931 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-745f6b83-2384-4b11-bce2-a5b303ec236c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874" status: 200 len: 1521 microversion: 2.1 time: 0.164255 Apr 08 11:16:15.023521 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 130/265] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:14 2022] GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:16.048142 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-ac0823d3-5a95-4f3c-b7db-19752c11691f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:16.048784 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-ac0823d3-5a95-4f3c-b7db-19752c11691f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: ea2b616a-165e-4f06-9017-37a69bc2a874] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:16.055178 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ac0823d3-5a95-4f3c-b7db-19752c11691f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:16.055628 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ac0823d3-5a95-4f3c-b7db-19752c11691f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:16.056405 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ac0823d3-5a95-4f3c-b7db-19752c11691f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:16.056838 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ac0823d3-5a95-4f3c-b7db-19752c11691f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:16.243235 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-ac0823d3-5a95-4f3c-b7db-19752c11691f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:16.255715 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-ac0823d3-5a95-4f3c-b7db-19752c11691f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874" status: 200 len: 1521 microversion: 2.1 time: 0.209904 Apr 08 11:16:16.257077 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 136/266] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:16 2022] GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:17.278293 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-cfbaf5f3-83f2-4ff4-a786-5e3aac32f8a0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:17.285272 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-cfbaf5f3-83f2-4ff4-a786-5e3aac32f8a0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: ea2b616a-165e-4f06-9017-37a69bc2a874] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:17.288347 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cfbaf5f3-83f2-4ff4-a786-5e3aac32f8a0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:17.288800 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cfbaf5f3-83f2-4ff4-a786-5e3aac32f8a0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:17.289590 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cfbaf5f3-83f2-4ff4-a786-5e3aac32f8a0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:17.290059 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cfbaf5f3-83f2-4ff4-a786-5e3aac32f8a0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:17.711778 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-cfbaf5f3-83f2-4ff4-a786-5e3aac32f8a0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:17.745572 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-cfbaf5f3-83f2-4ff4-a786-5e3aac32f8a0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874" status: 200 len: 1521 microversion: 2.1 time: 0.464873 Apr 08 11:16:17.745572 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 131/267] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:17 2022] GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874 => generated 1521 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:18.717615 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-4d60d359-e85b-41f0-ab48-f7a9f7436c2c tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1498274686", "imageRef": "35b8d8d2-a0e9-4c3e-8586-5e088dec27e6", "flavorRef": "452"}} {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:16:18.757728 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a3d0da97-fc40-43f5-91cb-adb645c7a317 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:18.759178 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a3d0da97-fc40-43f5-91cb-adb645c7a317 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: ea2b616a-165e-4f06-9017-37a69bc2a874] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:18.770037 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a3d0da97-fc40-43f5-91cb-adb645c7a317 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:18.770497 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a3d0da97-fc40-43f5-91cb-adb645c7a317 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:18.771318 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a3d0da97-fc40-43f5-91cb-adb645c7a317 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:18.771759 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a3d0da97-fc40-43f5-91cb-adb645c7a317 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:18.782641 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.network.neutron [None req-4d60d359-e85b-41f0-ab48-f7a9f7436c2c tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] validate_networks() for None {{(pid=117801) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 08 11:16:19.187546 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.virt.hardware [None req-4d60d359-e85b-41f0-ab48-f7a9f7436c2c tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Flavor limits 0:0:0 {{(pid=117801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 11:16:19.187928 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.virt.hardware [None req-4d60d359-e85b-41f0-ab48-f7a9f7436c2c tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Image limits 0:0:0 {{(pid=117801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 11:16:19.188604 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.virt.hardware [None req-4d60d359-e85b-41f0-ab48-f7a9f7436c2c tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Flavor pref 0:0:0 {{(pid=117801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 11:16:19.189183 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.virt.hardware [None req-4d60d359-e85b-41f0-ab48-f7a9f7436c2c tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Image pref 0:0:0 {{(pid=117801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 11:16:19.189625 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.virt.hardware [None req-4d60d359-e85b-41f0-ab48-f7a9f7436c2c tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 11:16:19.195174 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a3d0da97-fc40-43f5-91cb-adb645c7a317 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:19.201961 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4d60d359-e85b-41f0-ab48-f7a9f7436c2c tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:19.202598 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4d60d359-e85b-41f0-ab48-f7a9f7436c2c tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:19.203571 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4d60d359-e85b-41f0-ab48-f7a9f7436c2c tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:19.204669 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4d60d359-e85b-41f0-ab48-f7a9f7436c2c tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:19.205987 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a3d0da97-fc40-43f5-91cb-adb645c7a317 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874" status: 200 len: 1521 microversion: 2.1 time: 0.455433 Apr 08 11:16:19.206596 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 132/268] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:18 2022] GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874 => generated 1521 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:16:19.225380 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.quota [None req-4d60d359-e85b-41f0-ab48-f7a9f7436c2c tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Getting quotas for project 0def47b7e0a24d8585b9ed9f3af25862. Resources: {'instances', 'ram', 'cores'} {{(pid=117801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 11:16:19.230446 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.quota [None req-4d60d359-e85b-41f0-ab48-f7a9f7436c2c tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Getting quotas for user 3779860f60e940a180e1c49d2a67d51c and project 0def47b7e0a24d8585b9ed9f3af25862. Resources: {'instances', 'ram', 'cores'} {{(pid=117801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 11:16:19.247889 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-4d60d359-e85b-41f0-ab48-f7a9f7436c2c tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Going to run 1 instances... {{(pid=117801) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 08 11:16:19.250258 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-4d60d359-e85b-41f0-ab48-f7a9f7436c2c tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='35b8d8d2-a0e9-4c3e-8586-5e088dec27e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 08 11:16:19.379785 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-4d60d359-e85b-41f0-ab48-f7a9f7436c2c tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.666161 Apr 08 11:16:19.380441 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 137/269] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Apr 8 11:16:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 11:16:19.391581 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-cc9a246d-638a-4667-8c21-c16e53cef390 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:19.392416 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-cc9a246d-638a-4667-8c21-c16e53cef390 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:19.448075 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-cc9a246d-638a-4667-8c21-c16e53cef390 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:19.455426 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-cc9a246d-638a-4667-8c21-c16e53cef390 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1215 microversion: 2.1 time: 0.068777 Apr 08 11:16:19.456185 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 133/270] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:19 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1215 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:20.223459 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e05c7fb0-1243-40a1-abdf-2aaa0ae95003 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:20.224073 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e05c7fb0-1243-40a1-abdf-2aaa0ae95003 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: ea2b616a-165e-4f06-9017-37a69bc2a874] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:20.230682 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e05c7fb0-1243-40a1-abdf-2aaa0ae95003 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:20.231135 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e05c7fb0-1243-40a1-abdf-2aaa0ae95003 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:20.231933 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e05c7fb0-1243-40a1-abdf-2aaa0ae95003 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:20.232387 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e05c7fb0-1243-40a1-abdf-2aaa0ae95003 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:20.381185 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e05c7fb0-1243-40a1-abdf-2aaa0ae95003 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:20.391272 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e05c7fb0-1243-40a1-abdf-2aaa0ae95003 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874" status: 200 len: 1521 microversion: 2.1 time: 0.172090 Apr 08 11:16:20.391776 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 138/271] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:20 2022] GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:20.472286 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c5e50f5d-6e88-4eee-8672-99c0ebadcbfc tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:20.472921 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c5e50f5d-6e88-4eee-8672-99c0ebadcbfc tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:20.526941 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c5e50f5d-6e88-4eee-8672-99c0ebadcbfc tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:20.535113 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c5e50f5d-6e88-4eee-8672-99c0ebadcbfc tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1215 microversion: 2.1 time: 0.066689 Apr 08 11:16:20.535820 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 134/272] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:20 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1215 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:16:21.408743 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-6c5ada47-1101-4884-aab1-3f4ad5276a53 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:21.409471 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-6c5ada47-1101-4884-aab1-3f4ad5276a53 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: ea2b616a-165e-4f06-9017-37a69bc2a874] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:21.416115 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6c5ada47-1101-4884-aab1-3f4ad5276a53 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:21.416706 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6c5ada47-1101-4884-aab1-3f4ad5276a53 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:21.417880 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6c5ada47-1101-4884-aab1-3f4ad5276a53 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:21.418291 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6c5ada47-1101-4884-aab1-3f4ad5276a53 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:21.552232 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7d21ddc4-4e67-4c43-83f8-80da70264d54 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:21.552837 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7d21ddc4-4e67-4c43-83f8-80da70264d54 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:21.559590 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d21ddc4-4e67-4c43-83f8-80da70264d54 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:21.560045 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d21ddc4-4e67-4c43-83f8-80da70264d54 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:21.564463 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d21ddc4-4e67-4c43-83f8-80da70264d54 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:21.564463 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d21ddc4-4e67-4c43-83f8-80da70264d54 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:21.565219 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6c5ada47-1101-4884-aab1-3f4ad5276a53 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:21.573960 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-6c5ada47-1101-4884-aab1-3f4ad5276a53 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874" status: 200 len: 1521 microversion: 2.1 time: 0.169482 Apr 08 11:16:21.584547 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 139/273] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:21 2022] GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:21.628551 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7d21ddc4-4e67-4c43-83f8-80da70264d54 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:21.636120 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7d21ddc4-4e67-4c43-83f8-80da70264d54 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1219 microversion: 2.1 time: 0.087836 Apr 08 11:16:21.636999 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 135/274] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:21 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:22.592354 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-0e103a3b-22df-447c-a128-e6f6d05eef63 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:22.606209 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-0e103a3b-22df-447c-a128-e6f6d05eef63 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: ea2b616a-165e-4f06-9017-37a69bc2a874] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:22.606209 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0e103a3b-22df-447c-a128-e6f6d05eef63 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:22.606209 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0e103a3b-22df-447c-a128-e6f6d05eef63 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:22.606209 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0e103a3b-22df-447c-a128-e6f6d05eef63 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:22.606922 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0e103a3b-22df-447c-a128-e6f6d05eef63 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:22.656362 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1e7fab9c-7762-4e54-8893-5850065921c7 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:22.657165 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1e7fab9c-7762-4e54-8893-5850065921c7 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:22.663377 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1e7fab9c-7762-4e54-8893-5850065921c7 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:22.663890 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1e7fab9c-7762-4e54-8893-5850065921c7 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:22.666113 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1e7fab9c-7762-4e54-8893-5850065921c7 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:22.666570 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1e7fab9c-7762-4e54-8893-5850065921c7 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:22.740482 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1e7fab9c-7762-4e54-8893-5850065921c7 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:22.749326 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1e7fab9c-7762-4e54-8893-5850065921c7 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1219 microversion: 2.1 time: 0.100424 Apr 08 11:16:22.749948 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 136/275] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:22 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:22.782813 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-0e103a3b-22df-447c-a128-e6f6d05eef63 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:22.790592 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-0e103a3b-22df-447c-a128-e6f6d05eef63 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874" status: 200 len: 1521 microversion: 2.1 time: 0.203082 Apr 08 11:16:22.791177 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 140/276] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:22 2022] GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:23.767858 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-caa648dd-5b6d-4cea-985f-254fc91a32b1 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:23.768477 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-caa648dd-5b6d-4cea-985f-254fc91a32b1 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:23.775107 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-caa648dd-5b6d-4cea-985f-254fc91a32b1 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:23.775738 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-caa648dd-5b6d-4cea-985f-254fc91a32b1 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:23.776868 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-caa648dd-5b6d-4cea-985f-254fc91a32b1 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:23.777527 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-caa648dd-5b6d-4cea-985f-254fc91a32b1 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:23.806867 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-429396cc-5240-4bfa-86d0-5776971abb40 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:23.807569 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-429396cc-5240-4bfa-86d0-5776971abb40 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: ea2b616a-165e-4f06-9017-37a69bc2a874] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:23.818244 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-429396cc-5240-4bfa-86d0-5776971abb40 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:23.818764 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-429396cc-5240-4bfa-86d0-5776971abb40 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:23.820112 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-429396cc-5240-4bfa-86d0-5776971abb40 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:23.822531 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-429396cc-5240-4bfa-86d0-5776971abb40 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:23.869626 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-caa648dd-5b6d-4cea-985f-254fc91a32b1 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:23.877810 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-caa648dd-5b6d-4cea-985f-254fc91a32b1 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1219 microversion: 2.1 time: 0.113565 Apr 08 11:16:23.878031 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 137/277] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:23 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1219 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:23.979610 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-429396cc-5240-4bfa-86d0-5776971abb40 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:23.989030 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-429396cc-5240-4bfa-86d0-5776971abb40 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874" status: 200 len: 1521 microversion: 2.1 time: 0.185896 Apr 08 11:16:23.989618 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 141/278] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:23 2022] GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:16:24.894039 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-37d5a97e-ce75-4455-859c-2cdde9453a53 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:24.894701 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-37d5a97e-ce75-4455-859c-2cdde9453a53 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:24.902694 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-37d5a97e-ce75-4455-859c-2cdde9453a53 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:24.903214 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-37d5a97e-ce75-4455-859c-2cdde9453a53 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:24.904705 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-37d5a97e-ce75-4455-859c-2cdde9453a53 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:24.905153 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-37d5a97e-ce75-4455-859c-2cdde9453a53 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:24.990140 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-37d5a97e-ce75-4455-859c-2cdde9453a53 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:25.002930 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-37d5a97e-ce75-4455-859c-2cdde9453a53 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1211 microversion: 2.1 time: 0.108603 Apr 08 11:16:25.003722 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 138/279] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:24 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1211 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:25.006421 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-ebd8a20e-2fc4-4072-90f3-919d502c2dfe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:25.007153 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-ebd8a20e-2fc4-4072-90f3-919d502c2dfe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: ea2b616a-165e-4f06-9017-37a69bc2a874] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:25.014957 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ebd8a20e-2fc4-4072-90f3-919d502c2dfe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:25.015697 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ebd8a20e-2fc4-4072-90f3-919d502c2dfe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:25.021823 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ebd8a20e-2fc4-4072-90f3-919d502c2dfe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:25.030230 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ebd8a20e-2fc4-4072-90f3-919d502c2dfe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:25.209372 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-ebd8a20e-2fc4-4072-90f3-919d502c2dfe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:25.209372 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-ebd8a20e-2fc4-4072-90f3-919d502c2dfe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874" status: 200 len: 1521 microversion: 2.1 time: 0.203430 Apr 08 11:16:25.209372 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 142/280] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:25 2022] GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:16:26.020590 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-87f79224-f7e9-4e13-981d-9e6f01ae476e tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:26.021180 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-87f79224-f7e9-4e13-981d-9e6f01ae476e tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:26.027247 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-87f79224-f7e9-4e13-981d-9e6f01ae476e tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:26.027780 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-87f79224-f7e9-4e13-981d-9e6f01ae476e tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:26.028628 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-87f79224-f7e9-4e13-981d-9e6f01ae476e tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:26.029168 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-87f79224-f7e9-4e13-981d-9e6f01ae476e tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:26.098008 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-87f79224-f7e9-4e13-981d-9e6f01ae476e tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:26.105795 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-87f79224-f7e9-4e13-981d-9e6f01ae476e tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1267 microversion: 2.1 time: 0.089071 Apr 08 11:16:26.106419 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 139/281] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:26 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1267 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:26.230486 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-6a977db2-65d8-4cc9-8a1d-9535a98e3c33 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:26.231335 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-6a977db2-65d8-4cc9-8a1d-9535a98e3c33 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: ea2b616a-165e-4f06-9017-37a69bc2a874] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:26.239504 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6a977db2-65d8-4cc9-8a1d-9535a98e3c33 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:26.240038 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6a977db2-65d8-4cc9-8a1d-9535a98e3c33 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:26.240992 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6a977db2-65d8-4cc9-8a1d-9535a98e3c33 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:26.241751 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6a977db2-65d8-4cc9-8a1d-9535a98e3c33 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:26.425246 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6a977db2-65d8-4cc9-8a1d-9535a98e3c33 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:26.433143 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-6a977db2-65d8-4cc9-8a1d-9535a98e3c33 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874" status: 200 len: 1501 microversion: 2.1 time: 0.211347 Apr 08 11:16:26.433727 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 143/282] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:26 2022] GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874 => generated 1501 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:26.459636 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-71ec296e-76d2-49a2-b05e-e64a9e87b2b7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b100e7e2-d637-4af0-afc1-61aa9f8e76b4"}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:16:26.462042 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-71ec296e-76d2-49a2-b05e-e64a9e87b2b7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: ea2b616a-165e-4f06-9017-37a69bc2a874] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:26.472100 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-71ec296e-76d2-49a2-b05e-e64a9e87b2b7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:26.474191 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-71ec296e-76d2-49a2-b05e-e64a9e87b2b7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:26.475288 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-71ec296e-76d2-49a2-b05e-e64a9e87b2b7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:26.475900 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-71ec296e-76d2-49a2-b05e-e64a9e87b2b7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:26.516750 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-71ec296e-76d2-49a2-b05e-e64a9e87b2b7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] HTTP exception thrown: Cannot 'attach_volume' instance ea2b616a-165e-4f06-9017-37a69bc2a874 while it is in vm_state rescued Apr 08 11:16:26.517830 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-71ec296e-76d2-49a2-b05e-e64a9e87b2b7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Returning 409 to user: Cannot 'attach_volume' instance ea2b616a-165e-4f06-9017-37a69bc2a874 while it is in vm_state rescued {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:16:26.518910 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-71ec296e-76d2-49a2-b05e-e64a9e87b2b7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "POST /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.064813 Apr 08 11:16:26.523551 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 140/283] 10.222.0.46 () {60 vars in 1322 bytes} [Fri Apr 8 11:16:26 2022] POST /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874/os-volume_attachments => generated 152 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 08 11:16:26.528894 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-dbd1874a-1c27-48f3-a97d-8eddabf4a685 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:16:26.530287 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-dbd1874a-1c27-48f3-a97d-8eddabf4a685 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: ea2b616a-165e-4f06-9017-37a69bc2a874] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:26.540000 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dbd1874a-1c27-48f3-a97d-8eddabf4a685 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:26.540438 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dbd1874a-1c27-48f3-a97d-8eddabf4a685 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:26.541224 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dbd1874a-1c27-48f3-a97d-8eddabf4a685 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:26.541654 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dbd1874a-1c27-48f3-a97d-8eddabf4a685 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:26.830652 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-dbd1874a-1c27-48f3-a97d-8eddabf4a685 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "POST /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874/action" status: 202 len: 0 microversion: 2.1 time: 0.305158 Apr 08 11:16:26.833017 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 144/284] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Apr 8 11:16:26 2022] POST /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 11:16:26.844410 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d47801c5-d59c-408f-a77c-83a54080a4e5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:26.852781 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d47801c5-d59c-408f-a77c-83a54080a4e5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: ea2b616a-165e-4f06-9017-37a69bc2a874] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:26.855616 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d47801c5-d59c-408f-a77c-83a54080a4e5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:26.857156 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d47801c5-d59c-408f-a77c-83a54080a4e5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:26.859359 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d47801c5-d59c-408f-a77c-83a54080a4e5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:26.860062 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d47801c5-d59c-408f-a77c-83a54080a4e5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:27.135580 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d47801c5-d59c-408f-a77c-83a54080a4e5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:27.138570 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-f5e38821-a91f-43f5-a3ad-1b3364d8be56 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:27.144418 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-f5e38821-a91f-43f5-a3ad-1b3364d8be56 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:27.149759 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d47801c5-d59c-408f-a77c-83a54080a4e5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874" status: 200 len: 1509 microversion: 2.1 time: 0.312323 Apr 08 11:16:27.173874 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 141/285] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:26 2022] GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874 => generated 1509 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:27.175512 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f5e38821-a91f-43f5-a3ad-1b3364d8be56 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:27.175512 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f5e38821-a91f-43f5-a3ad-1b3364d8be56 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:27.175512 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f5e38821-a91f-43f5-a3ad-1b3364d8be56 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:27.175512 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f5e38821-a91f-43f5-a3ad-1b3364d8be56 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:27.419324 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f5e38821-a91f-43f5-a3ad-1b3364d8be56 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:27.427353 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-f5e38821-a91f-43f5-a3ad-1b3364d8be56 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1285 microversion: 2.1 time: 0.307140 Apr 08 11:16:27.438153 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 145/286] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:27 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1285 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:28.200502 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5d3e1413-2b5c-4e78-b834-9784622c7dc4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:28.200502 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5d3e1413-2b5c-4e78-b834-9784622c7dc4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: ea2b616a-165e-4f06-9017-37a69bc2a874] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:28.200502 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5d3e1413-2b5c-4e78-b834-9784622c7dc4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:28.200502 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5d3e1413-2b5c-4e78-b834-9784622c7dc4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:28.201284 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5d3e1413-2b5c-4e78-b834-9784622c7dc4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:28.201284 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5d3e1413-2b5c-4e78-b834-9784622c7dc4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:28.451494 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-c664f702-432c-42cb-9ffa-cd16419dcfd7 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:28.452220 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-c664f702-432c-42cb-9ffa-cd16419dcfd7 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:28.466511 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c664f702-432c-42cb-9ffa-cd16419dcfd7 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:28.467284 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c664f702-432c-42cb-9ffa-cd16419dcfd7 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:28.480813 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c664f702-432c-42cb-9ffa-cd16419dcfd7 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:28.481540 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c664f702-432c-42cb-9ffa-cd16419dcfd7 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:28.756784 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5d3e1413-2b5c-4e78-b834-9784622c7dc4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:28.780806 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5d3e1413-2b5c-4e78-b834-9784622c7dc4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874" status: 200 len: 1509 microversion: 2.1 time: 0.601022 Apr 08 11:16:28.782135 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 142/287] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:28 2022] GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874 => generated 1509 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:28.882262 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-c664f702-432c-42cb-9ffa-cd16419dcfd7 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:28.896504 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-c664f702-432c-42cb-9ffa-cd16419dcfd7 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1315 microversion: 2.1 time: 0.447606 Apr 08 11:16:28.898004 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 146/288] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:28 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1315 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:29.806222 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d39b2ec1-e787-4edf-9fcb-63ce781605b4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:29.806222 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d39b2ec1-e787-4edf-9fcb-63ce781605b4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: ea2b616a-165e-4f06-9017-37a69bc2a874] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:29.816355 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d39b2ec1-e787-4edf-9fcb-63ce781605b4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:29.817335 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d39b2ec1-e787-4edf-9fcb-63ce781605b4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:29.819403 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d39b2ec1-e787-4edf-9fcb-63ce781605b4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:29.822740 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d39b2ec1-e787-4edf-9fcb-63ce781605b4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:29.915819 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a09a1333-8c0f-4378-8f6e-7cd54c9f4429 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:29.916427 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a09a1333-8c0f-4378-8f6e-7cd54c9f4429 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:29.925015 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a09a1333-8c0f-4378-8f6e-7cd54c9f4429 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:29.925700 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a09a1333-8c0f-4378-8f6e-7cd54c9f4429 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:29.927273 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a09a1333-8c0f-4378-8f6e-7cd54c9f4429 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:29.927970 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a09a1333-8c0f-4378-8f6e-7cd54c9f4429 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:30.325253 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a09a1333-8c0f-4378-8f6e-7cd54c9f4429 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:30.335560 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a09a1333-8c0f-4378-8f6e-7cd54c9f4429 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1315 microversion: 2.1 time: 0.424652 Apr 08 11:16:30.337326 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 147/289] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:29 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:16:30.397343 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d39b2ec1-e787-4edf-9fcb-63ce781605b4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:30.417801 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d39b2ec1-e787-4edf-9fcb-63ce781605b4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874" status: 200 len: 1509 microversion: 2.1 time: 0.619138 Apr 08 11:16:30.421877 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 143/290] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:29 2022] GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874 => generated 1509 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:30.620599 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [req-e8046b06-8d7e-48c9-94fb-6e31749bd82d req-dcbf68a7-436f-4b32-aef1-f2937a7b21f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6001f4a-0a64-4a61-9196-30bfa668c472", "tag": "a1ed26a2-5e99-445b-82c9-5cb7ed16c345"}]} {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:16:30.637965 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-e8046b06-8d7e-48c9-94fb-6e31749bd82d req-dcbf68a7-436f-4b32-aef1-f2937a7b21f4 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:30.642083 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-e8046b06-8d7e-48c9-94fb-6e31749bd82d req-dcbf68a7-436f-4b32-aef1-f2937a7b21f4 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:30.668175 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.compute.server_external_events [req-e8046b06-8d7e-48c9-94fb-6e31749bd82d req-dcbf68a7-436f-4b32-aef1-f2937a7b21f4 service nova] Creating event network-changed:a1ed26a2-5e99-445b-82c9-5cb7ed16c345 for instance b6001f4a-0a64-4a61-9196-30bfa668c472 on hv-cinder-83607 Apr 08 11:16:30.687521 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [req-e8046b06-8d7e-48c9-94fb-6e31749bd82d req-dcbf68a7-436f-4b32-aef1-f2937a7b21f4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071440 Apr 08 11:16:30.701524 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 148/291] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:16:31.353712 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e5205f8f-fcfa-4e85-b75c-a1b388ea4bab tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:31.354387 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e5205f8f-fcfa-4e85-b75c-a1b388ea4bab tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:31.362144 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e5205f8f-fcfa-4e85-b75c-a1b388ea4bab tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:31.363140 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e5205f8f-fcfa-4e85-b75c-a1b388ea4bab tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:31.364114 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e5205f8f-fcfa-4e85-b75c-a1b388ea4bab tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:31.364615 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e5205f8f-fcfa-4e85-b75c-a1b388ea4bab tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:31.439674 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-dbd685f3-f885-487f-abb1-fba1267d2d8f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:31.440337 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-dbd685f3-f885-487f-abb1-fba1267d2d8f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: ea2b616a-165e-4f06-9017-37a69bc2a874] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:31.450307 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dbd685f3-f885-487f-abb1-fba1267d2d8f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:31.451074 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dbd685f3-f885-487f-abb1-fba1267d2d8f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:31.451879 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dbd685f3-f885-487f-abb1-fba1267d2d8f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:31.452316 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dbd685f3-f885-487f-abb1-fba1267d2d8f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:31.719363 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-dbd685f3-f885-487f-abb1-fba1267d2d8f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:31.728444 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e5205f8f-fcfa-4e85-b75c-a1b388ea4bab tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:31.731168 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-dbd685f3-f885-487f-abb1-fba1267d2d8f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874" status: 200 len: 1509 microversion: 2.1 time: 0.296759 Apr 08 11:16:31.738203 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e5205f8f-fcfa-4e85-b75c-a1b388ea4bab tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1315 microversion: 2.1 time: 0.388163 Apr 08 11:16:31.738897 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 149/292] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:31 2022] GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874 => generated 1509 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:16:31.741021 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 144/293] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:31 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:32.753299 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-b2e5386b-2e5e-453b-b8e9-5210cbbfcf17 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:32.754124 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-b2e5386b-2e5e-453b-b8e9-5210cbbfcf17 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: ea2b616a-165e-4f06-9017-37a69bc2a874] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:32.760911 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3aacbe0a-4eb6-4e1b-9afb-07c595b7ebd6 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:32.763634 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b2e5386b-2e5e-453b-b8e9-5210cbbfcf17 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:32.764242 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b2e5386b-2e5e-453b-b8e9-5210cbbfcf17 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:32.765281 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b2e5386b-2e5e-453b-b8e9-5210cbbfcf17 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:32.766167 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b2e5386b-2e5e-453b-b8e9-5210cbbfcf17 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:32.767362 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3aacbe0a-4eb6-4e1b-9afb-07c595b7ebd6 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:32.799759 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3aacbe0a-4eb6-4e1b-9afb-07c595b7ebd6 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:32.800233 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3aacbe0a-4eb6-4e1b-9afb-07c595b7ebd6 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:32.801051 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3aacbe0a-4eb6-4e1b-9afb-07c595b7ebd6 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:32.805495 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3aacbe0a-4eb6-4e1b-9afb-07c595b7ebd6 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:33.024759 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b2e5386b-2e5e-453b-b8e9-5210cbbfcf17 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:33.037330 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-b2e5386b-2e5e-453b-b8e9-5210cbbfcf17 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874" status: 200 len: 1515 microversion: 2.1 time: 0.290854 Apr 08 11:16:33.043310 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 150/294] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:32 2022] GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874 => generated 1515 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:33.057546 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3aacbe0a-4eb6-4e1b-9afb-07c595b7ebd6 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:33.069563 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3aacbe0a-4eb6-4e1b-9afb-07c595b7ebd6 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1315 microversion: 2.1 time: 0.317062 Apr 08 11:16:33.074148 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 145/295] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:32 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:16:34.094913 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-01c33bf0-9f34-45d9-89c5-20f29b0959e1 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:34.095793 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-01c33bf0-9f34-45d9-89c5-20f29b0959e1 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:34.109708 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-01c33bf0-9f34-45d9-89c5-20f29b0959e1 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:34.110183 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-01c33bf0-9f34-45d9-89c5-20f29b0959e1 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:34.119583 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-01c33bf0-9f34-45d9-89c5-20f29b0959e1 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:34.120160 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-01c33bf0-9f34-45d9-89c5-20f29b0959e1 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:34.342769 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-01c33bf0-9f34-45d9-89c5-20f29b0959e1 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:34.350746 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-01c33bf0-9f34-45d9-89c5-20f29b0959e1 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1315 microversion: 2.1 time: 0.265538 Apr 08 11:16:34.351402 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 151/296] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:34 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:35.368868 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1ec75ad0-3290-4602-8194-ff1d3c849398 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:35.373337 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1ec75ad0-3290-4602-8194-ff1d3c849398 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:35.385125 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ec75ad0-3290-4602-8194-ff1d3c849398 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:35.386090 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ec75ad0-3290-4602-8194-ff1d3c849398 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:35.390013 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ec75ad0-3290-4602-8194-ff1d3c849398 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:35.390565 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ec75ad0-3290-4602-8194-ff1d3c849398 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:35.616301 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1ec75ad0-3290-4602-8194-ff1d3c849398 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:35.628072 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1ec75ad0-3290-4602-8194-ff1d3c849398 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1315 microversion: 2.1 time: 0.263808 Apr 08 11:16:35.629372 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 146/297] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:35 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:36.154701 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a9b33fa5-38ff-42b9-8ce6-a7edc695a322 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Action: 'create', calling method: .version_select at 0x7f041efe6940>, body: {"keypair": {"name": "tempest-keypair-2100088169"}} {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:16:36.172879 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.quota [None req-a9b33fa5-38ff-42b9-8ce6-a7edc695a322 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Getting quotas for project 53fe2dc297a34f0281e7a165efea5957. Resources: {'key_pairs'} {{(pid=117801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 11:16:36.180109 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.quota [None req-a9b33fa5-38ff-42b9-8ce6-a7edc695a322 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Getting quotas for user 6b5bdfdda63241d284449c6b2ec5c46b and project 53fe2dc297a34f0281e7a165efea5957. Resources: {'key_pairs'} {{(pid=117801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 11:16:36.487751 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.quota [None req-a9b33fa5-38ff-42b9-8ce6-a7edc695a322 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Getting quotas for project 53fe2dc297a34f0281e7a165efea5957. Resources: {'key_pairs'} {{(pid=117801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 11:16:36.495507 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.quota [None req-a9b33fa5-38ff-42b9-8ce6-a7edc695a322 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Getting quotas for user 6b5bdfdda63241d284449c6b2ec5c46b and project 53fe2dc297a34f0281e7a165efea5957. Resources: {'key_pairs'} {{(pid=117801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 11:16:36.519373 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a9b33fa5-38ff-42b9-8ce6-a7edc695a322 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.371690 Apr 08 11:16:36.519964 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 152/298] 10.222.0.46 () {60 vars in 1157 bytes} [Fri Apr 8 11:16:36 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:36.649798 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-230552de-c7ff-496b-bde1-39c7f8a1e0ae tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:36.651213 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-230552de-c7ff-496b-bde1-39c7f8a1e0ae tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:36.674374 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-230552de-c7ff-496b-bde1-39c7f8a1e0ae tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:36.675944 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-230552de-c7ff-496b-bde1-39c7f8a1e0ae tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:36.677709 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-230552de-c7ff-496b-bde1-39c7f8a1e0ae tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:36.681358 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-230552de-c7ff-496b-bde1-39c7f8a1e0ae tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:36.935165 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-230552de-c7ff-496b-bde1-39c7f8a1e0ae tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:36.960055 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-230552de-c7ff-496b-bde1-39c7f8a1e0ae tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1315 microversion: 2.1 time: 0.317193 Apr 08 11:16:36.961088 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 147/299] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:36 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:37.979614 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-68979e5a-b01e-4a35-911a-bc8c675fae98 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:37.981149 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-68979e5a-b01e-4a35-911a-bc8c675fae98 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:37.994444 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-68979e5a-b01e-4a35-911a-bc8c675fae98 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:37.995045 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-68979e5a-b01e-4a35-911a-bc8c675fae98 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:37.997985 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-68979e5a-b01e-4a35-911a-bc8c675fae98 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:37.998648 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-68979e5a-b01e-4a35-911a-bc8c675fae98 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:38.349116 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-68979e5a-b01e-4a35-911a-bc8c675fae98 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:38.356246 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-68979e5a-b01e-4a35-911a-bc8c675fae98 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1315 microversion: 2.1 time: 0.382519 Apr 08 11:16:38.369994 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 153/300] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:37 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1315 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:39.380081 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bd2c9ea3-7f14-4b48-9422-27113493c8d2 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:39.381402 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-bd2c9ea3-7f14-4b48-9422-27113493c8d2 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:39.390267 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bd2c9ea3-7f14-4b48-9422-27113493c8d2 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:39.391130 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bd2c9ea3-7f14-4b48-9422-27113493c8d2 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:39.392665 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bd2c9ea3-7f14-4b48-9422-27113493c8d2 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:39.393536 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bd2c9ea3-7f14-4b48-9422-27113493c8d2 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:39.680612 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-bd2c9ea3-7f14-4b48-9422-27113493c8d2 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:39.689903 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-bd2c9ea3-7f14-4b48-9422-27113493c8d2 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1315 microversion: 2.1 time: 0.316539 Apr 08 11:16:39.690814 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 148/301] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:39 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:40.026563 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-21650fde-8373-4f30-8523-4bb93366373f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-747287987", "imageRef": "35b8d8d2-a0e9-4c3e-8586-5e088dec27e6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c130d358-962f-43d2-8806-6bdc4416af3f"}], "security_groups": [{"name": "tempest-securitygroup--1010397129"}], "key_name": "tempest-keypair-2100088169", "user_data": "}} {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:16:40.243391 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.network.neutron [None req-21650fde-8373-4f30-8523-4bb93366373f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] validate_networks() for [('c130d358-962f-43d2-8806-6bdc4416af3f', None, None, None, None, None)] {{(pid=117801) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 08 11:16:40.750633 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.virt.hardware [None req-21650fde-8373-4f30-8523-4bb93366373f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Flavor limits 0:0:0 {{(pid=117801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 11:16:40.751951 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.virt.hardware [None req-21650fde-8373-4f30-8523-4bb93366373f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Image limits 0:0:0 {{(pid=117801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 11:16:40.753036 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.virt.hardware [None req-21650fde-8373-4f30-8523-4bb93366373f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Flavor pref 0:0:0 {{(pid=117801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 11:16:40.753680 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.virt.hardware [None req-21650fde-8373-4f30-8523-4bb93366373f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Image pref 0:0:0 {{(pid=117801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 11:16:40.754280 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.virt.hardware [None req-21650fde-8373-4f30-8523-4bb93366373f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 11:16:40.766611 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-21650fde-8373-4f30-8523-4bb93366373f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:40.767701 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-21650fde-8373-4f30-8523-4bb93366373f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:40.769144 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-21650fde-8373-4f30-8523-4bb93366373f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:40.769790 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-21650fde-8373-4f30-8523-4bb93366373f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:40.790554 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.quota [None req-21650fde-8373-4f30-8523-4bb93366373f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Getting quotas for project 53fe2dc297a34f0281e7a165efea5957. Resources: {'instances', 'ram', 'cores'} {{(pid=117801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 11:16:40.791220 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4d533d1d-2f7b-435d-888c-1b447b7859a4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Action: 'create', calling method: .version_select at 0x7f042410a430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-237000854"}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:16:40.795457 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.quota [None req-21650fde-8373-4f30-8523-4bb93366373f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Getting quotas for user 6b5bdfdda63241d284449c6b2ec5c46b and project 53fe2dc297a34f0281e7a165efea5957. Resources: {'instances', 'ram', 'cores'} {{(pid=117801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 11:16:40.806994 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-21650fde-8373-4f30-8523-4bb93366373f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Going to run 1 instances... {{(pid=117801) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 08 11:16:40.809332 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-21650fde-8373-4f30-8523-4bb93366373f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='35b8d8d2-a0e9-4c3e-8586-5e088dec27e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 08 11:16:40.810031 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-4d533d1d-2f7b-435d-888c-1b447b7859a4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Getting quotas for project 925fd2ad2f3946e688dbe1a4c4068db9. Resources: {'key_pairs'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 11:16:40.814088 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-4d533d1d-2f7b-435d-888c-1b447b7859a4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Getting quotas for user 4fa60dc2a9994faab01551d6bc7c62b9 and project 925fd2ad2f3946e688dbe1a4c4068db9. Resources: {'key_pairs'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 11:16:40.985442 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-21650fde-8373-4f30-8523-4bb93366373f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.966673 Apr 08 11:16:40.992314 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 154/302] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Apr 8 11:16:40 2022] POST /compute/v2.1/servers => generated 409 bytes in 969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 11:16:40.992314 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-f179b4cc-c625-4b92-8f60-eb073102f575 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:40.992314 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-f179b4cc-c625-4b92-8f60-eb073102f575 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:41.001000 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f179b4cc-c625-4b92-8f60-eb073102f575 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:41.001645 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f179b4cc-c625-4b92-8f60-eb073102f575 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:41.003231 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f179b4cc-c625-4b92-8f60-eb073102f575 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:41.003872 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f179b4cc-c625-4b92-8f60-eb073102f575 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:41.166022 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f179b4cc-c625-4b92-8f60-eb073102f575 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:41.175542 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-f179b4cc-c625-4b92-8f60-eb073102f575 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1315 microversion: 2.1 time: 0.187739 Apr 08 11:16:41.175737 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-4d533d1d-2f7b-435d-888c-1b447b7859a4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Getting quotas for project 925fd2ad2f3946e688dbe1a4c4068db9. Resources: {'key_pairs'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 11:16:41.176120 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 155/303] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:40 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:41.180404 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-4d533d1d-2f7b-435d-888c-1b447b7859a4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Getting quotas for user 4fa60dc2a9994faab01551d6bc7c62b9 and project 925fd2ad2f3946e688dbe1a4c4068db9. Resources: {'key_pairs'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 11:16:41.182107 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-c6544ef2-b930-4c8a-94f4-26aaaa884e58 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:41.182912 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-c6544ef2-b930-4c8a-94f4-26aaaa884e58 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:41.200220 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4d533d1d-2f7b-435d-888c-1b447b7859a4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.667116 Apr 08 11:16:41.213581 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 149/304] 10.222.0.46 () {60 vars in 1157 bytes} [Fri Apr 8 11:16:40 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:41.240455 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-c6544ef2-b930-4c8a-94f4-26aaaa884e58 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:41.248531 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-c6544ef2-b930-4c8a-94f4-26aaaa884e58 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1245 microversion: 2.1 time: 0.071018 Apr 08 11:16:41.257930 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 156/305] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:41 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1245 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:42.200442 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3314aa19-f47d-4509-95de-1d850c76f4ee tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:42.200442 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3314aa19-f47d-4509-95de-1d850c76f4ee tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:42.206744 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3314aa19-f47d-4509-95de-1d850c76f4ee tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:42.207308 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3314aa19-f47d-4509-95de-1d850c76f4ee tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:42.208018 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3314aa19-f47d-4509-95de-1d850c76f4ee tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:42.208462 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3314aa19-f47d-4509-95de-1d850c76f4ee tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:42.275405 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-1e45df59-8e39-4b9d-a528-60fe06d33ed1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:42.276027 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-1e45df59-8e39-4b9d-a528-60fe06d33ed1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:42.287841 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1e45df59-8e39-4b9d-a528-60fe06d33ed1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:42.288368 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1e45df59-8e39-4b9d-a528-60fe06d33ed1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:42.289320 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1e45df59-8e39-4b9d-a528-60fe06d33ed1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:42.290038 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1e45df59-8e39-4b9d-a528-60fe06d33ed1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:42.375543 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1e45df59-8e39-4b9d-a528-60fe06d33ed1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:42.389438 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-1e45df59-8e39-4b9d-a528-60fe06d33ed1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1249 microversion: 2.1 time: 0.118434 Apr 08 11:16:42.395350 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 157/306] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:42 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1249 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:16:42.415333 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3314aa19-f47d-4509-95de-1d850c76f4ee tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:42.425902 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3314aa19-f47d-4509-95de-1d850c76f4ee tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1315 microversion: 2.1 time: 0.234606 Apr 08 11:16:42.426733 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 150/307] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:42 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:43.413439 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-5094fbcb-b0fe-4a19-ae53-b6039173daed tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:43.416319 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-5094fbcb-b0fe-4a19-ae53-b6039173daed tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:43.426381 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5094fbcb-b0fe-4a19-ae53-b6039173daed tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:43.429211 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5094fbcb-b0fe-4a19-ae53-b6039173daed tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:43.429211 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5094fbcb-b0fe-4a19-ae53-b6039173daed tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:43.429211 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5094fbcb-b0fe-4a19-ae53-b6039173daed tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:43.447317 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-966281fa-fb34-4bd6-800c-9f943b739300 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:43.448563 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-966281fa-fb34-4bd6-800c-9f943b739300 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:43.466310 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-966281fa-fb34-4bd6-800c-9f943b739300 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:43.467650 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-966281fa-fb34-4bd6-800c-9f943b739300 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:43.474331 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-966281fa-fb34-4bd6-800c-9f943b739300 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:43.474777 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-966281fa-fb34-4bd6-800c-9f943b739300 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:43.534495 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-5094fbcb-b0fe-4a19-ae53-b6039173daed tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:43.543787 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-5094fbcb-b0fe-4a19-ae53-b6039173daed tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1249 microversion: 2.1 time: 0.136406 Apr 08 11:16:43.554073 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 158/308] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:43 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1249 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:43.714095 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-966281fa-fb34-4bd6-800c-9f943b739300 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:43.724159 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-966281fa-fb34-4bd6-800c-9f943b739300 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1315 microversion: 2.1 time: 0.284607 Apr 08 11:16:43.724755 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 151/309] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:43 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:16:44.562720 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-db7b6b71-c5af-45e4-9e39-89855ffd4f39 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:44.563677 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-db7b6b71-c5af-45e4-9e39-89855ffd4f39 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:44.574889 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-db7b6b71-c5af-45e4-9e39-89855ffd4f39 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:44.575427 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-db7b6b71-c5af-45e4-9e39-89855ffd4f39 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:44.576752 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-db7b6b71-c5af-45e4-9e39-89855ffd4f39 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:44.577196 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-db7b6b71-c5af-45e4-9e39-89855ffd4f39 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:44.653264 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-db7b6b71-c5af-45e4-9e39-89855ffd4f39 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:44.662762 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-db7b6b71-c5af-45e4-9e39-89855ffd4f39 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1249 microversion: 2.1 time: 0.105667 Apr 08 11:16:44.663614 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 159/310] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:44 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1249 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:44.741899 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9045a18f-35c3-416d-a6cb-ea2bcd0c0cbe tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:44.742528 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9045a18f-35c3-416d-a6cb-ea2bcd0c0cbe tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:44.752143 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9045a18f-35c3-416d-a6cb-ea2bcd0c0cbe tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:44.752612 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9045a18f-35c3-416d-a6cb-ea2bcd0c0cbe tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:44.753418 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9045a18f-35c3-416d-a6cb-ea2bcd0c0cbe tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:44.753900 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9045a18f-35c3-416d-a6cb-ea2bcd0c0cbe tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:44.913477 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9045a18f-35c3-416d-a6cb-ea2bcd0c0cbe tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:44.923854 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9045a18f-35c3-416d-a6cb-ea2bcd0c0cbe tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1315 microversion: 2.1 time: 0.186100 Apr 08 11:16:44.924514 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 152/311] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:44 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:45.681069 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e223e9e6-34fb-497a-b68b-0aacd3a9fb9b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:45.681968 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e223e9e6-34fb-497a-b68b-0aacd3a9fb9b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:45.688991 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e223e9e6-34fb-497a-b68b-0aacd3a9fb9b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:45.689785 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e223e9e6-34fb-497a-b68b-0aacd3a9fb9b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:45.690608 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e223e9e6-34fb-497a-b68b-0aacd3a9fb9b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:45.691135 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e223e9e6-34fb-497a-b68b-0aacd3a9fb9b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:45.802615 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e223e9e6-34fb-497a-b68b-0aacd3a9fb9b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:45.811796 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e223e9e6-34fb-497a-b68b-0aacd3a9fb9b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1297 microversion: 2.1 time: 0.134722 Apr 08 11:16:45.812371 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 160/312] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:45 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1297 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:45.941419 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-93cf2be6-35cb-4aa2-957a-be8307b5e1d2 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:45.942065 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-93cf2be6-35cb-4aa2-957a-be8307b5e1d2 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:45.948440 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-93cf2be6-35cb-4aa2-957a-be8307b5e1d2 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:45.948887 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-93cf2be6-35cb-4aa2-957a-be8307b5e1d2 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:45.949666 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-93cf2be6-35cb-4aa2-957a-be8307b5e1d2 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:45.950131 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-93cf2be6-35cb-4aa2-957a-be8307b5e1d2 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:46.147757 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-93cf2be6-35cb-4aa2-957a-be8307b5e1d2 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:46.155327 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-93cf2be6-35cb-4aa2-957a-be8307b5e1d2 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1315 microversion: 2.1 time: 0.217858 Apr 08 11:16:46.155890 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 153/313] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:45 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:46.834683 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-c17589b8-9685-4e7b-8a7d-d3ac380ff57a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:46.835467 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-c17589b8-9685-4e7b-8a7d-d3ac380ff57a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:46.842532 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c17589b8-9685-4e7b-8a7d-d3ac380ff57a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:46.842986 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c17589b8-9685-4e7b-8a7d-d3ac380ff57a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:46.843775 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c17589b8-9685-4e7b-8a7d-d3ac380ff57a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:46.844215 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c17589b8-9685-4e7b-8a7d-d3ac380ff57a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:46.917447 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-c17589b8-9685-4e7b-8a7d-d3ac380ff57a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:46.924467 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-c17589b8-9685-4e7b-8a7d-d3ac380ff57a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1305 microversion: 2.1 time: 0.093692 Apr 08 11:16:46.925047 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 161/314] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:46 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1305 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:47.081147 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-5833bbd7-9aea-4df5-b2a5-04c241d61f91 req-67d38564-abed-4e84-b69e-bc95f08fcf0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6001f4a-0a64-4a61-9196-30bfa668c472", "name": "network-vif-plugged", "status": "completed", "tag": "a1ed26a2-5e99-445b-82c9-5cb7ed16c345"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:16:47.090608 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-5833bbd7-9aea-4df5-b2a5-04c241d61f91 req-67d38564-abed-4e84-b69e-bc95f08fcf0c service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:47.094331 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-5833bbd7-9aea-4df5-b2a5-04c241d61f91 req-67d38564-abed-4e84-b69e-bc95f08fcf0c service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:47.103554 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-5833bbd7-9aea-4df5-b2a5-04c241d61f91 req-67d38564-abed-4e84-b69e-bc95f08fcf0c service nova] Creating event network-vif-plugged:a1ed26a2-5e99-445b-82c9-5cb7ed16c345 for instance b6001f4a-0a64-4a61-9196-30bfa668c472 on hv-cinder-83607 Apr 08 11:16:47.110672 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-5833bbd7-9aea-4df5-b2a5-04c241d61f91 req-67d38564-abed-4e84-b69e-bc95f08fcf0c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035088 Apr 08 11:16:47.111763 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 154/315] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:16:47.171664 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-cd924b7c-51b4-4859-892e-2c8ebe35ebea tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:47.172283 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-cd924b7c-51b4-4859-892e-2c8ebe35ebea tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:47.179387 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cd924b7c-51b4-4859-892e-2c8ebe35ebea tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:47.180090 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cd924b7c-51b4-4859-892e-2c8ebe35ebea tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:47.181072 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cd924b7c-51b4-4859-892e-2c8ebe35ebea tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:47.181726 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cd924b7c-51b4-4859-892e-2c8ebe35ebea tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:47.608292 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-cd924b7c-51b4-4859-892e-2c8ebe35ebea tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:47.616320 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-cd924b7c-51b4-4859-892e-2c8ebe35ebea tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1315 microversion: 2.1 time: 0.448484 Apr 08 11:16:47.616997 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 162/316] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:47 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1315 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:47.943104 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b491ab32-a998-4320-bad6-21ca437256ed tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:47.943835 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b491ab32-a998-4320-bad6-21ca437256ed tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:47.949962 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b491ab32-a998-4320-bad6-21ca437256ed tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:47.950419 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b491ab32-a998-4320-bad6-21ca437256ed tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:47.951195 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b491ab32-a998-4320-bad6-21ca437256ed tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:47.951630 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b491ab32-a998-4320-bad6-21ca437256ed tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:48.106382 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b491ab32-a998-4320-bad6-21ca437256ed tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:48.114716 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b491ab32-a998-4320-bad6-21ca437256ed tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1371 microversion: 2.1 time: 0.175816 Apr 08 11:16:48.122706 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 155/317] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:47 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:48.633970 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-1d2b7a8d-3ab8-40ae-b011-3a017297aa52 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:48.634582 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-1d2b7a8d-3ab8-40ae-b011-3a017297aa52 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:48.642372 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1d2b7a8d-3ab8-40ae-b011-3a017297aa52 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:48.642863 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1d2b7a8d-3ab8-40ae-b011-3a017297aa52 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:48.643643 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1d2b7a8d-3ab8-40ae-b011-3a017297aa52 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:48.644077 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1d2b7a8d-3ab8-40ae-b011-3a017297aa52 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:48.780522 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1d2b7a8d-3ab8-40ae-b011-3a017297aa52 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:48.787743 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-1d2b7a8d-3ab8-40ae-b011-3a017297aa52 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1315 microversion: 2.1 time: 0.157653 Apr 08 11:16:48.788310 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 163/318] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:48 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:49.132999 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0fdf77d7-9aed-494f-8910-824f81521400 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:49.133613 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0fdf77d7-9aed-494f-8910-824f81521400 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:49.140161 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0fdf77d7-9aed-494f-8910-824f81521400 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:49.140616 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0fdf77d7-9aed-494f-8910-824f81521400 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:49.141393 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0fdf77d7-9aed-494f-8910-824f81521400 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:49.141863 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0fdf77d7-9aed-494f-8910-824f81521400 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:49.281438 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0fdf77d7-9aed-494f-8910-824f81521400 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:49.288793 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0fdf77d7-9aed-494f-8910-824f81521400 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1371 microversion: 2.1 time: 0.159559 Apr 08 11:16:49.289521 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 156/319] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:49 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:49.804759 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-d3eafd71-1de4-4ad5-826e-44c87b09a400 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:49.805465 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-d3eafd71-1de4-4ad5-826e-44c87b09a400 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:49.819363 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d3eafd71-1de4-4ad5-826e-44c87b09a400 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:49.819363 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d3eafd71-1de4-4ad5-826e-44c87b09a400 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:49.819363 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d3eafd71-1de4-4ad5-826e-44c87b09a400 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:49.819363 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d3eafd71-1de4-4ad5-826e-44c87b09a400 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:49.951516 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d3eafd71-1de4-4ad5-826e-44c87b09a400 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:49.960086 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-d3eafd71-1de4-4ad5-826e-44c87b09a400 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1315 microversion: 2.1 time: 0.159054 Apr 08 11:16:49.960690 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 164/320] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:49 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:50.305367 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-14097295-c18b-4476-b7ce-2192be4eda85 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:50.306028 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-14097295-c18b-4476-b7ce-2192be4eda85 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:50.312533 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-14097295-c18b-4476-b7ce-2192be4eda85 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:50.312975 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-14097295-c18b-4476-b7ce-2192be4eda85 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:50.313757 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-14097295-c18b-4476-b7ce-2192be4eda85 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:50.314226 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-14097295-c18b-4476-b7ce-2192be4eda85 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:50.444437 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-14097295-c18b-4476-b7ce-2192be4eda85 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:50.452324 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-14097295-c18b-4476-b7ce-2192be4eda85 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1371 microversion: 2.1 time: 0.150750 Apr 08 11:16:50.452909 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 157/321] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:50 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:50.977961 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-d1247265-cef1-4fde-8773-825aaa0980d3 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:50.978508 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-d1247265-cef1-4fde-8773-825aaa0980d3 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:50.984494 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d1247265-cef1-4fde-8773-825aaa0980d3 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:50.984955 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d1247265-cef1-4fde-8773-825aaa0980d3 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:50.985802 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d1247265-cef1-4fde-8773-825aaa0980d3 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:50.986252 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d1247265-cef1-4fde-8773-825aaa0980d3 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:51.136034 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d1247265-cef1-4fde-8773-825aaa0980d3 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:51.144122 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-d1247265-cef1-4fde-8773-825aaa0980d3 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1315 microversion: 2.1 time: 0.170117 Apr 08 11:16:51.144734 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 165/322] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:50 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:51.468655 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a2d6ea7b-0516-4f76-8b73-ce1a1166226a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:51.469265 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a2d6ea7b-0516-4f76-8b73-ce1a1166226a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:51.475406 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a2d6ea7b-0516-4f76-8b73-ce1a1166226a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:51.475935 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a2d6ea7b-0516-4f76-8b73-ce1a1166226a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:51.476712 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a2d6ea7b-0516-4f76-8b73-ce1a1166226a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:51.477153 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a2d6ea7b-0516-4f76-8b73-ce1a1166226a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:51.711852 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a2d6ea7b-0516-4f76-8b73-ce1a1166226a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:51.719561 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a2d6ea7b-0516-4f76-8b73-ce1a1166226a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1371 microversion: 2.1 time: 0.254838 Apr 08 11:16:51.720184 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 158/323] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:51 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1371 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:52.161415 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a5ae6296-1603-440b-8c64-bf6486f824d7 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:52.162134 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a5ae6296-1603-440b-8c64-bf6486f824d7 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:52.168701 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a5ae6296-1603-440b-8c64-bf6486f824d7 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:52.169157 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a5ae6296-1603-440b-8c64-bf6486f824d7 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:52.170572 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a5ae6296-1603-440b-8c64-bf6486f824d7 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:52.171021 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a5ae6296-1603-440b-8c64-bf6486f824d7 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:52.331758 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a5ae6296-1603-440b-8c64-bf6486f824d7 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:52.331758 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a5ae6296-1603-440b-8c64-bf6486f824d7 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1315 microversion: 2.1 time: 0.161283 Apr 08 11:16:52.331758 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 166/324] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:52 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:52.433042 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-d6f624e2-dbf8-4215-84da-eea94c11fe1c req-efb1f9cf-dfba-4114-b694-13f1bf4cfae6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb50c1bb-d2f9-47b0-bc8b-3b6759348c47", "tag": "c15e181d-7b77-4316-acf3-d678657a02e0"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:16:52.441980 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-d6f624e2-dbf8-4215-84da-eea94c11fe1c req-efb1f9cf-dfba-4114-b694-13f1bf4cfae6 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:52.442543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-d6f624e2-dbf8-4215-84da-eea94c11fe1c req-efb1f9cf-dfba-4114-b694-13f1bf4cfae6 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:52.464532 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-d6f624e2-dbf8-4215-84da-eea94c11fe1c req-efb1f9cf-dfba-4114-b694-13f1bf4cfae6 service nova] Creating event network-changed:c15e181d-7b77-4316-acf3-d678657a02e0 for instance bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 on hv-cinder-83607 Apr 08 11:16:52.475728 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-d6f624e2-dbf8-4215-84da-eea94c11fe1c req-efb1f9cf-dfba-4114-b694-13f1bf4cfae6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042555 Apr 08 11:16:52.482375 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 159/325] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:16:52.736909 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-240a1b33-a26a-4b2b-9dbb-44a76c5f5d41 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:52.737585 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-240a1b33-a26a-4b2b-9dbb-44a76c5f5d41 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:52.744002 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-240a1b33-a26a-4b2b-9dbb-44a76c5f5d41 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:52.744459 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-240a1b33-a26a-4b2b-9dbb-44a76c5f5d41 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:52.745235 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-240a1b33-a26a-4b2b-9dbb-44a76c5f5d41 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:52.745705 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-240a1b33-a26a-4b2b-9dbb-44a76c5f5d41 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:52.890169 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-240a1b33-a26a-4b2b-9dbb-44a76c5f5d41 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:52.897401 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-240a1b33-a26a-4b2b-9dbb-44a76c5f5d41 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1371 microversion: 2.1 time: 0.164927 Apr 08 11:16:52.897996 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 167/326] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:52 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:53.344569 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7b99c424-5d00-4849-863f-fd13079b35db tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:53.344569 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7b99c424-5d00-4849-863f-fd13079b35db tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:53.344569 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7b99c424-5d00-4849-863f-fd13079b35db tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:53.344569 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7b99c424-5d00-4849-863f-fd13079b35db tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:53.344906 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7b99c424-5d00-4849-863f-fd13079b35db tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:53.344906 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7b99c424-5d00-4849-863f-fd13079b35db tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:53.521975 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7b99c424-5d00-4849-863f-fd13079b35db tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:53.521975 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7b99c424-5d00-4849-863f-fd13079b35db tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1315 microversion: 2.1 time: 0.174042 Apr 08 11:16:53.521975 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 160/327] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:53 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:53.919219 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-892f92d6-cfdc-4cb8-bc65-0f144aac75eb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:53.920800 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-892f92d6-cfdc-4cb8-bc65-0f144aac75eb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:53.931704 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-892f92d6-cfdc-4cb8-bc65-0f144aac75eb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:53.932592 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-892f92d6-cfdc-4cb8-bc65-0f144aac75eb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:53.933747 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-892f92d6-cfdc-4cb8-bc65-0f144aac75eb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:53.934500 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-892f92d6-cfdc-4cb8-bc65-0f144aac75eb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:54.083539 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-892f92d6-cfdc-4cb8-bc65-0f144aac75eb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:54.090863 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-892f92d6-cfdc-4cb8-bc65-0f144aac75eb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1371 microversion: 2.1 time: 0.178729 Apr 08 11:16:54.091437 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 168/328] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:53 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:54.536845 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2b1b11af-7146-4769-87ea-3d0e63e4d809 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:54.537446 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2b1b11af-7146-4769-87ea-3d0e63e4d809 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:54.543409 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2b1b11af-7146-4769-87ea-3d0e63e4d809 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:54.544065 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2b1b11af-7146-4769-87ea-3d0e63e4d809 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:54.544873 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2b1b11af-7146-4769-87ea-3d0e63e4d809 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:54.545308 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2b1b11af-7146-4769-87ea-3d0e63e4d809 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:54.682484 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2b1b11af-7146-4769-87ea-3d0e63e4d809 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:54.689678 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2b1b11af-7146-4769-87ea-3d0e63e4d809 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1315 microversion: 2.1 time: 0.156652 Apr 08 11:16:54.690277 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 161/329] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:54 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:16:55.117470 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-63f9547b-6dff-464f-9e8f-41580cb25372 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:55.118217 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-63f9547b-6dff-464f-9e8f-41580cb25372 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:55.125495 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-63f9547b-6dff-464f-9e8f-41580cb25372 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:55.126054 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-63f9547b-6dff-464f-9e8f-41580cb25372 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:55.126949 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-63f9547b-6dff-464f-9e8f-41580cb25372 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:55.132004 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-63f9547b-6dff-464f-9e8f-41580cb25372 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:55.317978 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-63f9547b-6dff-464f-9e8f-41580cb25372 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:55.325274 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-63f9547b-6dff-464f-9e8f-41580cb25372 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1371 microversion: 2.1 time: 0.212517 Apr 08 11:16:55.326003 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 169/330] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:55 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1371 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:55.707801 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9da3f1c5-8185-4ecf-ad9a-a97e3781daea tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:55.708400 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9da3f1c5-8185-4ecf-ad9a-a97e3781daea tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:55.714707 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9da3f1c5-8185-4ecf-ad9a-a97e3781daea tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:55.715238 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9da3f1c5-8185-4ecf-ad9a-a97e3781daea tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:55.716093 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9da3f1c5-8185-4ecf-ad9a-a97e3781daea tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:55.717170 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9da3f1c5-8185-4ecf-ad9a-a97e3781daea tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:55.912937 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9da3f1c5-8185-4ecf-ad9a-a97e3781daea tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:55.912937 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9da3f1c5-8185-4ecf-ad9a-a97e3781daea tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1465 microversion: 2.1 time: 0.205944 Apr 08 11:16:55.912937 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 162/331] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:55 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1465 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:55.949660 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-12eb27fd-f15a-47ef-9c93-a902f4076a9d tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:55.950221 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-12eb27fd-f15a-47ef-9c93-a902f4076a9d tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:55.956752 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-12eb27fd-f15a-47ef-9c93-a902f4076a9d tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:55.957206 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-12eb27fd-f15a-47ef-9c93-a902f4076a9d tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:55.958019 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-12eb27fd-f15a-47ef-9c93-a902f4076a9d tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:55.958448 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-12eb27fd-f15a-47ef-9c93-a902f4076a9d tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:55.982720 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-12eb27fd-f15a-47ef-9c93-a902f4076a9d tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Going to try to terminate instance {{(pid=117801) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 08 11:16:56.342911 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f1c318ea-f6d3-4c0e-97b4-143eaaa598fb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:56.343553 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f1c318ea-f6d3-4c0e-97b4-143eaaa598fb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:56.349895 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f1c318ea-f6d3-4c0e-97b4-143eaaa598fb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:56.350340 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f1c318ea-f6d3-4c0e-97b4-143eaaa598fb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:56.351117 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f1c318ea-f6d3-4c0e-97b4-143eaaa598fb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:56.351555 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f1c318ea-f6d3-4c0e-97b4-143eaaa598fb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:56.527520 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f1c318ea-f6d3-4c0e-97b4-143eaaa598fb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:56.535564 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f1c318ea-f6d3-4c0e-97b4-143eaaa598fb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1371 microversion: 2.1 time: 0.196711 Apr 08 11:16:56.536221 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 163/332] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:56 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1371 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:16:56.785336 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-12eb27fd-f15a-47ef-9c93-a902f4076a9d tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 204 len: 0 microversion: 2.1 time: 0.839245 Apr 08 11:16:56.786051 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 170/333] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 8 11:16:55 2022] DELETE /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 0 bytes in 841 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 11:16:56.794122 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-dd6ef79b-1c1c-489d-b6ed-0f9937a1615b tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:56.795289 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-dd6ef79b-1c1c-489d-b6ed-0f9937a1615b tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:56.801113 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dd6ef79b-1c1c-489d-b6ed-0f9937a1615b tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:56.801554 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dd6ef79b-1c1c-489d-b6ed-0f9937a1615b tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:56.802340 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dd6ef79b-1c1c-489d-b6ed-0f9937a1615b tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:56.802776 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dd6ef79b-1c1c-489d-b6ed-0f9937a1615b tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:56.945466 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-dd6ef79b-1c1c-489d-b6ed-0f9937a1615b tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:56.958948 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-dd6ef79b-1c1c-489d-b6ed-0f9937a1615b tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1471 microversion: 2.1 time: 0.168214 Apr 08 11:16:56.966134 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 164/334] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:56 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1471 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:57.553795 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-6b51a939-45c7-4592-9e60-06f5ead66212 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:57.554886 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-6b51a939-45c7-4592-9e60-06f5ead66212 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:57.561954 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6b51a939-45c7-4592-9e60-06f5ead66212 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:57.562426 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6b51a939-45c7-4592-9e60-06f5ead66212 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:57.563216 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6b51a939-45c7-4592-9e60-06f5ead66212 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:57.563655 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6b51a939-45c7-4592-9e60-06f5ead66212 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:57.711329 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6b51a939-45c7-4592-9e60-06f5ead66212 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:57.719679 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-6b51a939-45c7-4592-9e60-06f5ead66212 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1371 microversion: 2.1 time: 0.170575 Apr 08 11:16:57.721040 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 171/335] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:57 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:16:57.976731 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e1b2dad7-b0ce-46dc-a35b-11782e020f21 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:57.977378 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e1b2dad7-b0ce-46dc-a35b-11782e020f21 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:57.983860 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e1b2dad7-b0ce-46dc-a35b-11782e020f21 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:57.984307 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e1b2dad7-b0ce-46dc-a35b-11782e020f21 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:57.985073 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e1b2dad7-b0ce-46dc-a35b-11782e020f21 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:57.985507 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e1b2dad7-b0ce-46dc-a35b-11782e020f21 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:58.140483 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e1b2dad7-b0ce-46dc-a35b-11782e020f21 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:58.148042 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e1b2dad7-b0ce-46dc-a35b-11782e020f21 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1471 microversion: 2.1 time: 0.175167 Apr 08 11:16:58.148699 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 165/336] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:57 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1471 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:58.738788 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-6d6e12f0-14ed-4c90-9cc7-a9bdb07a2359 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:58.739674 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-6d6e12f0-14ed-4c90-9cc7-a9bdb07a2359 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:58.746114 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6d6e12f0-14ed-4c90-9cc7-a9bdb07a2359 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:58.746573 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6d6e12f0-14ed-4c90-9cc7-a9bdb07a2359 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:58.747363 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6d6e12f0-14ed-4c90-9cc7-a9bdb07a2359 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:58.747807 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6d6e12f0-14ed-4c90-9cc7-a9bdb07a2359 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:58.909216 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6d6e12f0-14ed-4c90-9cc7-a9bdb07a2359 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:58.916867 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-6d6e12f0-14ed-4c90-9cc7-a9bdb07a2359 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1371 microversion: 2.1 time: 0.182431 Apr 08 11:16:58.917399 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 172/337] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:58 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:16:59.165867 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3339bf6a-e5b2-4f43-8633-af633e4872ea tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:59.166476 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3339bf6a-e5b2-4f43-8633-af633e4872ea tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:59.172380 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3339bf6a-e5b2-4f43-8633-af633e4872ea tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:59.172804 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3339bf6a-e5b2-4f43-8633-af633e4872ea tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:59.173637 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3339bf6a-e5b2-4f43-8633-af633e4872ea tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:59.174681 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3339bf6a-e5b2-4f43-8633-af633e4872ea tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:59.321481 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3339bf6a-e5b2-4f43-8633-af633e4872ea tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:16:59.330569 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3339bf6a-e5b2-4f43-8633-af633e4872ea tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1471 microversion: 2.1 time: 0.168536 Apr 08 11:16:59.331139 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 166/338] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:59 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1471 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:16:59.939998 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-046dfe50-f565-478f-b05d-eac181051141 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:16:59.942995 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-046dfe50-f565-478f-b05d-eac181051141 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:16:59.949651 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-046dfe50-f565-478f-b05d-eac181051141 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:59.950199 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-046dfe50-f565-478f-b05d-eac181051141 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:16:59.950989 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-046dfe50-f565-478f-b05d-eac181051141 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:16:59.951429 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-046dfe50-f565-478f-b05d-eac181051141 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:00.096876 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-046dfe50-f565-478f-b05d-eac181051141 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:00.105002 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-046dfe50-f565-478f-b05d-eac181051141 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1371 microversion: 2.1 time: 0.172414 Apr 08 11:17:00.110200 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 173/339] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:16:59 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:00.351815 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9d35c935-74d0-4f30-8a8e-e115543ef0c6 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:00.352786 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9d35c935-74d0-4f30-8a8e-e115543ef0c6 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:00.362875 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9d35c935-74d0-4f30-8a8e-e115543ef0c6 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:00.363507 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9d35c935-74d0-4f30-8a8e-e115543ef0c6 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:00.365049 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9d35c935-74d0-4f30-8a8e-e115543ef0c6 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:00.365523 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9d35c935-74d0-4f30-8a8e-e115543ef0c6 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:00.520026 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9d35c935-74d0-4f30-8a8e-e115543ef0c6 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:00.528796 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9d35c935-74d0-4f30-8a8e-e115543ef0c6 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1471 microversion: 2.1 time: 0.183130 Apr 08 11:17:00.530027 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 167/340] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:00 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1471 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:01.123440 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-fcf67329-1c1c-4665-a41c-bc01b149f741 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:01.123988 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-fcf67329-1c1c-4665-a41c-bc01b149f741 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:01.130429 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fcf67329-1c1c-4665-a41c-bc01b149f741 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:01.130883 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fcf67329-1c1c-4665-a41c-bc01b149f741 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:01.131660 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fcf67329-1c1c-4665-a41c-bc01b149f741 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:01.132100 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fcf67329-1c1c-4665-a41c-bc01b149f741 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:01.286136 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-fcf67329-1c1c-4665-a41c-bc01b149f741 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:01.294303 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-fcf67329-1c1c-4665-a41c-bc01b149f741 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1371 microversion: 2.1 time: 0.175211 Apr 08 11:17:01.295654 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 174/341] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:01 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:01.546952 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c9e5c75e-3bf8-46a9-a61f-01697dd6e2aa tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:01.547560 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c9e5c75e-3bf8-46a9-a61f-01697dd6e2aa tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:01.553480 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c9e5c75e-3bf8-46a9-a61f-01697dd6e2aa tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:01.553965 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c9e5c75e-3bf8-46a9-a61f-01697dd6e2aa tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:01.554731 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c9e5c75e-3bf8-46a9-a61f-01697dd6e2aa tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:01.555165 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c9e5c75e-3bf8-46a9-a61f-01697dd6e2aa tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:01.694779 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c9e5c75e-3bf8-46a9-a61f-01697dd6e2aa tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:01.703033 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c9e5c75e-3bf8-46a9-a61f-01697dd6e2aa tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1471 microversion: 2.1 time: 0.160494 Apr 08 11:17:01.703625 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 168/342] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:01 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1471 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:02.312545 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-35950f76-306c-49a8-a2b5-fab16c15dd95 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:02.313217 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-35950f76-306c-49a8-a2b5-fab16c15dd95 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:02.319467 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-35950f76-306c-49a8-a2b5-fab16c15dd95 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:02.319964 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-35950f76-306c-49a8-a2b5-fab16c15dd95 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:02.320750 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-35950f76-306c-49a8-a2b5-fab16c15dd95 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:02.321182 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-35950f76-306c-49a8-a2b5-fab16c15dd95 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:02.469673 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-35950f76-306c-49a8-a2b5-fab16c15dd95 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:02.477181 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-35950f76-306c-49a8-a2b5-fab16c15dd95 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1371 microversion: 2.1 time: 0.168959 Apr 08 11:17:02.477795 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 175/343] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:02 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:02.721073 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-272b1109-c7df-4841-8ef3-787aa862c582 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:02.721683 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-272b1109-c7df-4841-8ef3-787aa862c582 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:02.727736 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-272b1109-c7df-4841-8ef3-787aa862c582 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:02.734099 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-272b1109-c7df-4841-8ef3-787aa862c582 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:02.734099 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-272b1109-c7df-4841-8ef3-787aa862c582 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:02.734099 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-272b1109-c7df-4841-8ef3-787aa862c582 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:02.873441 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-272b1109-c7df-4841-8ef3-787aa862c582 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:02.882616 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-272b1109-c7df-4841-8ef3-787aa862c582 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1471 microversion: 2.1 time: 0.165842 Apr 08 11:17:02.894313 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 169/344] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:02 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1471 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:17:03.495395 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-662bac34-6fd0-4c7d-bcd1-5cecd320ba22 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:03.496004 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-662bac34-6fd0-4c7d-bcd1-5cecd320ba22 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:03.502626 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-662bac34-6fd0-4c7d-bcd1-5cecd320ba22 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:03.503117 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-662bac34-6fd0-4c7d-bcd1-5cecd320ba22 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:03.503958 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-662bac34-6fd0-4c7d-bcd1-5cecd320ba22 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:03.504437 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-662bac34-6fd0-4c7d-bcd1-5cecd320ba22 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:03.665667 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-662bac34-6fd0-4c7d-bcd1-5cecd320ba22 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:03.673380 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-662bac34-6fd0-4c7d-bcd1-5cecd320ba22 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1371 microversion: 2.1 time: 0.181723 Apr 08 11:17:03.673894 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 176/345] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:03 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:03.902653 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1e38e5ff-9687-45dd-b1e8-d9fee068228b tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:03.903265 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1e38e5ff-9687-45dd-b1e8-d9fee068228b tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:03.909191 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1e38e5ff-9687-45dd-b1e8-d9fee068228b tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:03.909638 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1e38e5ff-9687-45dd-b1e8-d9fee068228b tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:03.910445 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1e38e5ff-9687-45dd-b1e8-d9fee068228b tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:03.910885 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1e38e5ff-9687-45dd-b1e8-d9fee068228b tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:04.059936 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1e38e5ff-9687-45dd-b1e8-d9fee068228b tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:04.079365 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1e38e5ff-9687-45dd-b1e8-d9fee068228b tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1471 microversion: 2.1 time: 0.180426 Apr 08 11:17:04.079963 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 170/346] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:03 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1471 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:04.689968 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-fe900f5f-e762-4dfd-8145-08c7cf6f0946 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:04.690579 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-fe900f5f-e762-4dfd-8145-08c7cf6f0946 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:04.697072 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fe900f5f-e762-4dfd-8145-08c7cf6f0946 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:04.697527 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fe900f5f-e762-4dfd-8145-08c7cf6f0946 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:04.698338 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fe900f5f-e762-4dfd-8145-08c7cf6f0946 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:04.698782 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fe900f5f-e762-4dfd-8145-08c7cf6f0946 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:04.841973 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-fe900f5f-e762-4dfd-8145-08c7cf6f0946 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:04.849738 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-fe900f5f-e762-4dfd-8145-08c7cf6f0946 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1371 microversion: 2.1 time: 0.163643 Apr 08 11:17:04.850326 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 177/347] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:04 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:05.096159 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d3391e59-1a21-453c-8eb1-6431c2797e0f tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:05.096771 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d3391e59-1a21-453c-8eb1-6431c2797e0f tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:05.102880 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d3391e59-1a21-453c-8eb1-6431c2797e0f tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:05.103331 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d3391e59-1a21-453c-8eb1-6431c2797e0f tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:05.104100 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d3391e59-1a21-453c-8eb1-6431c2797e0f tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:05.104544 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d3391e59-1a21-453c-8eb1-6431c2797e0f tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:05.241924 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d3391e59-1a21-453c-8eb1-6431c2797e0f tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:05.249388 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d3391e59-1a21-453c-8eb1-6431c2797e0f tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1471 microversion: 2.1 time: 0.157828 Apr 08 11:17:05.249996 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 171/348] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:05 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:05.867608 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-be463ae2-6717-49ac-bb37-bb4763878ac0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:05.868131 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-be463ae2-6717-49ac-bb37-bb4763878ac0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:05.875160 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-be463ae2-6717-49ac-bb37-bb4763878ac0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:05.875616 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-be463ae2-6717-49ac-bb37-bb4763878ac0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:05.876394 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-be463ae2-6717-49ac-bb37-bb4763878ac0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:05.876838 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-be463ae2-6717-49ac-bb37-bb4763878ac0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:06.011550 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-be463ae2-6717-49ac-bb37-bb4763878ac0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:06.018962 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-be463ae2-6717-49ac-bb37-bb4763878ac0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1371 microversion: 2.1 time: 0.155514 Apr 08 11:17:06.019542 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 178/349] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:05 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:06.266820 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9dd580ba-065c-4e8c-9728-234950fa7e81 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:06.267536 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9dd580ba-065c-4e8c-9728-234950fa7e81 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:06.273246 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9dd580ba-065c-4e8c-9728-234950fa7e81 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:06.273850 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9dd580ba-065c-4e8c-9728-234950fa7e81 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:06.274637 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9dd580ba-065c-4e8c-9728-234950fa7e81 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:06.275073 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9dd580ba-065c-4e8c-9728-234950fa7e81 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:06.410411 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9dd580ba-065c-4e8c-9728-234950fa7e81 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:06.418044 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9dd580ba-065c-4e8c-9728-234950fa7e81 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1471 microversion: 2.1 time: 0.154942 Apr 08 11:17:06.418626 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 172/350] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:06 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:07.036320 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-7c9cde33-2dd1-47d2-8ff7-751682f5aff6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:07.036930 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-7c9cde33-2dd1-47d2-8ff7-751682f5aff6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:07.043804 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7c9cde33-2dd1-47d2-8ff7-751682f5aff6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:07.044253 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7c9cde33-2dd1-47d2-8ff7-751682f5aff6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:07.045052 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7c9cde33-2dd1-47d2-8ff7-751682f5aff6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:07.046164 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7c9cde33-2dd1-47d2-8ff7-751682f5aff6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:07.185555 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-7c9cde33-2dd1-47d2-8ff7-751682f5aff6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:07.193245 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-7c9cde33-2dd1-47d2-8ff7-751682f5aff6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1371 microversion: 2.1 time: 0.160451 Apr 08 11:17:07.193746 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 179/351] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:07 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:07.435626 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ec9ff344-a078-42d5-90c8-c3933d30e1aa tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:07.436286 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ec9ff344-a078-42d5-90c8-c3933d30e1aa tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:07.442283 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ec9ff344-a078-42d5-90c8-c3933d30e1aa tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:07.442736 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ec9ff344-a078-42d5-90c8-c3933d30e1aa tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:07.443507 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ec9ff344-a078-42d5-90c8-c3933d30e1aa tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:07.443945 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ec9ff344-a078-42d5-90c8-c3933d30e1aa tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:07.575269 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ec9ff344-a078-42d5-90c8-c3933d30e1aa tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:07.584231 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ec9ff344-a078-42d5-90c8-c3933d30e1aa tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1471 microversion: 2.1 time: 0.152454 Apr 08 11:17:07.590876 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 173/352] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:07 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1471 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:08.209607 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-3b71b5d6-c00a-4abe-bcb7-a0d8e8277759 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:08.210242 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-3b71b5d6-c00a-4abe-bcb7-a0d8e8277759 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:08.216488 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3b71b5d6-c00a-4abe-bcb7-a0d8e8277759 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:08.216939 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3b71b5d6-c00a-4abe-bcb7-a0d8e8277759 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:08.217731 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3b71b5d6-c00a-4abe-bcb7-a0d8e8277759 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:08.218201 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3b71b5d6-c00a-4abe-bcb7-a0d8e8277759 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:08.362148 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-3b71b5d6-c00a-4abe-bcb7-a0d8e8277759 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:08.369966 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-3b71b5d6-c00a-4abe-bcb7-a0d8e8277759 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1371 microversion: 2.1 time: 0.164020 Apr 08 11:17:08.370542 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 180/353] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:08 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:08.601828 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bd686411-fc86-4f05-935d-7b016cc05653 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:08.602377 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-bd686411-fc86-4f05-935d-7b016cc05653 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:08.608372 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bd686411-fc86-4f05-935d-7b016cc05653 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:08.608821 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bd686411-fc86-4f05-935d-7b016cc05653 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:08.609631 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bd686411-fc86-4f05-935d-7b016cc05653 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:08.610158 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bd686411-fc86-4f05-935d-7b016cc05653 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:08.797689 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-bd686411-fc86-4f05-935d-7b016cc05653 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:08.805349 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-bd686411-fc86-4f05-935d-7b016cc05653 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1471 microversion: 2.1 time: 0.207651 Apr 08 11:17:08.805929 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 174/354] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:08 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1471 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:09.386985 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-6ea5c080-3adf-4c0a-860c-16b9896a5075 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:09.387593 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-6ea5c080-3adf-4c0a-860c-16b9896a5075 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:09.394152 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6ea5c080-3adf-4c0a-860c-16b9896a5075 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:09.394599 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6ea5c080-3adf-4c0a-860c-16b9896a5075 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:09.395372 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6ea5c080-3adf-4c0a-860c-16b9896a5075 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:09.395810 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6ea5c080-3adf-4c0a-860c-16b9896a5075 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:09.534077 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6ea5c080-3adf-4c0a-860c-16b9896a5075 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:09.541960 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-6ea5c080-3adf-4c0a-860c-16b9896a5075 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1371 microversion: 2.1 time: 0.158667 Apr 08 11:17:09.542555 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 181/355] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:09 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:09.823908 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-784ff4bb-3960-411e-ad56-1104c202ba5c tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:09.824521 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-784ff4bb-3960-411e-ad56-1104c202ba5c tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:09.831292 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-784ff4bb-3960-411e-ad56-1104c202ba5c tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:09.831749 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-784ff4bb-3960-411e-ad56-1104c202ba5c tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:09.832518 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-784ff4bb-3960-411e-ad56-1104c202ba5c tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:09.832957 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-784ff4bb-3960-411e-ad56-1104c202ba5c tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:09.962543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-784ff4bb-3960-411e-ad56-1104c202ba5c tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:09.970731 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-784ff4bb-3960-411e-ad56-1104c202ba5c tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1471 microversion: 2.1 time: 0.150756 Apr 08 11:17:09.971297 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 175/356] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:09 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1471 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:10.559727 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-4439f91a-488c-4374-9434-73e345a1f743 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:10.560333 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-4439f91a-488c-4374-9434-73e345a1f743 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:10.567335 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4439f91a-488c-4374-9434-73e345a1f743 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:10.567791 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4439f91a-488c-4374-9434-73e345a1f743 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:10.568564 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4439f91a-488c-4374-9434-73e345a1f743 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:10.569003 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4439f91a-488c-4374-9434-73e345a1f743 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:10.707336 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-4439f91a-488c-4374-9434-73e345a1f743 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:10.715977 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-4439f91a-488c-4374-9434-73e345a1f743 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1371 microversion: 2.1 time: 0.160001 Apr 08 11:17:10.716560 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 182/357] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:10 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:10.989116 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-893d93d2-7d9b-456d-a409-75de43a5d4d6 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:10.990262 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-893d93d2-7d9b-456d-a409-75de43a5d4d6 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:10.997962 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-893d93d2-7d9b-456d-a409-75de43a5d4d6 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:10.999070 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-893d93d2-7d9b-456d-a409-75de43a5d4d6 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:11.000278 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-893d93d2-7d9b-456d-a409-75de43a5d4d6 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:11.000903 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-893d93d2-7d9b-456d-a409-75de43a5d4d6 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:11.222348 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-893d93d2-7d9b-456d-a409-75de43a5d4d6 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:11.230005 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-893d93d2-7d9b-456d-a409-75de43a5d4d6 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1471 microversion: 2.1 time: 0.244869 Apr 08 11:17:11.231024 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 176/358] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:10 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1471 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:11.543529 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [req-9a2c86d6-f31b-479b-939f-2005d53dc390 req-243d2359-50d3-477f-8834-7b9dd7788b13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb50c1bb-d2f9-47b0-bc8b-3b6759348c47", "name": "network-vif-plugged", "status": "completed", "tag": "c15e181d-7b77-4316-acf3-d678657a02e0"}]} {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:17:11.552594 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-9a2c86d6-f31b-479b-939f-2005d53dc390 req-243d2359-50d3-477f-8834-7b9dd7788b13 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:11.553081 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-9a2c86d6-f31b-479b-939f-2005d53dc390 req-243d2359-50d3-477f-8834-7b9dd7788b13 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:11.564478 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.compute.server_external_events [req-9a2c86d6-f31b-479b-939f-2005d53dc390 req-243d2359-50d3-477f-8834-7b9dd7788b13 service nova] Creating event network-vif-plugged:c15e181d-7b77-4316-acf3-d678657a02e0 for instance bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 on hv-cinder-83607 Apr 08 11:17:11.569495 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [req-9a2c86d6-f31b-479b-939f-2005d53dc390 req-243d2359-50d3-477f-8834-7b9dd7788b13 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030352 Apr 08 11:17:11.571535 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 183/359] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:17:11.693846 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-31b176f4-eb7a-404c-b0c6-36b1700f929d req-bd332cb4-b6af-4e82-b2ab-1cab2e4356b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6001f4a-0a64-4a61-9196-30bfa668c472", "name": "network-vif-deleted", "tag": "a1ed26a2-5e99-445b-82c9-5cb7ed16c345"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:17:11.702171 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-31b176f4-eb7a-404c-b0c6-36b1700f929d req-bd332cb4-b6af-4e82-b2ab-1cab2e4356b9 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:11.702613 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-31b176f4-eb7a-404c-b0c6-36b1700f929d req-bd332cb4-b6af-4e82-b2ab-1cab2e4356b9 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:11.714668 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-31b176f4-eb7a-404c-b0c6-36b1700f929d req-bd332cb4-b6af-4e82-b2ab-1cab2e4356b9 service nova] Creating event network-vif-deleted:a1ed26a2-5e99-445b-82c9-5cb7ed16c345 for instance b6001f4a-0a64-4a61-9196-30bfa668c472 on hv-cinder-83607 Apr 08 11:17:11.720329 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-31b176f4-eb7a-404c-b0c6-36b1700f929d req-bd332cb4-b6af-4e82-b2ab-1cab2e4356b9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030287 Apr 08 11:17:11.721502 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 177/360] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:17:11.736939 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a816209d-bf93-45f5-adf0-79ae0209c0a9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:11.738005 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a816209d-bf93-45f5-adf0-79ae0209c0a9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:11.746500 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a816209d-bf93-45f5-adf0-79ae0209c0a9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:11.746992 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a816209d-bf93-45f5-adf0-79ae0209c0a9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:11.747836 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a816209d-bf93-45f5-adf0-79ae0209c0a9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:11.748329 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a816209d-bf93-45f5-adf0-79ae0209c0a9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:11.899211 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a816209d-bf93-45f5-adf0-79ae0209c0a9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:11.909423 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a816209d-bf93-45f5-adf0-79ae0209c0a9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1371 microversion: 2.1 time: 0.176765 Apr 08 11:17:11.921032 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 184/361] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:11 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1371 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:12.247603 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a61bd9e3-37db-444b-b455-d5794134ce46 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:12.248306 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a61bd9e3-37db-444b-b455-d5794134ce46 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:12.254694 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a61bd9e3-37db-444b-b455-d5794134ce46 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:12.255152 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a61bd9e3-37db-444b-b455-d5794134ce46 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:12.255937 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a61bd9e3-37db-444b-b455-d5794134ce46 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:12.256377 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a61bd9e3-37db-444b-b455-d5794134ce46 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:12.288259 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a61bd9e3-37db-444b-b455-d5794134ce46 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:12.288760 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a61bd9e3-37db-444b-b455-d5794134ce46 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:12.289186 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-a61bd9e3-37db-444b-b455-d5794134ce46 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lazy-loading 'fault' on Instance uuid b6001f4a-0a64-4a61-9196-30bfa668c472 {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 11:17:12.335854 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a61bd9e3-37db-444b-b455-d5794134ce46 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:12.344141 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a61bd9e3-37db-444b-b455-d5794134ce46 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1305 microversion: 2.1 time: 0.100811 Apr 08 11:17:12.344677 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 178/362] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:12 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1305 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:12.927348 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-0259068c-c7f8-4b05-b06f-ee978425fdb3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:12.927871 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-0259068c-c7f8-4b05-b06f-ee978425fdb3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:12.934051 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0259068c-c7f8-4b05-b06f-ee978425fdb3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:12.934494 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0259068c-c7f8-4b05-b06f-ee978425fdb3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:12.935255 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0259068c-c7f8-4b05-b06f-ee978425fdb3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:12.935683 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0259068c-c7f8-4b05-b06f-ee978425fdb3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:13.069214 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-0259068c-c7f8-4b05-b06f-ee978425fdb3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:13.076435 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-0259068c-c7f8-4b05-b06f-ee978425fdb3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1371 microversion: 2.1 time: 0.152989 Apr 08 11:17:13.084759 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 185/363] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:12 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:13.365635 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1e3934a3-e990-44f3-8d42-8e8c936d748b tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:13.366264 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1e3934a3-e990-44f3-8d42-8e8c936d748b tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:13.372191 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1e3934a3-e990-44f3-8d42-8e8c936d748b tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:13.372721 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1e3934a3-e990-44f3-8d42-8e8c936d748b tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:13.373421 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1e3934a3-e990-44f3-8d42-8e8c936d748b tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:13.373933 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1e3934a3-e990-44f3-8d42-8e8c936d748b tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:13.406107 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1e3934a3-e990-44f3-8d42-8e8c936d748b tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:13.406697 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1e3934a3-e990-44f3-8d42-8e8c936d748b tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:13.407159 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-1e3934a3-e990-44f3-8d42-8e8c936d748b tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lazy-loading 'fault' on Instance uuid b6001f4a-0a64-4a61-9196-30bfa668c472 {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 11:17:13.452699 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1e3934a3-e990-44f3-8d42-8e8c936d748b tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:13.460400 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1e3934a3-e990-44f3-8d42-8e8c936d748b tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1305 microversion: 2.1 time: 0.098862 Apr 08 11:17:13.460980 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 179/364] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:13 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1305 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:14.092987 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-73f55769-c651-40f8-b837-1c5cac4a440e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:14.094862 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-73f55769-c651-40f8-b837-1c5cac4a440e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:14.101620 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-73f55769-c651-40f8-b837-1c5cac4a440e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:14.102452 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-73f55769-c651-40f8-b837-1c5cac4a440e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:14.109051 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-73f55769-c651-40f8-b837-1c5cac4a440e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:14.109051 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-73f55769-c651-40f8-b837-1c5cac4a440e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:14.255332 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-73f55769-c651-40f8-b837-1c5cac4a440e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:14.263782 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-73f55769-c651-40f8-b837-1c5cac4a440e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1371 microversion: 2.1 time: 0.174547 Apr 08 11:17:14.280845 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 186/365] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:14 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:14.477398 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c2af2549-31ad-4076-b51f-2c70c3befff8 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:14.503709 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c2af2549-31ad-4076-b51f-2c70c3befff8 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:14.503709 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c2af2549-31ad-4076-b51f-2c70c3befff8 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:14.503709 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c2af2549-31ad-4076-b51f-2c70c3befff8 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:14.503709 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c2af2549-31ad-4076-b51f-2c70c3befff8 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:14.504284 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c2af2549-31ad-4076-b51f-2c70c3befff8 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:14.516257 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c2af2549-31ad-4076-b51f-2c70c3befff8 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:14.516708 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c2af2549-31ad-4076-b51f-2c70c3befff8 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:14.517215 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-c2af2549-31ad-4076-b51f-2c70c3befff8 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lazy-loading 'fault' on Instance uuid b6001f4a-0a64-4a61-9196-30bfa668c472 {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 11:17:14.558463 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c2af2549-31ad-4076-b51f-2c70c3befff8 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3779860f60e940a180e1c49d2a67d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0def47b7e0a24d8585b9ed9f3af25862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:14.593700 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c2af2549-31ad-4076-b51f-2c70c3befff8 tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 200 len: 1305 microversion: 2.1 time: 0.093077 Apr 08 11:17:14.593700 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 180/366] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:14 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 1305 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:17:15.290124 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-5692fb2c-c9d4-40f2-afa9-c55238f6f8ad tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:15.291329 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-5692fb2c-c9d4-40f2-afa9-c55238f6f8ad tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:15.298303 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5692fb2c-c9d4-40f2-afa9-c55238f6f8ad tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:15.303672 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5692fb2c-c9d4-40f2-afa9-c55238f6f8ad tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:15.303672 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5692fb2c-c9d4-40f2-afa9-c55238f6f8ad tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:15.303672 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5692fb2c-c9d4-40f2-afa9-c55238f6f8ad tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:15.459597 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-5692fb2c-c9d4-40f2-afa9-c55238f6f8ad tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:15.467566 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-5692fb2c-c9d4-40f2-afa9-c55238f6f8ad tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1371 microversion: 2.1 time: 0.181606 Apr 08 11:17:15.468147 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 187/367] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:15 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:15.609366 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0fbf7552-7393-4dc3-8575-7cf28cd7e14a tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:15.610174 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0fbf7552-7393-4dc3-8575-7cf28cd7e14a tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] [instance: b6001f4a-0a64-4a61-9196-30bfa668c472] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:15.618089 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0fbf7552-7393-4dc3-8575-7cf28cd7e14a tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:15.618535 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0fbf7552-7393-4dc3-8575-7cf28cd7e14a tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:15.619386 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0fbf7552-7393-4dc3-8575-7cf28cd7e14a tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:15.619862 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0fbf7552-7393-4dc3-8575-7cf28cd7e14a tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:15.634142 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-0fbf7552-7393-4dc3-8575-7cf28cd7e14a tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] HTTP exception thrown: Instance b6001f4a-0a64-4a61-9196-30bfa668c472 could not be found. Apr 08 11:17:15.634728 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0fbf7552-7393-4dc3-8575-7cf28cd7e14a tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] Returning 404 to user: Instance b6001f4a-0a64-4a61-9196-30bfa668c472 could not be found. {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:17:15.635612 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0fbf7552-7393-4dc3-8575-7cf28cd7e14a tempest-VolumesNegativeTest-1647055731 tempest-VolumesNegativeTest-1647055731-project] 10.222.0.46 "GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472" status: 404 len: 111 microversion: 2.1 time: 0.031037 Apr 08 11:17:15.636143 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 181/368] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:15 2022] GET /compute/v2.1/servers/b6001f4a-0a64-4a61-9196-30bfa668c472 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 11:17:16.486199 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-5f35d351-167a-4138-81c1-5f1d4d8b4560 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:16.486199 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-5f35d351-167a-4138-81c1-5f1d4d8b4560 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:16.492999 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5f35d351-167a-4138-81c1-5f1d4d8b4560 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:16.493454 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5f35d351-167a-4138-81c1-5f1d4d8b4560 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:16.494262 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5f35d351-167a-4138-81c1-5f1d4d8b4560 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:16.494892 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5f35d351-167a-4138-81c1-5f1d4d8b4560 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:16.683147 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-5f35d351-167a-4138-81c1-5f1d4d8b4560 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:16.691773 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-5f35d351-167a-4138-81c1-5f1d4d8b4560 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1565 microversion: 2.1 time: 0.210889 Apr 08 11:17:16.692367 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 188/369] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:16 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1565 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:16.716156 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3b9e62d7-2495-4723-a1f0-3d8f47d8957b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:16.716759 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3b9e62d7-2495-4723-a1f0-3d8f47d8957b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:16.723610 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3b9e62d7-2495-4723-a1f0-3d8f47d8957b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:16.724091 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3b9e62d7-2495-4723-a1f0-3d8f47d8957b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:16.724885 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3b9e62d7-2495-4723-a1f0-3d8f47d8957b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:16.725321 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3b9e62d7-2495-4723-a1f0-3d8f47d8957b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:16.837376 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3b9e62d7-2495-4723-a1f0-3d8f47d8957b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.125208 Apr 08 11:17:16.838005 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 182/370] 10.222.0.46 () {58 vars in 1274 bytes} [Fri Apr 8 11:17:16 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-interface => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:17:18.443059 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [req-9e7122c1-ed68-4fbb-8780-f8dd5893ee22 req-6825b689-d06e-4ea3-9204-b63eab6d910b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb50c1bb-d2f9-47b0-bc8b-3b6759348c47", "tag": "c15e181d-7b77-4316-acf3-d678657a02e0"}]} {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:17:18.462505 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-9e7122c1-ed68-4fbb-8780-f8dd5893ee22 req-6825b689-d06e-4ea3-9204-b63eab6d910b service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:18.463225 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-9e7122c1-ed68-4fbb-8780-f8dd5893ee22 req-6825b689-d06e-4ea3-9204-b63eab6d910b service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:18.499257 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.compute.server_external_events [req-9e7122c1-ed68-4fbb-8780-f8dd5893ee22 req-6825b689-d06e-4ea3-9204-b63eab6d910b service nova] Creating event network-changed:c15e181d-7b77-4316-acf3-d678657a02e0 for instance bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 on hv-cinder-83607 Apr 08 11:17:18.512460 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [req-9e7122c1-ed68-4fbb-8780-f8dd5893ee22 req-6825b689-d06e-4ea3-9204-b63eab6d910b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072653 Apr 08 11:17:18.513687 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 189/371] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:17:30.851572 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8c2a12f5-f998-4658-95b0-0ab629f615d1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Action: 'create', calling method: .version_select at 0x7f041ffcddc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1239149749"}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:17:30.866380 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-8c2a12f5-f998-4658-95b0-0ab629f615d1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Getting quotas for project 7b145acd79ca42c2a72a54be4e950a97. Resources: {'key_pairs'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 11:17:30.870805 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-8c2a12f5-f998-4658-95b0-0ab629f615d1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Getting quotas for user f5f00b50061845bab2717e8483efec94 and project 7b145acd79ca42c2a72a54be4e950a97. Resources: {'key_pairs'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 11:17:31.266297 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-8c2a12f5-f998-4658-95b0-0ab629f615d1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Getting quotas for project 7b145acd79ca42c2a72a54be4e950a97. Resources: {'key_pairs'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 11:17:31.272050 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-8c2a12f5-f998-4658-95b0-0ab629f615d1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Getting quotas for user f5f00b50061845bab2717e8483efec94 and project 7b145acd79ca42c2a72a54be4e950a97. Resources: {'key_pairs'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 11:17:31.286325 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8c2a12f5-f998-4658-95b0-0ab629f615d1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.691567 Apr 08 11:17:31.291844 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 183/372] 10.222.0.46 () {60 vars in 1157 bytes} [Fri Apr 8 11:17:30 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:31.865054 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-60b8f4e5-ac7f-4091-8975-443acc73669c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1646419773", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-237000854", "security_groups": [{"name": "tempest-secgroup-smoke-1698678439"}], "block_device_mapping_v2": [{"uuid": "c1f31ba6-8e1f-40a4-af66-a73334e7c5f9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "975de40b-882d-4298-b14f-c145b277c4b5"}]}} {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:17:32.194453 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.network.neutron [None req-60b8f4e5-ac7f-4091-8975-443acc73669c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] validate_networks() for [('975de40b-882d-4298-b14f-c145b277c4b5', None, None, None, None, None)] {{(pid=117801) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 08 11:17:32.730778 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.virt.hardware [None req-60b8f4e5-ac7f-4091-8975-443acc73669c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Flavor limits 0:0:0 {{(pid=117801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 11:17:32.731421 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.virt.hardware [None req-60b8f4e5-ac7f-4091-8975-443acc73669c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Image limits 0:0:0 {{(pid=117801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 11:17:32.732235 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.virt.hardware [None req-60b8f4e5-ac7f-4091-8975-443acc73669c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Flavor pref 0:0:0 {{(pid=117801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 11:17:32.732889 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.virt.hardware [None req-60b8f4e5-ac7f-4091-8975-443acc73669c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Image pref 0:0:0 {{(pid=117801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 11:17:32.733419 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.virt.hardware [None req-60b8f4e5-ac7f-4091-8975-443acc73669c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 11:17:32.743696 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-60b8f4e5-ac7f-4091-8975-443acc73669c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:32.744386 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-60b8f4e5-ac7f-4091-8975-443acc73669c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:32.745265 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-60b8f4e5-ac7f-4091-8975-443acc73669c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:32.745809 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-60b8f4e5-ac7f-4091-8975-443acc73669c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:32.765012 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.quota [None req-60b8f4e5-ac7f-4091-8975-443acc73669c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Getting quotas for project 925fd2ad2f3946e688dbe1a4c4068db9. Resources: {'instances', 'ram', 'cores'} {{(pid=117801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 11:17:32.769328 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.quota [None req-60b8f4e5-ac7f-4091-8975-443acc73669c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Getting quotas for user 4fa60dc2a9994faab01551d6bc7c62b9 and project 925fd2ad2f3946e688dbe1a4c4068db9. Resources: {'instances', 'ram', 'cores'} {{(pid=117801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 11:17:32.898991 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-60b8f4e5-ac7f-4091-8975-443acc73669c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Going to run 1 instances... {{(pid=117801) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 08 11:17:32.901311 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-60b8f4e5-ac7f-4091-8975-443acc73669c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c1f31ba6-8e1f-40a4-af66-a73334e7c5f9',volume_size=None,volume_type=None)] {{(pid=117801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 08 11:17:33.984363 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-60b8f4e5-ac7f-4091-8975-443acc73669c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.127200 Apr 08 11:17:33.986300 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 190/373] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Apr 8 11:17:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 2131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 08 11:17:33.997989 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0914184e-9b93-4cdf-af39-3297d6385eb3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:33.999266 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0914184e-9b93-4cdf-af39-3297d6385eb3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:34.072497 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0914184e-9b93-4cdf-af39-3297d6385eb3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:34.086520 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0914184e-9b93-4cdf-af39-3297d6385eb3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1094 microversion: 2.1 time: 0.094051 Apr 08 11:17:34.088072 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 184/374] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:33 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1094 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:35.105039 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-b8d02dd9-9e7c-4bb0-b471-310916aef584 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:35.105644 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-b8d02dd9-9e7c-4bb0-b471-310916aef584 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:35.161333 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b8d02dd9-9e7c-4bb0-b471-310916aef584 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:35.169333 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-b8d02dd9-9e7c-4bb0-b471-310916aef584 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1094 microversion: 2.1 time: 0.068261 Apr 08 11:17:35.172310 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 191/375] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:35 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:36.186341 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-71ed0c86-87b0-449b-a8f9-d34d7ba6bf41 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:36.186989 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-71ed0c86-87b0-449b-a8f9-d34d7ba6bf41 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:36.195223 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-71ed0c86-87b0-449b-a8f9-d34d7ba6bf41 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:36.195678 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-71ed0c86-87b0-449b-a8f9-d34d7ba6bf41 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:36.196466 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-71ed0c86-87b0-449b-a8f9-d34d7ba6bf41 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:36.197008 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-71ed0c86-87b0-449b-a8f9-d34d7ba6bf41 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:36.259449 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-71ed0c86-87b0-449b-a8f9-d34d7ba6bf41 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:36.268162 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-71ed0c86-87b0-449b-a8f9-d34d7ba6bf41 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1136 microversion: 2.1 time: 0.085773 Apr 08 11:17:36.268748 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 185/376] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:36 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1136 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:37.284983 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-94a224e5-9cb0-47f4-b0de-f9d1557f3fc9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:37.285616 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-94a224e5-9cb0-47f4-b0de-f9d1557f3fc9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:37.292148 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-94a224e5-9cb0-47f4-b0de-f9d1557f3fc9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:37.292603 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-94a224e5-9cb0-47f4-b0de-f9d1557f3fc9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:37.293376 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-94a224e5-9cb0-47f4-b0de-f9d1557f3fc9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:37.293848 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-94a224e5-9cb0-47f4-b0de-f9d1557f3fc9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:37.355732 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-94a224e5-9cb0-47f4-b0de-f9d1557f3fc9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:37.363770 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-94a224e5-9cb0-47f4-b0de-f9d1557f3fc9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1192 microversion: 2.1 time: 0.082541 Apr 08 11:17:37.364342 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 192/377] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:37 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1192 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:38.380909 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7bf96e47-9011-46c4-9cf2-34635d33b83c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:38.381599 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7bf96e47-9011-46c4-9cf2-34635d33b83c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:38.387479 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7bf96e47-9011-46c4-9cf2-34635d33b83c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:38.387903 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7bf96e47-9011-46c4-9cf2-34635d33b83c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:38.388663 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7bf96e47-9011-46c4-9cf2-34635d33b83c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:38.389092 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7bf96e47-9011-46c4-9cf2-34635d33b83c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:38.448443 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7bf96e47-9011-46c4-9cf2-34635d33b83c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:38.456425 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7bf96e47-9011-46c4-9cf2-34635d33b83c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1192 microversion: 2.1 time: 0.079135 Apr 08 11:17:38.456915 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 186/378] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:38 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1192 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:39.472777 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2262d684-9b93-4c66-9279-90ab31136627 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:39.473426 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-2262d684-9b93-4c66-9279-90ab31136627 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:39.480239 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2262d684-9b93-4c66-9279-90ab31136627 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:39.480601 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2262d684-9b93-4c66-9279-90ab31136627 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:39.481405 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2262d684-9b93-4c66-9279-90ab31136627 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:39.481888 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2262d684-9b93-4c66-9279-90ab31136627 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:39.543138 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2262d684-9b93-4c66-9279-90ab31136627 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:39.550408 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-2262d684-9b93-4c66-9279-90ab31136627 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1192 microversion: 2.1 time: 0.081829 Apr 08 11:17:39.550969 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 193/379] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:39 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1192 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:40.569575 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e70590ce-21cc-499d-be07-44ac37b3e9c0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:40.569575 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e70590ce-21cc-499d-be07-44ac37b3e9c0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:40.573749 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e70590ce-21cc-499d-be07-44ac37b3e9c0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:40.574242 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e70590ce-21cc-499d-be07-44ac37b3e9c0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:40.575022 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e70590ce-21cc-499d-be07-44ac37b3e9c0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:40.575458 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e70590ce-21cc-499d-be07-44ac37b3e9c0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:40.686005 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e70590ce-21cc-499d-be07-44ac37b3e9c0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:40.695558 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e70590ce-21cc-499d-be07-44ac37b3e9c0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1200 microversion: 2.1 time: 0.132522 Apr 08 11:17:40.696351 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 187/380] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:40 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1200 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:41.715517 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-3274a712-f384-4d8b-aa2f-192eec540762 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:41.716062 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-3274a712-f384-4d8b-aa2f-192eec540762 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:41.723685 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3274a712-f384-4d8b-aa2f-192eec540762 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:41.724161 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3274a712-f384-4d8b-aa2f-192eec540762 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:41.724966 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3274a712-f384-4d8b-aa2f-192eec540762 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:41.725461 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3274a712-f384-4d8b-aa2f-192eec540762 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:41.876471 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-3274a712-f384-4d8b-aa2f-192eec540762 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:41.886250 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-3274a712-f384-4d8b-aa2f-192eec540762 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1278 microversion: 2.1 time: 0.174879 Apr 08 11:17:41.886948 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 194/381] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:41 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1278 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:42.902846 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f8e3d438-b2a6-4f16-8348-76fe8fa46ca3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:42.903454 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f8e3d438-b2a6-4f16-8348-76fe8fa46ca3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:42.909977 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f8e3d438-b2a6-4f16-8348-76fe8fa46ca3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:42.910424 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f8e3d438-b2a6-4f16-8348-76fe8fa46ca3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:42.911245 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f8e3d438-b2a6-4f16-8348-76fe8fa46ca3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:42.911619 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f8e3d438-b2a6-4f16-8348-76fe8fa46ca3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:43.049124 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f8e3d438-b2a6-4f16-8348-76fe8fa46ca3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:43.056587 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f8e3d438-b2a6-4f16-8348-76fe8fa46ca3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1278 microversion: 2.1 time: 0.157724 Apr 08 11:17:43.057231 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 188/382] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:42 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:44.072498 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-4b889cc6-e307-411e-9ea7-cc22cdb04805 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:44.073122 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-4b889cc6-e307-411e-9ea7-cc22cdb04805 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:44.080139 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4b889cc6-e307-411e-9ea7-cc22cdb04805 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:44.080596 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4b889cc6-e307-411e-9ea7-cc22cdb04805 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:44.081376 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4b889cc6-e307-411e-9ea7-cc22cdb04805 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:44.081848 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4b889cc6-e307-411e-9ea7-cc22cdb04805 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:44.218291 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-4b889cc6-e307-411e-9ea7-cc22cdb04805 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:44.225710 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-4b889cc6-e307-411e-9ea7-cc22cdb04805 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1278 microversion: 2.1 time: 0.157049 Apr 08 11:17:44.226310 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 195/383] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:44 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:45.242976 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-879e8054-c438-46ef-a4e3-f44a75609e5e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:45.243626 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-879e8054-c438-46ef-a4e3-f44a75609e5e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:45.250278 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-879e8054-c438-46ef-a4e3-f44a75609e5e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:45.250734 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-879e8054-c438-46ef-a4e3-f44a75609e5e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:45.251527 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-879e8054-c438-46ef-a4e3-f44a75609e5e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:45.251972 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-879e8054-c438-46ef-a4e3-f44a75609e5e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:45.391833 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-879e8054-c438-46ef-a4e3-f44a75609e5e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:45.399440 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-879e8054-c438-46ef-a4e3-f44a75609e5e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1278 microversion: 2.1 time: 0.160507 Apr 08 11:17:45.400053 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 189/384] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:45 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:46.416716 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-b3b0b0ab-c9db-4cbf-801d-8e8548e3ea37 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:46.417332 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-b3b0b0ab-c9db-4cbf-801d-8e8548e3ea37 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:46.423920 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b3b0b0ab-c9db-4cbf-801d-8e8548e3ea37 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:46.424370 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b3b0b0ab-c9db-4cbf-801d-8e8548e3ea37 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:46.425165 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b3b0b0ab-c9db-4cbf-801d-8e8548e3ea37 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:46.425640 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b3b0b0ab-c9db-4cbf-801d-8e8548e3ea37 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:46.566758 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b3b0b0ab-c9db-4cbf-801d-8e8548e3ea37 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:46.574305 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-b3b0b0ab-c9db-4cbf-801d-8e8548e3ea37 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1278 microversion: 2.1 time: 0.161345 Apr 08 11:17:46.574889 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 196/385] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:46 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1278 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:47.591539 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-70e9730b-833a-4f19-a713-5eb010bade56 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:47.593411 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-70e9730b-833a-4f19-a713-5eb010bade56 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:47.599839 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-70e9730b-833a-4f19-a713-5eb010bade56 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:47.600541 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-70e9730b-833a-4f19-a713-5eb010bade56 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:47.604638 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-70e9730b-833a-4f19-a713-5eb010bade56 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:47.604638 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-70e9730b-833a-4f19-a713-5eb010bade56 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:47.830791 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-70e9730b-833a-4f19-a713-5eb010bade56 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:47.838847 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-70e9730b-833a-4f19-a713-5eb010bade56 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1278 microversion: 2.1 time: 0.251255 Apr 08 11:17:47.839564 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 190/386] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:47 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1278 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:47.971004 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [req-5d2bfec9-bfef-46b1-9315-4fc65418fb87 req-cced5a67-c055-4d4f-a4e5-a6cced953265 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcbe20ff-6f97-41c3-bde7-c03ad1d3634c", "tag": "a0f6a311-6139-4dbc-9303-164cfc456792"}]} {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:17:47.980099 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-5d2bfec9-bfef-46b1-9315-4fc65418fb87 req-cced5a67-c055-4d4f-a4e5-a6cced953265 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:47.980966 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-5d2bfec9-bfef-46b1-9315-4fc65418fb87 req-cced5a67-c055-4d4f-a4e5-a6cced953265 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:47.998511 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.compute.server_external_events [req-5d2bfec9-bfef-46b1-9315-4fc65418fb87 req-cced5a67-c055-4d4f-a4e5-a6cced953265 service nova] Creating event network-changed:a0f6a311-6139-4dbc-9303-164cfc456792 for instance fcbe20ff-6f97-41c3-bde7-c03ad1d3634c on hv-cinder-83607 Apr 08 11:17:48.013415 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [req-5d2bfec9-bfef-46b1-9315-4fc65418fb87 req-cced5a67-c055-4d4f-a4e5-a6cced953265 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046270 Apr 08 11:17:48.014070 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 197/387] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:17:48.856441 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4af08a75-3a1f-4bd3-99ba-0be3e727d736 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:48.857089 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4af08a75-3a1f-4bd3-99ba-0be3e727d736 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:48.863183 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4af08a75-3a1f-4bd3-99ba-0be3e727d736 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:48.863638 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4af08a75-3a1f-4bd3-99ba-0be3e727d736 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:48.864407 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4af08a75-3a1f-4bd3-99ba-0be3e727d736 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:48.864844 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4af08a75-3a1f-4bd3-99ba-0be3e727d736 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:49.017594 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4af08a75-3a1f-4bd3-99ba-0be3e727d736 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:49.026380 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4af08a75-3a1f-4bd3-99ba-0be3e727d736 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1278 microversion: 2.1 time: 0.173610 Apr 08 11:17:49.027154 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 191/388] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:48 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1278 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:50.045624 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-8a79e3e5-5611-4302-b128-980d4fe5e384 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:50.047028 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-8a79e3e5-5611-4302-b128-980d4fe5e384 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:50.053166 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8a79e3e5-5611-4302-b128-980d4fe5e384 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:50.053620 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8a79e3e5-5611-4302-b128-980d4fe5e384 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:50.054423 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8a79e3e5-5611-4302-b128-980d4fe5e384 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:50.054865 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8a79e3e5-5611-4302-b128-980d4fe5e384 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:50.201651 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-8a79e3e5-5611-4302-b128-980d4fe5e384 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:50.214960 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-8a79e3e5-5611-4302-b128-980d4fe5e384 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1278 microversion: 2.1 time: 0.173994 Apr 08 11:17:50.215566 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 198/389] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:50 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1278 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:51.231737 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-caeec17b-d6ea-4738-952a-a35bd523c465 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:51.232344 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-caeec17b-d6ea-4738-952a-a35bd523c465 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:51.239004 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-caeec17b-d6ea-4738-952a-a35bd523c465 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:51.239440 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-caeec17b-d6ea-4738-952a-a35bd523c465 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:51.240240 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-caeec17b-d6ea-4738-952a-a35bd523c465 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:51.241547 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-caeec17b-d6ea-4738-952a-a35bd523c465 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:51.386405 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-caeec17b-d6ea-4738-952a-a35bd523c465 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:51.394858 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-caeec17b-d6ea-4738-952a-a35bd523c465 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1278 microversion: 2.1 time: 0.166875 Apr 08 11:17:51.395704 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 192/390] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:51 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1278 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:51.862732 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 11:17:51.862988 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:17:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 11:17:52.412022 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-264ad149-c77e-4e08-b408-2f0597eaa1aa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:52.412752 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-264ad149-c77e-4e08-b408-2f0597eaa1aa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:52.418939 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-264ad149-c77e-4e08-b408-2f0597eaa1aa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:52.419390 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-264ad149-c77e-4e08-b408-2f0597eaa1aa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:52.420157 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-264ad149-c77e-4e08-b408-2f0597eaa1aa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:52.420588 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-264ad149-c77e-4e08-b408-2f0597eaa1aa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:52.558607 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-264ad149-c77e-4e08-b408-2f0597eaa1aa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:52.566495 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-264ad149-c77e-4e08-b408-2f0597eaa1aa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1278 microversion: 2.1 time: 0.158587 Apr 08 11:17:52.567068 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 199/391] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:52 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:53.583353 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3730a2d5-66d2-44c6-b55a-4a48c1edac00 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:53.583998 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3730a2d5-66d2-44c6-b55a-4a48c1edac00 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:53.589915 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3730a2d5-66d2-44c6-b55a-4a48c1edac00 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:53.590388 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3730a2d5-66d2-44c6-b55a-4a48c1edac00 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:53.591160 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3730a2d5-66d2-44c6-b55a-4a48c1edac00 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:53.591599 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3730a2d5-66d2-44c6-b55a-4a48c1edac00 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:53.730567 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3730a2d5-66d2-44c6-b55a-4a48c1edac00 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:53.738932 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3730a2d5-66d2-44c6-b55a-4a48c1edac00 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1278 microversion: 2.1 time: 0.159382 Apr 08 11:17:53.739516 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 193/392] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:53 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:54.756605 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-d6e3628d-9991-44af-bfb4-4a39bd5b9161 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:54.757231 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-d6e3628d-9991-44af-bfb4-4a39bd5b9161 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:54.763850 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d6e3628d-9991-44af-bfb4-4a39bd5b9161 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:54.764304 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d6e3628d-9991-44af-bfb4-4a39bd5b9161 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:54.765099 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d6e3628d-9991-44af-bfb4-4a39bd5b9161 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:54.766136 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d6e3628d-9991-44af-bfb4-4a39bd5b9161 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:54.922955 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d6e3628d-9991-44af-bfb4-4a39bd5b9161 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:54.930312 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-d6e3628d-9991-44af-bfb4-4a39bd5b9161 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1278 microversion: 2.1 time: 0.177673 Apr 08 11:17:54.930888 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 200/393] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:54 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1278 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:55.947298 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7617a0dd-6b56-4ddd-bcdb-3c01c8d0c5f1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:55.947972 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7617a0dd-6b56-4ddd-bcdb-3c01c8d0c5f1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:55.954722 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7617a0dd-6b56-4ddd-bcdb-3c01c8d0c5f1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:55.955173 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7617a0dd-6b56-4ddd-bcdb-3c01c8d0c5f1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:55.955949 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7617a0dd-6b56-4ddd-bcdb-3c01c8d0c5f1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:55.956417 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7617a0dd-6b56-4ddd-bcdb-3c01c8d0c5f1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:56.091399 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7617a0dd-6b56-4ddd-bcdb-3c01c8d0c5f1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:56.098725 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7617a0dd-6b56-4ddd-bcdb-3c01c8d0c5f1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1278 microversion: 2.1 time: 0.155237 Apr 08 11:17:56.099295 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 194/394] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:55 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:57.116419 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-26c39f16-8e85-4cad-a741-a3cd1c12af13 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:57.117789 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-26c39f16-8e85-4cad-a741-a3cd1c12af13 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:57.124863 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-26c39f16-8e85-4cad-a741-a3cd1c12af13 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:57.125888 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-26c39f16-8e85-4cad-a741-a3cd1c12af13 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:57.126682 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-26c39f16-8e85-4cad-a741-a3cd1c12af13 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:57.127148 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-26c39f16-8e85-4cad-a741-a3cd1c12af13 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:57.274440 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-26c39f16-8e85-4cad-a741-a3cd1c12af13 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:57.282107 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-26c39f16-8e85-4cad-a741-a3cd1c12af13 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1278 microversion: 2.1 time: 0.170023 Apr 08 11:17:57.282707 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 201/395] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:57 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1278 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:58.298954 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0dbaffe7-99f5-4e3d-b564-e82d07ebfcd6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:58.299648 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0dbaffe7-99f5-4e3d-b564-e82d07ebfcd6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:58.305591 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0dbaffe7-99f5-4e3d-b564-e82d07ebfcd6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:58.306062 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0dbaffe7-99f5-4e3d-b564-e82d07ebfcd6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:58.306841 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0dbaffe7-99f5-4e3d-b564-e82d07ebfcd6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:58.307275 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0dbaffe7-99f5-4e3d-b564-e82d07ebfcd6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:58.444704 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0dbaffe7-99f5-4e3d-b564-e82d07ebfcd6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:58.451979 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0dbaffe7-99f5-4e3d-b564-e82d07ebfcd6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1278 microversion: 2.1 time: 0.156872 Apr 08 11:17:58.452541 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 195/396] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:58 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:17:59.469290 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-ed2c691c-f724-497f-a50a-dbef04af8047 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:17:59.469949 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-ed2c691c-f724-497f-a50a-dbef04af8047 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:17:59.476921 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ed2c691c-f724-497f-a50a-dbef04af8047 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:59.477376 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ed2c691c-f724-497f-a50a-dbef04af8047 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:59.478194 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ed2c691c-f724-497f-a50a-dbef04af8047 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:17:59.478643 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ed2c691c-f724-497f-a50a-dbef04af8047 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:17:59.632214 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-ed2c691c-f724-497f-a50a-dbef04af8047 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:17:59.642798 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-ed2c691c-f724-497f-a50a-dbef04af8047 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1278 microversion: 2.1 time: 0.178051 Apr 08 11:17:59.643787 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 202/397] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:17:59 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1278 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:00.661180 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bba57a42-931f-44dc-b12e-1283e9ac5cb7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:00.661908 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-bba57a42-931f-44dc-b12e-1283e9ac5cb7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:00.668378 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bba57a42-931f-44dc-b12e-1283e9ac5cb7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:00.669054 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bba57a42-931f-44dc-b12e-1283e9ac5cb7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:00.670160 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bba57a42-931f-44dc-b12e-1283e9ac5cb7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:00.671030 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bba57a42-931f-44dc-b12e-1283e9ac5cb7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:00.837962 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-bba57a42-931f-44dc-b12e-1283e9ac5cb7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:00.846008 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-bba57a42-931f-44dc-b12e-1283e9ac5cb7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1278 microversion: 2.1 time: 0.188762 Apr 08 11:18:00.846592 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 196/398] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:00 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1278 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:01.866519 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-62a9472f-65c2-4457-bfc9-d4f75c3b7514 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:01.867165 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-62a9472f-65c2-4457-bfc9-d4f75c3b7514 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:01.874239 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-62a9472f-65c2-4457-bfc9-d4f75c3b7514 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:01.874715 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-62a9472f-65c2-4457-bfc9-d4f75c3b7514 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:01.876153 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-62a9472f-65c2-4457-bfc9-d4f75c3b7514 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:01.876583 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-62a9472f-65c2-4457-bfc9-d4f75c3b7514 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:02.015409 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-62a9472f-65c2-4457-bfc9-d4f75c3b7514 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:02.022702 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-62a9472f-65c2-4457-bfc9-d4f75c3b7514 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1278 microversion: 2.1 time: 0.163568 Apr 08 11:18:02.023270 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 203/399] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:01 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:03.040077 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0c1babe4-e235-491e-b21b-544588ef1687 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:03.040696 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0c1babe4-e235-491e-b21b-544588ef1687 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:03.047247 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0c1babe4-e235-491e-b21b-544588ef1687 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:03.047967 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0c1babe4-e235-491e-b21b-544588ef1687 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:03.048845 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0c1babe4-e235-491e-b21b-544588ef1687 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:03.049288 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0c1babe4-e235-491e-b21b-544588ef1687 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:03.195911 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0c1babe4-e235-491e-b21b-544588ef1687 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:03.204138 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0c1babe4-e235-491e-b21b-544588ef1687 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1278 microversion: 2.1 time: 0.168237 Apr 08 11:18:03.204729 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 197/400] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:03 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1278 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:04.221287 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-29f9d1f0-25a4-4229-bfad-2720e6722032 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:04.221917 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-29f9d1f0-25a4-4229-bfad-2720e6722032 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:04.228215 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-29f9d1f0-25a4-4229-bfad-2720e6722032 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:04.228670 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-29f9d1f0-25a4-4229-bfad-2720e6722032 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:04.229442 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-29f9d1f0-25a4-4229-bfad-2720e6722032 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:04.229920 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-29f9d1f0-25a4-4229-bfad-2720e6722032 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:04.376895 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-29f9d1f0-25a4-4229-bfad-2720e6722032 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:04.384434 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-29f9d1f0-25a4-4229-bfad-2720e6722032 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1278 microversion: 2.1 time: 0.167225 Apr 08 11:18:04.385031 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 204/401] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:04 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1278 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:05.402040 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c7fd6978-1cc9-4ad5-9686-9384874cc58f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:05.402835 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c7fd6978-1cc9-4ad5-9686-9384874cc58f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:05.409290 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c7fd6978-1cc9-4ad5-9686-9384874cc58f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:05.409758 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c7fd6978-1cc9-4ad5-9686-9384874cc58f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:05.410553 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c7fd6978-1cc9-4ad5-9686-9384874cc58f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:05.410992 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c7fd6978-1cc9-4ad5-9686-9384874cc58f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:05.550892 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c7fd6978-1cc9-4ad5-9686-9384874cc58f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:05.558605 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c7fd6978-1cc9-4ad5-9686-9384874cc58f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1278 microversion: 2.1 time: 0.160480 Apr 08 11:18:05.562216 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 198/402] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:05 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:06.575788 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-aa2e62f1-a9a3-478b-a424-798d3a5e1fa6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:06.576396 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-aa2e62f1-a9a3-478b-a424-798d3a5e1fa6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:06.583158 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-aa2e62f1-a9a3-478b-a424-798d3a5e1fa6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:06.583614 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-aa2e62f1-a9a3-478b-a424-798d3a5e1fa6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:06.584411 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-aa2e62f1-a9a3-478b-a424-798d3a5e1fa6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:06.584869 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-aa2e62f1-a9a3-478b-a424-798d3a5e1fa6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:06.723022 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-aa2e62f1-a9a3-478b-a424-798d3a5e1fa6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:06.730720 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-aa2e62f1-a9a3-478b-a424-798d3a5e1fa6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1266 microversion: 2.1 time: 0.158747 Apr 08 11:18:06.731306 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 205/403] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:06 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:07.749523 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8b372406-3efd-42a0-bad5-732faaee76c2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:07.750791 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8b372406-3efd-42a0-bad5-732faaee76c2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:07.757054 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8b372406-3efd-42a0-bad5-732faaee76c2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:07.757510 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8b372406-3efd-42a0-bad5-732faaee76c2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:07.758340 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8b372406-3efd-42a0-bad5-732faaee76c2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:07.758825 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8b372406-3efd-42a0-bad5-732faaee76c2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:07.899955 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8b372406-3efd-42a0-bad5-732faaee76c2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:07.908122 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8b372406-3efd-42a0-bad5-732faaee76c2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1266 microversion: 2.1 time: 0.162371 Apr 08 11:18:07.908700 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 199/404] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:07 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:08.925645 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-ffe4d4d3-9be9-47ab-9436-9f794d67ba3e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:08.926332 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-ffe4d4d3-9be9-47ab-9436-9f794d67ba3e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:08.934257 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ffe4d4d3-9be9-47ab-9436-9f794d67ba3e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:08.934712 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ffe4d4d3-9be9-47ab-9436-9f794d67ba3e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:08.935539 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ffe4d4d3-9be9-47ab-9436-9f794d67ba3e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:08.935980 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ffe4d4d3-9be9-47ab-9436-9f794d67ba3e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:09.089089 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-ffe4d4d3-9be9-47ab-9436-9f794d67ba3e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:09.097603 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-ffe4d4d3-9be9-47ab-9436-9f794d67ba3e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1266 microversion: 2.1 time: 0.176509 Apr 08 11:18:09.098210 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 206/405] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:08 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:10.114563 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b076c1d6-f12a-4df2-a9b5-8fea7ed6a9c9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:10.115211 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b076c1d6-f12a-4df2-a9b5-8fea7ed6a9c9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:10.121579 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b076c1d6-f12a-4df2-a9b5-8fea7ed6a9c9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:10.122063 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b076c1d6-f12a-4df2-a9b5-8fea7ed6a9c9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:10.122856 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b076c1d6-f12a-4df2-a9b5-8fea7ed6a9c9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:10.123295 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b076c1d6-f12a-4df2-a9b5-8fea7ed6a9c9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:10.273439 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b076c1d6-f12a-4df2-a9b5-8fea7ed6a9c9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:10.281026 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b076c1d6-f12a-4df2-a9b5-8fea7ed6a9c9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1266 microversion: 2.1 time: 0.170270 Apr 08 11:18:10.281650 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 200/406] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:10 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:11.298523 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-faed77dd-85ee-4930-b68b-dcd73c8acfc1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:11.299144 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-faed77dd-85ee-4930-b68b-dcd73c8acfc1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:11.305836 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-faed77dd-85ee-4930-b68b-dcd73c8acfc1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:11.306292 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-faed77dd-85ee-4930-b68b-dcd73c8acfc1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:11.307075 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-faed77dd-85ee-4930-b68b-dcd73c8acfc1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:11.307517 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-faed77dd-85ee-4930-b68b-dcd73c8acfc1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:11.457835 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-faed77dd-85ee-4930-b68b-dcd73c8acfc1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:11.465799 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-faed77dd-85ee-4930-b68b-dcd73c8acfc1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1266 microversion: 2.1 time: 0.171765 Apr 08 11:18:11.466387 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 207/407] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:11 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:12.482816 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-26ac72fb-0ffc-47f0-b2fd-33f7f0dcf5c9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:12.483427 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-26ac72fb-0ffc-47f0-b2fd-33f7f0dcf5c9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:12.489878 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-26ac72fb-0ffc-47f0-b2fd-33f7f0dcf5c9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:12.490364 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-26ac72fb-0ffc-47f0-b2fd-33f7f0dcf5c9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:12.491258 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-26ac72fb-0ffc-47f0-b2fd-33f7f0dcf5c9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:12.491582 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-26ac72fb-0ffc-47f0-b2fd-33f7f0dcf5c9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:12.655576 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-26ac72fb-0ffc-47f0-b2fd-33f7f0dcf5c9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:12.665138 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-26ac72fb-0ffc-47f0-b2fd-33f7f0dcf5c9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1266 microversion: 2.1 time: 0.186025 Apr 08 11:18:12.666026 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 201/408] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:12 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:13.684751 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-0f5480c8-9f6c-4d32-b605-8ae0ae2d9799 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:13.685393 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-0f5480c8-9f6c-4d32-b605-8ae0ae2d9799 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:13.691972 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0f5480c8-9f6c-4d32-b605-8ae0ae2d9799 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:13.692434 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0f5480c8-9f6c-4d32-b605-8ae0ae2d9799 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:13.693227 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0f5480c8-9f6c-4d32-b605-8ae0ae2d9799 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:13.693668 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0f5480c8-9f6c-4d32-b605-8ae0ae2d9799 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:13.838317 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-0f5480c8-9f6c-4d32-b605-8ae0ae2d9799 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:13.850745 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-0f5480c8-9f6c-4d32-b605-8ae0ae2d9799 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1266 microversion: 2.1 time: 0.169465 Apr 08 11:18:13.851805 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 208/409] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:13 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:14.877533 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b162b279-63ba-453a-a128-af04c57c2d8d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:14.878232 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b162b279-63ba-453a-a128-af04c57c2d8d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:14.888905 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b162b279-63ba-453a-a128-af04c57c2d8d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:14.890139 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b162b279-63ba-453a-a128-af04c57c2d8d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:14.891674 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b162b279-63ba-453a-a128-af04c57c2d8d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:14.892581 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b162b279-63ba-453a-a128-af04c57c2d8d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:15.107881 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b162b279-63ba-453a-a128-af04c57c2d8d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:15.116469 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b162b279-63ba-453a-a128-af04c57c2d8d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1266 microversion: 2.1 time: 0.243049 Apr 08 11:18:15.117062 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 202/410] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:14 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:16.134445 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-5d83dfa7-623a-4dee-809f-b027dc49e1af tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:16.135097 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-5d83dfa7-623a-4dee-809f-b027dc49e1af tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:16.142275 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5d83dfa7-623a-4dee-809f-b027dc49e1af tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:16.142718 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5d83dfa7-623a-4dee-809f-b027dc49e1af tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:16.143509 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5d83dfa7-623a-4dee-809f-b027dc49e1af tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:16.143943 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5d83dfa7-623a-4dee-809f-b027dc49e1af tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:16.332436 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-5d83dfa7-623a-4dee-809f-b027dc49e1af tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:16.340242 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-5d83dfa7-623a-4dee-809f-b027dc49e1af tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1266 microversion: 2.1 time: 0.209849 Apr 08 11:18:16.340831 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 209/411] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:16 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:17.362782 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4dc5587c-2179-4069-8227-aeb79ca64232 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:17.363415 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4dc5587c-2179-4069-8227-aeb79ca64232 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:17.370144 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4dc5587c-2179-4069-8227-aeb79ca64232 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:17.372878 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4dc5587c-2179-4069-8227-aeb79ca64232 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:17.372878 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4dc5587c-2179-4069-8227-aeb79ca64232 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:17.372878 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4dc5587c-2179-4069-8227-aeb79ca64232 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:17.530717 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4dc5587c-2179-4069-8227-aeb79ca64232 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:17.540946 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4dc5587c-2179-4069-8227-aeb79ca64232 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1266 microversion: 2.1 time: 0.184635 Apr 08 11:18:17.541506 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 203/412] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:17 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:18.570854 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-6a10cb4d-9643-4f8d-abe5-bcc7a159c546 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:18.571468 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-6a10cb4d-9643-4f8d-abe5-bcc7a159c546 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:18.578605 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6a10cb4d-9643-4f8d-abe5-bcc7a159c546 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:18.579052 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6a10cb4d-9643-4f8d-abe5-bcc7a159c546 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:18.579838 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6a10cb4d-9643-4f8d-abe5-bcc7a159c546 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:18.580284 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6a10cb4d-9643-4f8d-abe5-bcc7a159c546 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:18.826713 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6a10cb4d-9643-4f8d-abe5-bcc7a159c546 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:18.840148 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-6a10cb4d-9643-4f8d-abe5-bcc7a159c546 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1266 microversion: 2.1 time: 0.275068 Apr 08 11:18:18.841184 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 210/413] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:18 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1266 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:19.858589 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7c98a005-22c2-4a59-8e1a-8baf6a2c95cd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:19.859227 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7c98a005-22c2-4a59-8e1a-8baf6a2c95cd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:19.866117 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7c98a005-22c2-4a59-8e1a-8baf6a2c95cd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:19.866578 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7c98a005-22c2-4a59-8e1a-8baf6a2c95cd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:19.867365 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7c98a005-22c2-4a59-8e1a-8baf6a2c95cd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:19.867806 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7c98a005-22c2-4a59-8e1a-8baf6a2c95cd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:20.033288 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7c98a005-22c2-4a59-8e1a-8baf6a2c95cd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:20.041718 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7c98a005-22c2-4a59-8e1a-8baf6a2c95cd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1266 microversion: 2.1 time: 0.187099 Apr 08 11:18:20.047921 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 204/414] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:19 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:20.854226 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-c43272c1-a90f-489b-915b-1275185f14e7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1698649026", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1239149749", "security_groups": [{"name": "tempest-secgroup-smoke-104119444"}], "networks": [{"uuid": "c6c5afb0-70e9-4703-a660-436da0f05f91"}], "block_device_mapping_v2": [{"uuid": "1af1b5a3-a95a-4832-869c-25782366fe13", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:18:20.981457 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.network.neutron [None req-c43272c1-a90f-489b-915b-1275185f14e7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] validate_networks() for [('c6c5afb0-70e9-4703-a660-436da0f05f91', None, None, None, None, None)] {{(pid=117801) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 08 11:18:21.062006 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1618a601-7145-4e45-ac77-005c28727d33 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:21.063742 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1618a601-7145-4e45-ac77-005c28727d33 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:21.073738 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1618a601-7145-4e45-ac77-005c28727d33 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:21.074777 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1618a601-7145-4e45-ac77-005c28727d33 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:21.076386 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1618a601-7145-4e45-ac77-005c28727d33 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:21.077149 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1618a601-7145-4e45-ac77-005c28727d33 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:21.308400 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1618a601-7145-4e45-ac77-005c28727d33 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:21.317929 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1618a601-7145-4e45-ac77-005c28727d33 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1266 microversion: 2.1 time: 0.260621 Apr 08 11:18:21.318968 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 205/415] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:21 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1266 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:21.507083 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.virt.hardware [None req-c43272c1-a90f-489b-915b-1275185f14e7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Flavor limits 0:0:0 {{(pid=117801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 11:18:21.507509 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.virt.hardware [None req-c43272c1-a90f-489b-915b-1275185f14e7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Image limits 0:0:0 {{(pid=117801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 11:18:21.507983 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.virt.hardware [None req-c43272c1-a90f-489b-915b-1275185f14e7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Flavor pref 0:0:0 {{(pid=117801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 11:18:21.508488 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.virt.hardware [None req-c43272c1-a90f-489b-915b-1275185f14e7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Image pref 0:0:0 {{(pid=117801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 11:18:21.508965 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.virt.hardware [None req-c43272c1-a90f-489b-915b-1275185f14e7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 11:18:21.517790 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c43272c1-a90f-489b-915b-1275185f14e7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:21.518457 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c43272c1-a90f-489b-915b-1275185f14e7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:21.519818 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c43272c1-a90f-489b-915b-1275185f14e7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:21.520560 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c43272c1-a90f-489b-915b-1275185f14e7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:21.545508 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.quota [None req-c43272c1-a90f-489b-915b-1275185f14e7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Getting quotas for project 7b145acd79ca42c2a72a54be4e950a97. Resources: {'instances', 'ram', 'cores'} {{(pid=117801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 11:18:21.551130 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.quota [None req-c43272c1-a90f-489b-915b-1275185f14e7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Getting quotas for user f5f00b50061845bab2717e8483efec94 and project 7b145acd79ca42c2a72a54be4e950a97. Resources: {'instances', 'ram', 'cores'} {{(pid=117801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 11:18:21.624210 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-c43272c1-a90f-489b-915b-1275185f14e7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Going to run 1 instances... {{(pid=117801) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 08 11:18:21.626467 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-c43272c1-a90f-489b-915b-1275185f14e7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1af1b5a3-a95a-4832-869c-25782366fe13',volume_size=None,volume_type=None)] {{(pid=117801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 08 11:18:22.055402 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-c43272c1-a90f-489b-915b-1275185f14e7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.205775 Apr 08 11:18:22.056148 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 211/416] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Apr 8 11:18:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 1207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 11:18:22.070496 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f5c38fc3-f30e-42fc-b311-bad419da3977 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:22.071140 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f5c38fc3-f30e-42fc-b311-bad419da3977 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:22.140186 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f5c38fc3-f30e-42fc-b311-bad419da3977 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:22.151765 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f5c38fc3-f30e-42fc-b311-bad419da3977 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1089 microversion: 2.1 time: 0.084733 Apr 08 11:18:22.152835 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 206/417] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:22 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1089 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:22.336111 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-3f9ebf8c-6582-4955-a7c1-97a1c3a67fa2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:22.336888 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-3f9ebf8c-6582-4955-a7c1-97a1c3a67fa2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:22.344095 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3f9ebf8c-6582-4955-a7c1-97a1c3a67fa2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:22.344721 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3f9ebf8c-6582-4955-a7c1-97a1c3a67fa2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:22.345682 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3f9ebf8c-6582-4955-a7c1-97a1c3a67fa2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:22.346274 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3f9ebf8c-6582-4955-a7c1-97a1c3a67fa2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:22.512360 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-3f9ebf8c-6582-4955-a7c1-97a1c3a67fa2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:22.520714 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-3f9ebf8c-6582-4955-a7c1-97a1c3a67fa2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1266 microversion: 2.1 time: 0.188600 Apr 08 11:18:22.521304 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 212/418] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:22 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:23.175971 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e62364fc-6917-4e16-8a3f-41912b334fef tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:23.176900 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e62364fc-6917-4e16-8a3f-41912b334fef tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:23.232419 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e62364fc-6917-4e16-8a3f-41912b334fef tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:23.241159 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e62364fc-6917-4e16-8a3f-41912b334fef tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1089 microversion: 2.1 time: 0.069501 Apr 08 11:18:23.241745 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 207/419] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:23 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1089 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:23.538180 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-75e24d5f-03e8-427c-b187-260eb2910445 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:23.539001 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-75e24d5f-03e8-427c-b187-260eb2910445 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:23.546250 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-75e24d5f-03e8-427c-b187-260eb2910445 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:23.546776 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-75e24d5f-03e8-427c-b187-260eb2910445 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:23.547581 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-75e24d5f-03e8-427c-b187-260eb2910445 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:23.548594 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-75e24d5f-03e8-427c-b187-260eb2910445 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:23.752868 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-75e24d5f-03e8-427c-b187-260eb2910445 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:23.766154 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-75e24d5f-03e8-427c-b187-260eb2910445 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1266 microversion: 2.1 time: 0.231179 Apr 08 11:18:23.767534 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 213/420] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:23 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:24.271386 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2d83ee92-1a62-4502-bf25-d4b0f46a3e2f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:24.274539 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2d83ee92-1a62-4502-bf25-d4b0f46a3e2f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:24.287806 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2d83ee92-1a62-4502-bf25-d4b0f46a3e2f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:24.288734 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2d83ee92-1a62-4502-bf25-d4b0f46a3e2f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:24.290919 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2d83ee92-1a62-4502-bf25-d4b0f46a3e2f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:24.291991 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2d83ee92-1a62-4502-bf25-d4b0f46a3e2f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:24.419765 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2d83ee92-1a62-4502-bf25-d4b0f46a3e2f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:24.429227 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2d83ee92-1a62-4502-bf25-d4b0f46a3e2f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1187 microversion: 2.1 time: 0.165421 Apr 08 11:18:24.439492 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 208/421] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:24 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1187 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:24.789357 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-287471b9-074d-4d9e-80d0-af92ca819453 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:24.790297 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-287471b9-074d-4d9e-80d0-af92ca819453 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:24.796917 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-287471b9-074d-4d9e-80d0-af92ca819453 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:24.804419 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-287471b9-074d-4d9e-80d0-af92ca819453 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:24.804419 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-287471b9-074d-4d9e-80d0-af92ca819453 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:24.804419 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-287471b9-074d-4d9e-80d0-af92ca819453 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:24.988391 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-287471b9-074d-4d9e-80d0-af92ca819453 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:25.001278 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-287471b9-074d-4d9e-80d0-af92ca819453 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1266 microversion: 2.1 time: 0.215453 Apr 08 11:18:25.002337 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 214/422] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:24 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:25.457918 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-33c3d37c-278b-4278-b6a8-7ae0758e9f12 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:25.462022 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-33c3d37c-278b-4278-b6a8-7ae0758e9f12 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:25.475575 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-33c3d37c-278b-4278-b6a8-7ae0758e9f12 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:25.477734 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-33c3d37c-278b-4278-b6a8-7ae0758e9f12 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:25.479988 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-33c3d37c-278b-4278-b6a8-7ae0758e9f12 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:25.480996 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-33c3d37c-278b-4278-b6a8-7ae0758e9f12 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:25.603778 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-33c3d37c-278b-4278-b6a8-7ae0758e9f12 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:25.639750 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-33c3d37c-278b-4278-b6a8-7ae0758e9f12 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1205 microversion: 2.1 time: 0.177771 Apr 08 11:18:25.650533 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 209/423] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:25 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1205 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:26.024808 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-abae056e-1462-4fde-8a9a-f0a3d4dc5447 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:26.026245 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-abae056e-1462-4fde-8a9a-f0a3d4dc5447 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:26.034099 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-abae056e-1462-4fde-8a9a-f0a3d4dc5447 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:26.034950 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-abae056e-1462-4fde-8a9a-f0a3d4dc5447 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:26.035998 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-abae056e-1462-4fde-8a9a-f0a3d4dc5447 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:26.036737 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-abae056e-1462-4fde-8a9a-f0a3d4dc5447 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:26.242207 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-abae056e-1462-4fde-8a9a-f0a3d4dc5447 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:26.253684 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-abae056e-1462-4fde-8a9a-f0a3d4dc5447 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1266 microversion: 2.1 time: 0.232727 Apr 08 11:18:26.254943 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 215/424] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:26 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:26.666701 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-aa72fbd0-7f05-40f2-9c95-b7063c860f29 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:26.667610 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-aa72fbd0-7f05-40f2-9c95-b7063c860f29 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:26.675249 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aa72fbd0-7f05-40f2-9c95-b7063c860f29 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:26.675993 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aa72fbd0-7f05-40f2-9c95-b7063c860f29 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:26.676871 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aa72fbd0-7f05-40f2-9c95-b7063c860f29 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:26.677398 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aa72fbd0-7f05-40f2-9c95-b7063c860f29 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:26.916483 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-aa72fbd0-7f05-40f2-9c95-b7063c860f29 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:26.928788 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-aa72fbd0-7f05-40f2-9c95-b7063c860f29 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1272 microversion: 2.1 time: 0.268325 Apr 08 11:18:26.929376 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 210/425] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:26 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1272 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:27.272839 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-30ae0f69-6b69-483d-b04e-4ca8b7af41ed tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:27.274140 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-30ae0f69-6b69-483d-b04e-4ca8b7af41ed tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:27.283641 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-30ae0f69-6b69-483d-b04e-4ca8b7af41ed tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:27.284681 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-30ae0f69-6b69-483d-b04e-4ca8b7af41ed tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:27.285886 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-30ae0f69-6b69-483d-b04e-4ca8b7af41ed tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:27.286723 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-30ae0f69-6b69-483d-b04e-4ca8b7af41ed tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:27.589882 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-30ae0f69-6b69-483d-b04e-4ca8b7af41ed tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:27.598190 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-30ae0f69-6b69-483d-b04e-4ca8b7af41ed tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1266 microversion: 2.1 time: 0.329971 Apr 08 11:18:27.599270 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 216/426] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:27 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1266 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:27.811890 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-e695cf6c-8f9c-4211-a2ca-99d4457112d1 req-79e5859c-3855-4456-9143-c366a6c093de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6031de3c-c187-4e54-b340-ad53edbe9ee6", "tag": "58170f46-0bda-4d91-90b4-61e81203f4f5"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:18:27.822982 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-e695cf6c-8f9c-4211-a2ca-99d4457112d1 req-79e5859c-3855-4456-9143-c366a6c093de service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:27.825341 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-e695cf6c-8f9c-4211-a2ca-99d4457112d1 req-79e5859c-3855-4456-9143-c366a6c093de service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:27.839144 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-e695cf6c-8f9c-4211-a2ca-99d4457112d1 req-79e5859c-3855-4456-9143-c366a6c093de service nova] Creating event network-changed:58170f46-0bda-4d91-90b4-61e81203f4f5 for instance 6031de3c-c187-4e54-b340-ad53edbe9ee6 on hv-cinder-83607 Apr 08 11:18:27.857429 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-e695cf6c-8f9c-4211-a2ca-99d4457112d1 req-79e5859c-3855-4456-9143-c366a6c093de service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045941 Apr 08 11:18:27.858539 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 211/427] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:18:27.893754 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [req-7443845c-9983-4827-8e01-d5595ca0a357 req-cf5c2b28-7989-4134-8878-4d0a0abd2eb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcbe20ff-6f97-41c3-bde7-c03ad1d3634c", "name": "network-vif-plugged", "status": "completed", "tag": "a0f6a311-6139-4dbc-9303-164cfc456792"}]} {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:18:27.913474 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-7443845c-9983-4827-8e01-d5595ca0a357 req-cf5c2b28-7989-4134-8878-4d0a0abd2eb4 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:27.914042 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-7443845c-9983-4827-8e01-d5595ca0a357 req-cf5c2b28-7989-4134-8878-4d0a0abd2eb4 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:27.933031 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.compute.server_external_events [req-7443845c-9983-4827-8e01-d5595ca0a357 req-cf5c2b28-7989-4134-8878-4d0a0abd2eb4 service nova] Creating event network-vif-plugged:a0f6a311-6139-4dbc-9303-164cfc456792 for instance fcbe20ff-6f97-41c3-bde7-c03ad1d3634c on hv-cinder-83607 Apr 08 11:18:27.942406 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [req-7443845c-9983-4827-8e01-d5595ca0a357 req-cf5c2b28-7989-4134-8878-4d0a0abd2eb4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059419 Apr 08 11:18:27.943867 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 217/428] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:18:27.947916 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d194c149-65b0-4acc-add5-e445b496d6b1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:27.948724 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d194c149-65b0-4acc-add5-e445b496d6b1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:27.957623 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d194c149-65b0-4acc-add5-e445b496d6b1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:27.958451 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d194c149-65b0-4acc-add5-e445b496d6b1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:27.959495 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d194c149-65b0-4acc-add5-e445b496d6b1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:27.962126 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d194c149-65b0-4acc-add5-e445b496d6b1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:28.251339 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d194c149-65b0-4acc-add5-e445b496d6b1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:28.262703 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d194c149-65b0-4acc-add5-e445b496d6b1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1260 microversion: 2.1 time: 0.319151 Apr 08 11:18:28.264074 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 212/429] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:27 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1260 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:28.621505 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-617d145e-46f3-4c42-adb7-469b65fce523 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:28.624335 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-617d145e-46f3-4c42-adb7-469b65fce523 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:28.629734 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-617d145e-46f3-4c42-adb7-469b65fce523 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:28.630226 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-617d145e-46f3-4c42-adb7-469b65fce523 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:28.631017 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-617d145e-46f3-4c42-adb7-469b65fce523 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:28.631544 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-617d145e-46f3-4c42-adb7-469b65fce523 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:28.816399 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-617d145e-46f3-4c42-adb7-469b65fce523 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:28.824025 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-617d145e-46f3-4c42-adb7-469b65fce523 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1266 microversion: 2.1 time: 0.207089 Apr 08 11:18:28.824613 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 218/430] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:28 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:29.285415 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f6c10f33-9c7f-48d7-afc6-0b997d7f9b06 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:29.286232 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f6c10f33-9c7f-48d7-afc6-0b997d7f9b06 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:29.293335 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f6c10f33-9c7f-48d7-afc6-0b997d7f9b06 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:29.293926 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f6c10f33-9c7f-48d7-afc6-0b997d7f9b06 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:29.294779 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f6c10f33-9c7f-48d7-afc6-0b997d7f9b06 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:29.295311 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f6c10f33-9c7f-48d7-afc6-0b997d7f9b06 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:29.466968 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f6c10f33-9c7f-48d7-afc6-0b997d7f9b06 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:29.509545 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f6c10f33-9c7f-48d7-afc6-0b997d7f9b06 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1260 microversion: 2.1 time: 0.193963 Apr 08 11:18:29.509545 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 213/431] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:29 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1260 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:29.840622 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-6278d922-2c15-46ff-842f-8e6d166ddd0b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:29.841230 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-6278d922-2c15-46ff-842f-8e6d166ddd0b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:29.847767 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6278d922-2c15-46ff-842f-8e6d166ddd0b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:29.848275 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6278d922-2c15-46ff-842f-8e6d166ddd0b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:29.848987 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6278d922-2c15-46ff-842f-8e6d166ddd0b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:29.849465 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6278d922-2c15-46ff-842f-8e6d166ddd0b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:30.013052 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6278d922-2c15-46ff-842f-8e6d166ddd0b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:30.021135 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-6278d922-2c15-46ff-842f-8e6d166ddd0b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1266 microversion: 2.1 time: 0.184220 Apr 08 11:18:30.021729 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 219/432] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:29 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:30.492131 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8cc5262e-a0dc-42a0-89c3-563834544ebf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:30.492774 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8cc5262e-a0dc-42a0-89c3-563834544ebf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:30.501183 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8cc5262e-a0dc-42a0-89c3-563834544ebf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:30.501653 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8cc5262e-a0dc-42a0-89c3-563834544ebf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:30.502458 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8cc5262e-a0dc-42a0-89c3-563834544ebf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:30.502908 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8cc5262e-a0dc-42a0-89c3-563834544ebf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:30.691909 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8cc5262e-a0dc-42a0-89c3-563834544ebf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:30.699608 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8cc5262e-a0dc-42a0-89c3-563834544ebf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1260 microversion: 2.1 time: 0.211326 Apr 08 11:18:30.700181 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 214/433] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:30 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1260 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:31.038548 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-231e5210-3511-4ecc-8b16-1f900ade9886 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:31.039274 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-231e5210-3511-4ecc-8b16-1f900ade9886 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:31.045544 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-231e5210-3511-4ecc-8b16-1f900ade9886 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:31.046090 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-231e5210-3511-4ecc-8b16-1f900ade9886 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:31.046873 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-231e5210-3511-4ecc-8b16-1f900ade9886 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:31.047323 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-231e5210-3511-4ecc-8b16-1f900ade9886 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:31.195987 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-231e5210-3511-4ecc-8b16-1f900ade9886 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:31.203763 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-231e5210-3511-4ecc-8b16-1f900ade9886 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1454 microversion: 2.1 time: 0.169040 Apr 08 11:18:31.204871 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 220/434] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:31 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1454 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:31.221202 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f8e7f25c-80f6-45fa-a404-92e5802278f0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:31.221840 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f8e7f25c-80f6-45fa-a404-92e5802278f0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:31.227619 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f8e7f25c-80f6-45fa-a404-92e5802278f0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:31.228062 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f8e7f25c-80f6-45fa-a404-92e5802278f0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:31.228827 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f8e7f25c-80f6-45fa-a404-92e5802278f0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:31.229261 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f8e7f25c-80f6-45fa-a404-92e5802278f0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:31.441793 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f8e7f25c-80f6-45fa-a404-92e5802278f0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:31.449414 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f8e7f25c-80f6-45fa-a404-92e5802278f0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1454 microversion: 2.1 time: 0.232159 Apr 08 11:18:31.455045 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 215/435] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:31 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1454 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:31.717381 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-b9c51eab-577c-420b-9bd4-13e1efb01145 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:31.718140 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-b9c51eab-577c-420b-9bd4-13e1efb01145 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:31.724439 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b9c51eab-577c-420b-9bd4-13e1efb01145 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:31.724892 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b9c51eab-577c-420b-9bd4-13e1efb01145 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:31.725722 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b9c51eab-577c-420b-9bd4-13e1efb01145 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:31.726200 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b9c51eab-577c-420b-9bd4-13e1efb01145 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:31.947701 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b9c51eab-577c-420b-9bd4-13e1efb01145 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:31.955800 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-b9c51eab-577c-420b-9bd4-13e1efb01145 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1260 microversion: 2.1 time: 0.242570 Apr 08 11:18:31.960576 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 221/436] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:31 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1260 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:32.972366 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7eddd1c4-4483-46f7-8cdc-c1b92d973bf2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:32.973072 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7eddd1c4-4483-46f7-8cdc-c1b92d973bf2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:32.978748 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7eddd1c4-4483-46f7-8cdc-c1b92d973bf2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:32.979204 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7eddd1c4-4483-46f7-8cdc-c1b92d973bf2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:32.979977 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7eddd1c4-4483-46f7-8cdc-c1b92d973bf2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:32.980412 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7eddd1c4-4483-46f7-8cdc-c1b92d973bf2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:33.216400 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7eddd1c4-4483-46f7-8cdc-c1b92d973bf2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:33.223892 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7eddd1c4-4483-46f7-8cdc-c1b92d973bf2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1260 microversion: 2.1 time: 0.255396 Apr 08 11:18:33.224468 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 216/437] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:32 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1260 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:34.038231 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [req-0a4902e1-bbbb-4ab2-a2d3-2e080c48ea93 req-7a77810b-4e97-409f-ba67-e16d8d0aefa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcbe20ff-6f97-41c3-bde7-c03ad1d3634c", "tag": "a0f6a311-6139-4dbc-9303-164cfc456792"}]} {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:18:34.047489 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-0a4902e1-bbbb-4ab2-a2d3-2e080c48ea93 req-7a77810b-4e97-409f-ba67-e16d8d0aefa8 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:34.048449 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-0a4902e1-bbbb-4ab2-a2d3-2e080c48ea93 req-7a77810b-4e97-409f-ba67-e16d8d0aefa8 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:34.060082 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.compute.server_external_events [req-0a4902e1-bbbb-4ab2-a2d3-2e080c48ea93 req-7a77810b-4e97-409f-ba67-e16d8d0aefa8 service nova] Creating event network-changed:a0f6a311-6139-4dbc-9303-164cfc456792 for instance fcbe20ff-6f97-41c3-bde7-c03ad1d3634c on hv-cinder-83607 Apr 08 11:18:34.066504 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [req-0a4902e1-bbbb-4ab2-a2d3-2e080c48ea93 req-7a77810b-4e97-409f-ba67-e16d8d0aefa8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031545 Apr 08 11:18:34.067449 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 222/438] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:18:34.241166 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-faaba416-a2b4-4e5e-8a94-8f8d0ad31746 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:34.241902 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-faaba416-a2b4-4e5e-8a94-8f8d0ad31746 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:34.248589 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-faaba416-a2b4-4e5e-8a94-8f8d0ad31746 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:34.249049 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-faaba416-a2b4-4e5e-8a94-8f8d0ad31746 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:34.249873 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-faaba416-a2b4-4e5e-8a94-8f8d0ad31746 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:34.250309 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-faaba416-a2b4-4e5e-8a94-8f8d0ad31746 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:34.485542 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-faaba416-a2b4-4e5e-8a94-8f8d0ad31746 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:34.499006 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-faaba416-a2b4-4e5e-8a94-8f8d0ad31746 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1260 microversion: 2.1 time: 0.259703 Apr 08 11:18:34.511831 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 217/439] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:34 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1260 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:18:35.219464 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-257a23be-f511-49d9-ab7f-ad06c7f50fbd tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1635682536", "imageRef": "35b8d8d2-a0e9-4c3e-8586-5e088dec27e6", "flavorRef": "452", "networks": [{"uuid": "d6eced8c-35d4-42dc-a366-5f5882c42cdb"}]}} {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:18:35.272058 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.network.neutron [None req-257a23be-f511-49d9-ab7f-ad06c7f50fbd tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] validate_networks() for [('d6eced8c-35d4-42dc-a366-5f5882c42cdb', None, None, None, None, None)] {{(pid=117801) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 08 11:18:35.520188 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f119aef8-bcf7-4520-8f6b-284af7402d01 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:35.520817 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f119aef8-bcf7-4520-8f6b-284af7402d01 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:35.527498 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f119aef8-bcf7-4520-8f6b-284af7402d01 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:35.527954 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f119aef8-bcf7-4520-8f6b-284af7402d01 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:35.528765 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f119aef8-bcf7-4520-8f6b-284af7402d01 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:35.529210 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f119aef8-bcf7-4520-8f6b-284af7402d01 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:35.967329 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f119aef8-bcf7-4520-8f6b-284af7402d01 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:35.971353 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.virt.hardware [None req-257a23be-f511-49d9-ab7f-ad06c7f50fbd tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Flavor limits 0:0:0 {{(pid=117801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 11:18:35.971779 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.virt.hardware [None req-257a23be-f511-49d9-ab7f-ad06c7f50fbd tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Image limits 0:0:0 {{(pid=117801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 11:18:35.972261 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.virt.hardware [None req-257a23be-f511-49d9-ab7f-ad06c7f50fbd tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Flavor pref 0:0:0 {{(pid=117801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 11:18:35.973256 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.virt.hardware [None req-257a23be-f511-49d9-ab7f-ad06c7f50fbd tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Image pref 0:0:0 {{(pid=117801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 11:18:35.973926 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.virt.hardware [None req-257a23be-f511-49d9-ab7f-ad06c7f50fbd tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 11:18:35.976480 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f119aef8-bcf7-4520-8f6b-284af7402d01 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1260 microversion: 2.1 time: 0.460642 Apr 08 11:18:35.977084 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 218/440] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:35 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1260 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:18:35.993604 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-257a23be-f511-49d9-ab7f-ad06c7f50fbd tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:35.994341 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-257a23be-f511-49d9-ab7f-ad06c7f50fbd tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:35.995150 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-257a23be-f511-49d9-ab7f-ad06c7f50fbd tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:35.995585 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-257a23be-f511-49d9-ab7f-ad06c7f50fbd tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:36.012728 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.quota [None req-257a23be-f511-49d9-ab7f-ad06c7f50fbd tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Getting quotas for project b717a37fc74e40b1be8f3e43bca2d271. Resources: {'instances', 'ram', 'cores'} {{(pid=117801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 11:18:36.017342 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.quota [None req-257a23be-f511-49d9-ab7f-ad06c7f50fbd tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Getting quotas for user 0283a594e452414d93a92a27f5cd934b and project b717a37fc74e40b1be8f3e43bca2d271. Resources: {'instances', 'ram', 'cores'} {{(pid=117801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 11:18:36.029101 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-257a23be-f511-49d9-ab7f-ad06c7f50fbd tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Going to run 1 instances... {{(pid=117801) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 08 11:18:36.031636 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-257a23be-f511-49d9-ab7f-ad06c7f50fbd tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='35b8d8d2-a0e9-4c3e-8586-5e088dec27e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 08 11:18:36.141355 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-257a23be-f511-49d9-ab7f-ad06c7f50fbd tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.926449 Apr 08 11:18:36.142704 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 223/441] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Apr 8 11:18:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 11:18:36.153308 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c0abba9e-9c46-4140-a91f-a9292c42e609 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:36.153957 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c0abba9e-9c46-4140-a91f-a9292c42e609 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:36.225893 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c0abba9e-9c46-4140-a91f-a9292c42e609 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:36.236849 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c0abba9e-9c46-4140-a91f-a9292c42e609 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8" status: 200 len: 1219 microversion: 2.1 time: 0.087065 Apr 08 11:18:36.237506 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 219/442] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:36 2022] GET /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:36.994455 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-ee705b2e-59bb-407b-b109-958f83fbe65d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:36.995096 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-ee705b2e-59bb-407b-b109-958f83fbe65d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:37.003163 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ee705b2e-59bb-407b-b109-958f83fbe65d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:37.003596 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ee705b2e-59bb-407b-b109-958f83fbe65d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:37.004400 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ee705b2e-59bb-407b-b109-958f83fbe65d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:37.004853 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ee705b2e-59bb-407b-b109-958f83fbe65d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:37.150982 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-ee705b2e-59bb-407b-b109-958f83fbe65d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:37.159218 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-ee705b2e-59bb-407b-b109-958f83fbe65d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1260 microversion: 2.1 time: 0.169384 Apr 08 11:18:37.159802 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 224/443] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:36 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:37.257383 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e30112ac-b5f3-4a3c-9817-3a8a557132b7 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:37.258103 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e30112ac-b5f3-4a3c-9817-3a8a557132b7 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:37.264786 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e30112ac-b5f3-4a3c-9817-3a8a557132b7 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:37.265394 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e30112ac-b5f3-4a3c-9817-3a8a557132b7 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:37.266452 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e30112ac-b5f3-4a3c-9817-3a8a557132b7 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:37.267544 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e30112ac-b5f3-4a3c-9817-3a8a557132b7 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:37.337420 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e30112ac-b5f3-4a3c-9817-3a8a557132b7 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:37.347340 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e30112ac-b5f3-4a3c-9817-3a8a557132b7 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8" status: 200 len: 1223 microversion: 2.1 time: 0.094007 Apr 08 11:18:37.347921 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 220/444] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:37 2022] GET /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8 => generated 1223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:38.177709 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-7e2d0b15-0b86-4664-9bf8-9af9e8085e17 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:38.178342 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-7e2d0b15-0b86-4664-9bf8-9af9e8085e17 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:38.185231 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7e2d0b15-0b86-4664-9bf8-9af9e8085e17 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:38.185737 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7e2d0b15-0b86-4664-9bf8-9af9e8085e17 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:38.186566 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7e2d0b15-0b86-4664-9bf8-9af9e8085e17 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:38.187017 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7e2d0b15-0b86-4664-9bf8-9af9e8085e17 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:38.361887 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-7e2d0b15-0b86-4664-9bf8-9af9e8085e17 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:38.364070 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1a195661-ab4b-4cb0-972d-7f18be45ff80 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:38.364703 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1a195661-ab4b-4cb0-972d-7f18be45ff80 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:38.371006 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1a195661-ab4b-4cb0-972d-7f18be45ff80 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:38.371265 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-7e2d0b15-0b86-4664-9bf8-9af9e8085e17 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1260 microversion: 2.1 time: 0.198406 Apr 08 11:18:38.371427 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1a195661-ab4b-4cb0-972d-7f18be45ff80 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:38.372392 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 225/445] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:38 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1260 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:38.372605 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1a195661-ab4b-4cb0-972d-7f18be45ff80 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:38.372605 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1a195661-ab4b-4cb0-972d-7f18be45ff80 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:38.445528 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1a195661-ab4b-4cb0-972d-7f18be45ff80 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:38.446084 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1a195661-ab4b-4cb0-972d-7f18be45ff80 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8" status: 200 len: 1215 microversion: 2.1 time: 0.085654 Apr 08 11:18:38.446669 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 221/446] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:38 2022] GET /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8 => generated 1215 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:18:39.388529 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-47e91cac-671d-4c36-ab08-2e68241937b4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:39.389202 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-47e91cac-671d-4c36-ab08-2e68241937b4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:39.395936 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-47e91cac-671d-4c36-ab08-2e68241937b4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:39.396516 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-47e91cac-671d-4c36-ab08-2e68241937b4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:39.397347 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-47e91cac-671d-4c36-ab08-2e68241937b4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:39.397792 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-47e91cac-671d-4c36-ab08-2e68241937b4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:39.465178 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6275e172-e455-4b7e-b6b2-91e0eda8086c tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:39.466021 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6275e172-e455-4b7e-b6b2-91e0eda8086c tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:39.473010 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6275e172-e455-4b7e-b6b2-91e0eda8086c tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:39.473462 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6275e172-e455-4b7e-b6b2-91e0eda8086c tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:39.474343 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6275e172-e455-4b7e-b6b2-91e0eda8086c tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:39.474732 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6275e172-e455-4b7e-b6b2-91e0eda8086c tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:39.590348 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6275e172-e455-4b7e-b6b2-91e0eda8086c tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:39.600503 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6275e172-e455-4b7e-b6b2-91e0eda8086c tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8" status: 200 len: 1279 microversion: 2.1 time: 0.140201 Apr 08 11:18:39.601416 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 222/447] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:39 2022] GET /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8 => generated 1279 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:18:39.676258 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-47e91cac-671d-4c36-ab08-2e68241937b4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:39.688469 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-47e91cac-671d-4c36-ab08-2e68241937b4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1260 microversion: 2.1 time: 0.303634 Apr 08 11:18:39.689430 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 226/448] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:39 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1260 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:40.620498 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-59f3ea4c-8ae0-4af7-b8f3-c18a95652d46 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:40.622008 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-59f3ea4c-8ae0-4af7-b8f3-c18a95652d46 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:40.629811 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-59f3ea4c-8ae0-4af7-b8f3-c18a95652d46 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:40.630648 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-59f3ea4c-8ae0-4af7-b8f3-c18a95652d46 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:40.631721 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-59f3ea4c-8ae0-4af7-b8f3-c18a95652d46 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:40.632403 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-59f3ea4c-8ae0-4af7-b8f3-c18a95652d46 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:40.711781 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-4dc7f708-5f3d-4d86-89c2-0265203c3168 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:40.714055 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-4dc7f708-5f3d-4d86-89c2-0265203c3168 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:40.725853 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4dc7f708-5f3d-4d86-89c2-0265203c3168 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:40.726694 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4dc7f708-5f3d-4d86-89c2-0265203c3168 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:40.728005 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4dc7f708-5f3d-4d86-89c2-0265203c3168 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:40.728581 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4dc7f708-5f3d-4d86-89c2-0265203c3168 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:40.898529 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-59f3ea4c-8ae0-4af7-b8f3-c18a95652d46 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:40.908217 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-59f3ea4c-8ae0-4af7-b8f3-c18a95652d46 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8" status: 200 len: 1319 microversion: 2.1 time: 0.291931 Apr 08 11:18:40.909429 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 223/449] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:40 2022] GET /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8 => generated 1319 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:41.159386 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-4dc7f708-5f3d-4d86-89c2-0265203c3168 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:41.167506 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-4dc7f708-5f3d-4d86-89c2-0265203c3168 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1260 microversion: 2.1 time: 0.464437 Apr 08 11:18:41.168111 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 227/450] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:40 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1260 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:18:41.925853 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-abdd5b86-c2b9-4ee8-9759-a785156820d9 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:41.926629 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-abdd5b86-c2b9-4ee8-9759-a785156820d9 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:41.932634 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-abdd5b86-c2b9-4ee8-9759-a785156820d9 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:41.933089 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-abdd5b86-c2b9-4ee8-9759-a785156820d9 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:41.933895 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-abdd5b86-c2b9-4ee8-9759-a785156820d9 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:41.934342 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-abdd5b86-c2b9-4ee8-9759-a785156820d9 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:42.089517 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [req-c3f040d0-9029-4a60-a617-d00e8df70536 req-9becef30-9a3b-4109-ad15-b6ae734aa505 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8", "tag": "41e9d56a-4a4f-45bd-babc-c02387afd0b8"}]} {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:18:42.103074 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-c3f040d0-9029-4a60-a617-d00e8df70536 req-9becef30-9a3b-4109-ad15-b6ae734aa505 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:42.103637 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-c3f040d0-9029-4a60-a617-d00e8df70536 req-9becef30-9a3b-4109-ad15-b6ae734aa505 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:42.128622 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.compute.server_external_events [req-c3f040d0-9029-4a60-a617-d00e8df70536 req-9becef30-9a3b-4109-ad15-b6ae734aa505 service nova] Creating event network-changed:41e9d56a-4a4f-45bd-babc-c02387afd0b8 for instance cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8 on hv-cinder-83607 Apr 08 11:18:42.136472 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [req-c3f040d0-9029-4a60-a617-d00e8df70536 req-9becef30-9a3b-4109-ad15-b6ae734aa505 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058387 Apr 08 11:18:42.137365 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 228/451] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:18:42.203902 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-abdd5b86-c2b9-4ee8-9759-a785156820d9 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:42.207545 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2d1327ed-bcaf-4806-8b41-920fa56c610b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:42.212485 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-abdd5b86-c2b9-4ee8-9759-a785156820d9 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8" status: 200 len: 1319 microversion: 2.1 time: 0.290498 Apr 08 11:18:42.213227 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 224/452] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:41 2022] GET /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8 => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:42.214353 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-2d1327ed-bcaf-4806-8b41-920fa56c610b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:42.228406 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2d1327ed-bcaf-4806-8b41-920fa56c610b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:42.228870 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2d1327ed-bcaf-4806-8b41-920fa56c610b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:42.230000 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2d1327ed-bcaf-4806-8b41-920fa56c610b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:42.230450 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2d1327ed-bcaf-4806-8b41-920fa56c610b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:42.269940 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-0bd184fc-e5ca-40fd-8ee4-01900548d820 req-d0228e9b-a42f-494f-8bba-45fc4d370806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6031de3c-c187-4e54-b340-ad53edbe9ee6", "name": "network-vif-plugged", "status": "completed", "tag": "58170f46-0bda-4d91-90b4-61e81203f4f5"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:18:42.282178 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-0bd184fc-e5ca-40fd-8ee4-01900548d820 req-d0228e9b-a42f-494f-8bba-45fc4d370806 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:42.283169 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-0bd184fc-e5ca-40fd-8ee4-01900548d820 req-d0228e9b-a42f-494f-8bba-45fc4d370806 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:42.304744 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-0bd184fc-e5ca-40fd-8ee4-01900548d820 req-d0228e9b-a42f-494f-8bba-45fc4d370806 service nova] Creating event network-vif-plugged:58170f46-0bda-4d91-90b4-61e81203f4f5 for instance 6031de3c-c187-4e54-b340-ad53edbe9ee6 on hv-cinder-83607 Apr 08 11:18:42.313565 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-0bd184fc-e5ca-40fd-8ee4-01900548d820 req-d0228e9b-a42f-494f-8bba-45fc4d370806 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047443 Apr 08 11:18:42.314967 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 225/453] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:18:42.431496 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2d1327ed-bcaf-4806-8b41-920fa56c610b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:42.439778 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-2d1327ed-bcaf-4806-8b41-920fa56c610b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1260 microversion: 2.1 time: 0.244842 Apr 08 11:18:42.444881 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 229/454] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:42 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1260 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:43.229882 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ff95a890-e350-4c2a-97ca-f623d75e30b8 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:43.230503 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ff95a890-e350-4c2a-97ca-f623d75e30b8 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:43.237107 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ff95a890-e350-4c2a-97ca-f623d75e30b8 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:43.237549 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ff95a890-e350-4c2a-97ca-f623d75e30b8 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:43.238372 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ff95a890-e350-4c2a-97ca-f623d75e30b8 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:43.238802 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ff95a890-e350-4c2a-97ca-f623d75e30b8 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:43.457247 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-c38bed13-67ad-4b3c-ac00-cc845a61d54d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:43.458047 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-c38bed13-67ad-4b3c-ac00-cc845a61d54d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:43.459662 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ff95a890-e350-4c2a-97ca-f623d75e30b8 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:43.466142 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c38bed13-67ad-4b3c-ac00-cc845a61d54d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:43.466730 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c38bed13-67ad-4b3c-ac00-cc845a61d54d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:43.467956 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c38bed13-67ad-4b3c-ac00-cc845a61d54d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:43.468668 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c38bed13-67ad-4b3c-ac00-cc845a61d54d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:43.472721 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ff95a890-e350-4c2a-97ca-f623d75e30b8 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8" status: 200 len: 1319 microversion: 2.1 time: 0.246754 Apr 08 11:18:43.474200 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 226/455] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:43 2022] GET /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8 => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:18:43.615731 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-c38bed13-67ad-4b3c-ac00-cc845a61d54d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:43.624701 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-c38bed13-67ad-4b3c-ac00-cc845a61d54d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1260 microversion: 2.1 time: 0.172098 Apr 08 11:18:43.625369 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 230/456] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:43 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:18:44.490926 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f84939c7-3322-4f4d-9731-9706c668c47e tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:44.491535 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f84939c7-3322-4f4d-9731-9706c668c47e tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:44.497576 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f84939c7-3322-4f4d-9731-9706c668c47e tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:44.498068 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f84939c7-3322-4f4d-9731-9706c668c47e tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:44.498813 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f84939c7-3322-4f4d-9731-9706c668c47e tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:44.499244 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f84939c7-3322-4f4d-9731-9706c668c47e tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:44.628792 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f84939c7-3322-4f4d-9731-9706c668c47e tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:44.636095 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f84939c7-3322-4f4d-9731-9706c668c47e tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8" status: 200 len: 1319 microversion: 2.1 time: 0.149550 Apr 08 11:18:44.636659 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 227/457] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:44 2022] GET /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:44.645281 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-d4007326-3506-4c09-a929-599c24d4cf76 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:44.645281 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-d4007326-3506-4c09-a929-599c24d4cf76 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:44.649148 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d4007326-3506-4c09-a929-599c24d4cf76 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:44.649604 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d4007326-3506-4c09-a929-599c24d4cf76 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:44.650413 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d4007326-3506-4c09-a929-599c24d4cf76 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:44.650854 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d4007326-3506-4c09-a929-599c24d4cf76 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:44.789546 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d4007326-3506-4c09-a929-599c24d4cf76 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:44.796774 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-d4007326-3506-4c09-a929-599c24d4cf76 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1260 microversion: 2.1 time: 0.158420 Apr 08 11:18:44.797340 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 231/458] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:44 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:45.652336 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5e08b05a-9eaa-4a91-b2f7-ae3a7b9fa23c tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:45.652951 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5e08b05a-9eaa-4a91-b2f7-ae3a7b9fa23c tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:45.658869 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5e08b05a-9eaa-4a91-b2f7-ae3a7b9fa23c tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:45.659804 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5e08b05a-9eaa-4a91-b2f7-ae3a7b9fa23c tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:45.660100 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5e08b05a-9eaa-4a91-b2f7-ae3a7b9fa23c tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:45.660536 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5e08b05a-9eaa-4a91-b2f7-ae3a7b9fa23c tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:45.793725 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5e08b05a-9eaa-4a91-b2f7-ae3a7b9fa23c tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:45.801596 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5e08b05a-9eaa-4a91-b2f7-ae3a7b9fa23c tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8" status: 200 len: 1319 microversion: 2.1 time: 0.153057 Apr 08 11:18:45.802222 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 228/459] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:45 2022] GET /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:45.813805 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-8d3c4ac2-08e2-482e-9207-c4de061a104e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:45.814403 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-8d3c4ac2-08e2-482e-9207-c4de061a104e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:45.821325 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8d3c4ac2-08e2-482e-9207-c4de061a104e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:45.821795 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8d3c4ac2-08e2-482e-9207-c4de061a104e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:45.822744 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8d3c4ac2-08e2-482e-9207-c4de061a104e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:45.823179 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8d3c4ac2-08e2-482e-9207-c4de061a104e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:45.956218 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-8d3c4ac2-08e2-482e-9207-c4de061a104e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:45.963590 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-8d3c4ac2-08e2-482e-9207-c4de061a104e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1260 microversion: 2.1 time: 0.153550 Apr 08 11:18:45.964169 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 232/460] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:45 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:46.818699 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e6a5f6b1-6178-4d0d-a98f-250f3021dc1c tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:46.819342 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e6a5f6b1-6178-4d0d-a98f-250f3021dc1c tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:46.825206 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e6a5f6b1-6178-4d0d-a98f-250f3021dc1c tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:46.825659 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e6a5f6b1-6178-4d0d-a98f-250f3021dc1c tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:46.826458 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e6a5f6b1-6178-4d0d-a98f-250f3021dc1c tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:46.826898 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e6a5f6b1-6178-4d0d-a98f-250f3021dc1c tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:46.960908 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e6a5f6b1-6178-4d0d-a98f-250f3021dc1c tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:46.968203 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e6a5f6b1-6178-4d0d-a98f-250f3021dc1c tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8" status: 200 len: 1319 microversion: 2.1 time: 0.153899 Apr 08 11:18:46.968765 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 229/461] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:46 2022] GET /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:46.980208 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-79c00bed-734a-4a49-8eb5-9783ecdcdcab tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:46.980836 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-79c00bed-734a-4a49-8eb5-9783ecdcdcab tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:46.987104 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-79c00bed-734a-4a49-8eb5-9783ecdcdcab tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:46.987557 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-79c00bed-734a-4a49-8eb5-9783ecdcdcab tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:46.988327 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-79c00bed-734a-4a49-8eb5-9783ecdcdcab tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:46.988766 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-79c00bed-734a-4a49-8eb5-9783ecdcdcab tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:47.126788 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-79c00bed-734a-4a49-8eb5-9783ecdcdcab tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:47.135126 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-79c00bed-734a-4a49-8eb5-9783ecdcdcab tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1260 microversion: 2.1 time: 0.158676 Apr 08 11:18:47.135962 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 233/462] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:46 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:47.517373 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-fdf1d039-250c-4e55-b5cf-265269120aea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:47.518004 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-fdf1d039-250c-4e55-b5cf-265269120aea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:47.525875 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fdf1d039-250c-4e55-b5cf-265269120aea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:47.526328 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fdf1d039-250c-4e55-b5cf-265269120aea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:47.532564 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fdf1d039-250c-4e55-b5cf-265269120aea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:47.532564 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fdf1d039-250c-4e55-b5cf-265269120aea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:47.553825 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-fdf1d039-250c-4e55-b5cf-265269120aea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/ips" status: 200 len: 151 microversion: 2.20 time: 0.042443 Apr 08 11:18:47.554438 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 230/463] 10.222.0.46 () {60 vars in 1288 bytes} [Fri Apr 8 11:18:47 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 11:18:47.984655 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-fc54ed26-ea2c-4c61-b951-a44e282b9318 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:47.986112 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-fc54ed26-ea2c-4c61-b951-a44e282b9318 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:47.993483 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fc54ed26-ea2c-4c61-b951-a44e282b9318 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:47.996272 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fc54ed26-ea2c-4c61-b951-a44e282b9318 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:47.996272 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fc54ed26-ea2c-4c61-b951-a44e282b9318 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:47.996272 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fc54ed26-ea2c-4c61-b951-a44e282b9318 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:48.153391 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-681cfeb6-ac7b-4425-a3da-99f14fc9b925 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:48.156673 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-681cfeb6-ac7b-4425-a3da-99f14fc9b925 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:48.168276 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-681cfeb6-ac7b-4425-a3da-99f14fc9b925 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:48.169062 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-681cfeb6-ac7b-4425-a3da-99f14fc9b925 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:48.170443 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-681cfeb6-ac7b-4425-a3da-99f14fc9b925 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:48.171111 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-681cfeb6-ac7b-4425-a3da-99f14fc9b925 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:48.190125 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-fc54ed26-ea2c-4c61-b951-a44e282b9318 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:48.205042 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-fc54ed26-ea2c-4c61-b951-a44e282b9318 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8" status: 200 len: 1319 microversion: 2.1 time: 0.224195 Apr 08 11:18:48.209827 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 234/464] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:47 2022] GET /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:48.356407 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-681cfeb6-ac7b-4425-a3da-99f14fc9b925 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:48.365016 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-681cfeb6-ac7b-4425-a3da-99f14fc9b925 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1443 microversion: 2.1 time: 0.216011 Apr 08 11:18:48.365809 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 231/465] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:48 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1443 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:48.383680 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-f656e542-6eab-4dc7-ad05-59bfac31ef75 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:48.392338 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-f656e542-6eab-4dc7-ad05-59bfac31ef75 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:48.392338 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f656e542-6eab-4dc7-ad05-59bfac31ef75 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:48.392338 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f656e542-6eab-4dc7-ad05-59bfac31ef75 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:48.392798 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f656e542-6eab-4dc7-ad05-59bfac31ef75 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:48.393138 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f656e542-6eab-4dc7-ad05-59bfac31ef75 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:48.545095 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f656e542-6eab-4dc7-ad05-59bfac31ef75 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:48.553196 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-f656e542-6eab-4dc7-ad05-59bfac31ef75 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1443 microversion: 2.1 time: 0.173615 Apr 08 11:18:48.553666 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 235/466] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:48 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1443 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:49.137046 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bf6a8813-f1a2-4c73-bd97-36bc3e3234d5 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:49.138632 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-bf6a8813-f1a2-4c73-bd97-36bc3e3234d5 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:49.144707 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bf6a8813-f1a2-4c73-bd97-36bc3e3234d5 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:49.145229 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bf6a8813-f1a2-4c73-bd97-36bc3e3234d5 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:49.146110 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bf6a8813-f1a2-4c73-bd97-36bc3e3234d5 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:49.146618 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bf6a8813-f1a2-4c73-bd97-36bc3e3234d5 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:49.172660 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-bf6a8813-f1a2-4c73-bd97-36bc3e3234d5 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/ips" status: 200 len: 145 microversion: 2.1 time: 0.036998 Apr 08 11:18:49.176819 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 232/467] 10.222.0.46 () {58 vars in 1247 bytes} [Fri Apr 8 11:18:49 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/ips => generated 145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:18:49.223471 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-0d2b53ff-c1c3-425a-a84c-069e3e73bb1f tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:49.224116 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-0d2b53ff-c1c3-425a-a84c-069e3e73bb1f tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:49.230542 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0d2b53ff-c1c3-425a-a84c-069e3e73bb1f tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:49.231003 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0d2b53ff-c1c3-425a-a84c-069e3e73bb1f tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:49.231778 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0d2b53ff-c1c3-425a-a84c-069e3e73bb1f tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:49.232220 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0d2b53ff-c1c3-425a-a84c-069e3e73bb1f tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:49.475215 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-0d2b53ff-c1c3-425a-a84c-069e3e73bb1f tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:49.482516 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-0d2b53ff-c1c3-425a-a84c-069e3e73bb1f tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8" status: 200 len: 1319 microversion: 2.1 time: 0.263124 Apr 08 11:18:49.483084 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 236/468] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:49 2022] GET /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8 => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:50.503037 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b2db30dd-ab27-4472-818a-25ac2df98859 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:50.505323 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b2db30dd-ab27-4472-818a-25ac2df98859 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:50.515791 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b2db30dd-ab27-4472-818a-25ac2df98859 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:50.515791 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b2db30dd-ab27-4472-818a-25ac2df98859 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:50.515791 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b2db30dd-ab27-4472-818a-25ac2df98859 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:50.515791 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b2db30dd-ab27-4472-818a-25ac2df98859 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:50.785858 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b2db30dd-ab27-4472-818a-25ac2df98859 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:50.787238 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [req-aef64ce8-3bd5-4731-93c2-fcae1342e896 req-de2a277f-fde9-4c1e-b649-5d2c07f8393a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8", "name": "network-vif-plugged", "status": "completed", "tag": "41e9d56a-4a4f-45bd-babc-c02387afd0b8"}]} {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:18:50.794782 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b2db30dd-ab27-4472-818a-25ac2df98859 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8" status: 200 len: 1319 microversion: 2.1 time: 0.296660 Apr 08 11:18:50.795474 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 233/469] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:50 2022] GET /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8 => generated 1319 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:50.796940 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-aef64ce8-3bd5-4731-93c2-fcae1342e896 req-de2a277f-fde9-4c1e-b649-5d2c07f8393a service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:50.797731 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-aef64ce8-3bd5-4731-93c2-fcae1342e896 req-de2a277f-fde9-4c1e-b649-5d2c07f8393a service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:50.810267 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.compute.server_external_events [req-aef64ce8-3bd5-4731-93c2-fcae1342e896 req-de2a277f-fde9-4c1e-b649-5d2c07f8393a service nova] Creating event network-vif-plugged:41e9d56a-4a4f-45bd-babc-c02387afd0b8 for instance cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8 on hv-cinder-83607 Apr 08 11:18:50.815391 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [req-aef64ce8-3bd5-4731-93c2-fcae1342e896 req-de2a277f-fde9-4c1e-b649-5d2c07f8393a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034067 Apr 08 11:18:50.815979 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 237/470] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:18:51.067935 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0508ac6d-de27-4ae9-8f7f-b27c974af9ff tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:18:51.068467 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0508ac6d-de27-4ae9-8f7f-b27c974af9ff tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:51.074368 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0508ac6d-de27-4ae9-8f7f-b27c974af9ff tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:51.075001 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0508ac6d-de27-4ae9-8f7f-b27c974af9ff tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:51.075763 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0508ac6d-de27-4ae9-8f7f-b27c974af9ff tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:51.076193 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0508ac6d-de27-4ae9-8f7f-b27c974af9ff tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:51.101559 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-0508ac6d-de27-4ae9-8f7f-b27c974af9ff tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lazy-loading 'flavor' on Instance uuid 594ceb52-9d1f-494f-818d-eb66144bc49d {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 11:18:51.171844 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [req-704f8d63-d00d-4e87-ad1a-8c39cb2def34 req-a563f42a-e06e-4add-a1e9-5c293b908ebc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6031de3c-c187-4e54-b340-ad53edbe9ee6", "tag": "58170f46-0bda-4d91-90b4-61e81203f4f5"}]} {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:18:51.181348 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-704f8d63-d00d-4e87-ad1a-8c39cb2def34 req-a563f42a-e06e-4add-a1e9-5c293b908ebc service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:51.181818 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-704f8d63-d00d-4e87-ad1a-8c39cb2def34 req-a563f42a-e06e-4add-a1e9-5c293b908ebc service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:51.192700 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.compute.server_external_events [req-704f8d63-d00d-4e87-ad1a-8c39cb2def34 req-a563f42a-e06e-4add-a1e9-5c293b908ebc service nova] Creating event network-changed:58170f46-0bda-4d91-90b4-61e81203f4f5 for instance 6031de3c-c187-4e54-b340-ad53edbe9ee6 on hv-cinder-83607 Apr 08 11:18:51.197481 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [req-704f8d63-d00d-4e87-ad1a-8c39cb2def34 req-a563f42a-e06e-4add-a1e9-5c293b908ebc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030185 Apr 08 11:18:51.198313 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 238/471] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:18:51.776989 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0508ac6d-de27-4ae9-8f7f-b27c974af9ff tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "POST /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/action" status: 202 len: 0 microversion: 2.20 time: 0.712902 Apr 08 11:18:51.777688 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 234/472] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Apr 8 11:18:51 2022] POST /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/action => generated 0 bytes in 714 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 08 11:18:51.787342 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-58c1c64c-6b7f-41a5-baf8-03c418878453 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:51.788036 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-58c1c64c-6b7f-41a5-baf8-03c418878453 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:51.794455 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-58c1c64c-6b7f-41a5-baf8-03c418878453 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:51.794911 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-58c1c64c-6b7f-41a5-baf8-03c418878453 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:51.795685 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-58c1c64c-6b7f-41a5-baf8-03c418878453 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:51.796127 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-58c1c64c-6b7f-41a5-baf8-03c418878453 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:51.812610 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a9f1f287-38d7-4783-8912-b98325b283fe tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:51.813318 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a9f1f287-38d7-4783-8912-b98325b283fe tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:51.820066 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a9f1f287-38d7-4783-8912-b98325b283fe tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:51.820525 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a9f1f287-38d7-4783-8912-b98325b283fe tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:51.821304 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a9f1f287-38d7-4783-8912-b98325b283fe tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:51.821747 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a9f1f287-38d7-4783-8912-b98325b283fe tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:52.098182 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-58c1c64c-6b7f-41a5-baf8-03c418878453 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:52.106084 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a9f1f287-38d7-4783-8912-b98325b283fe tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:52.106761 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-58c1c64c-6b7f-41a5-baf8-03c418878453 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:52.108270 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-58c1c64c-6b7f-41a5-baf8-03c418878453 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:52.109643 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-58c1c64c-6b7f-41a5-baf8-03c418878453 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1723 microversion: 2.20 time: 0.326593 Apr 08 11:18:52.110287 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 239/473] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:18:51 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1723 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:18:52.114741 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a9f1f287-38d7-4783-8912-b98325b283fe tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8" status: 200 len: 1319 microversion: 2.1 time: 0.306236 Apr 08 11:18:52.115715 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 235/474] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:51 2022] GET /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8 => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:18:52.787626 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-0dbb1fb6-4de3-4ffb-aa33-eac775da432c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "71f32ab3-7067-48a5-90d2-edfdfa694080"}} {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:18:52.788915 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-0dbb1fb6-4de3-4ffb-aa33-eac775da432c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:52.795555 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0dbb1fb6-4de3-4ffb-aa33-eac775da432c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:52.796007 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0dbb1fb6-4de3-4ffb-aa33-eac775da432c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:52.796786 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0dbb1fb6-4de3-4ffb-aa33-eac775da432c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:52.797222 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0dbb1fb6-4de3-4ffb-aa33-eac775da432c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:53.130382 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-213dde0a-86d3-45e9-bcdf-6b9962687347 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:53.131041 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-213dde0a-86d3-45e9-bcdf-6b9962687347 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:53.137925 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-213dde0a-86d3-45e9-bcdf-6b9962687347 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:53.138479 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-213dde0a-86d3-45e9-bcdf-6b9962687347 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:53.139343 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-213dde0a-86d3-45e9-bcdf-6b9962687347 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:53.139978 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-213dde0a-86d3-45e9-bcdf-6b9962687347 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:53.281106 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-213dde0a-86d3-45e9-bcdf-6b9962687347 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:53.289278 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-213dde0a-86d3-45e9-bcdf-6b9962687347 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:53.290733 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-213dde0a-86d3-45e9-bcdf-6b9962687347 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:53.291875 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-213dde0a-86d3-45e9-bcdf-6b9962687347 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1723 microversion: 2.20 time: 0.166391 Apr 08 11:18:53.292435 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 236/475] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:18:53 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:18:53.296704 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8868386f-c1b5-4c7e-9a8b-4b3b6ecc5455 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:53.301714 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8868386f-c1b5-4c7e-9a8b-4b3b6ecc5455 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:53.303667 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8868386f-c1b5-4c7e-9a8b-4b3b6ecc5455 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:53.304124 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8868386f-c1b5-4c7e-9a8b-4b3b6ecc5455 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:53.304964 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8868386f-c1b5-4c7e-9a8b-4b3b6ecc5455 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:53.305410 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8868386f-c1b5-4c7e-9a8b-4b3b6ecc5455 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:53.441514 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8868386f-c1b5-4c7e-9a8b-4b3b6ecc5455 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:53.449226 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8868386f-c1b5-4c7e-9a8b-4b3b6ecc5455 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8" status: 200 len: 1319 microversion: 2.1 time: 0.155769 Apr 08 11:18:53.449836 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 237/476] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:53 2022] GET /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:54.311162 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f3997523-0cc3-4ca7-9002-43eb913097d0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:54.311808 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f3997523-0cc3-4ca7-9002-43eb913097d0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:54.318154 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f3997523-0cc3-4ca7-9002-43eb913097d0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:54.318601 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f3997523-0cc3-4ca7-9002-43eb913097d0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:54.319371 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f3997523-0cc3-4ca7-9002-43eb913097d0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:54.319807 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f3997523-0cc3-4ca7-9002-43eb913097d0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:54.453213 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f3997523-0cc3-4ca7-9002-43eb913097d0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:54.461240 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f3997523-0cc3-4ca7-9002-43eb913097d0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:54.462796 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f3997523-0cc3-4ca7-9002-43eb913097d0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:54.463955 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f3997523-0cc3-4ca7-9002-43eb913097d0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1723 microversion: 2.20 time: 0.156808 Apr 08 11:18:54.464517 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 238/477] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:18:54 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:18:54.468929 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5876b396-277d-40ef-9fa8-b0b634f1eed3 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:54.469535 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5876b396-277d-40ef-9fa8-b0b634f1eed3 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:54.475179 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5876b396-277d-40ef-9fa8-b0b634f1eed3 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:54.475724 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5876b396-277d-40ef-9fa8-b0b634f1eed3 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:54.476404 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5876b396-277d-40ef-9fa8-b0b634f1eed3 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:54.476844 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5876b396-277d-40ef-9fa8-b0b634f1eed3 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:54.606927 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-0dbb1fb6-4de3-4ffb-aa33-eac775da432c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "POST /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.823109 Apr 08 11:18:54.612228 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 240/478] 10.222.0.46 () {60 vars in 1322 bytes} [Fri Apr 8 11:18:52 2022] POST /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/os-volume_attachments => generated 194 bytes in 1825 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:18:54.616622 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5876b396-277d-40ef-9fa8-b0b634f1eed3 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:54.622668 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5876b396-277d-40ef-9fa8-b0b634f1eed3 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8" status: 200 len: 1507 microversion: 2.1 time: 0.157076 Apr 08 11:18:54.623255 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 239/479] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:18:54 2022] GET /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:18:55.483319 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2478bca1-7944-4cbb-9d56-aa300f10ad87 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:55.484200 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-2478bca1-7944-4cbb-9d56-aa300f10ad87 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:55.491442 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2478bca1-7944-4cbb-9d56-aa300f10ad87 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:55.491897 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2478bca1-7944-4cbb-9d56-aa300f10ad87 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:55.492682 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2478bca1-7944-4cbb-9d56-aa300f10ad87 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:55.493120 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2478bca1-7944-4cbb-9d56-aa300f10ad87 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:55.633059 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2478bca1-7944-4cbb-9d56-aa300f10ad87 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:55.639052 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2478bca1-7944-4cbb-9d56-aa300f10ad87 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:55.640558 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2478bca1-7944-4cbb-9d56-aa300f10ad87 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:55.641729 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-2478bca1-7944-4cbb-9d56-aa300f10ad87 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1723 microversion: 2.20 time: 0.163246 Apr 08 11:18:55.642497 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 241/480] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:18:55 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:18:56.660228 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9c727170-3998-4a0d-8d8e-161330834082 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:56.674661 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9c727170-3998-4a0d-8d8e-161330834082 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:56.674661 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9c727170-3998-4a0d-8d8e-161330834082 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:56.674661 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9c727170-3998-4a0d-8d8e-161330834082 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:56.674661 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9c727170-3998-4a0d-8d8e-161330834082 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:56.675134 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9c727170-3998-4a0d-8d8e-161330834082 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:56.805482 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9c727170-3998-4a0d-8d8e-161330834082 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:56.813356 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9c727170-3998-4a0d-8d8e-161330834082 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:56.814895 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9c727170-3998-4a0d-8d8e-161330834082 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:56.816058 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9c727170-3998-4a0d-8d8e-161330834082 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1723 microversion: 2.20 time: 0.159739 Apr 08 11:18:56.816631 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 240/481] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:18:56 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:18:57.835296 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-b2175f3c-9ff6-43cc-a020-367330dfba84 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:57.835911 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-b2175f3c-9ff6-43cc-a020-367330dfba84 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:57.842691 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b2175f3c-9ff6-43cc-a020-367330dfba84 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:57.844516 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b2175f3c-9ff6-43cc-a020-367330dfba84 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:57.844516 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b2175f3c-9ff6-43cc-a020-367330dfba84 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:57.844516 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b2175f3c-9ff6-43cc-a020-367330dfba84 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:57.987424 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b2175f3c-9ff6-43cc-a020-367330dfba84 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:57.998088 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b2175f3c-9ff6-43cc-a020-367330dfba84 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:57.999607 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b2175f3c-9ff6-43cc-a020-367330dfba84 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:58.000769 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-b2175f3c-9ff6-43cc-a020-367330dfba84 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1723 microversion: 2.20 time: 0.169931 Apr 08 11:18:58.001366 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 242/482] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:18:57 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:18:59.020475 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f796f65a-b820-4216-ab7b-be82e5a732f7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:18:59.021207 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f796f65a-b820-4216-ab7b-be82e5a732f7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:18:59.027210 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f796f65a-b820-4216-ab7b-be82e5a732f7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:59.027654 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f796f65a-b820-4216-ab7b-be82e5a732f7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:59.028419 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f796f65a-b820-4216-ab7b-be82e5a732f7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:18:59.028848 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f796f65a-b820-4216-ab7b-be82e5a732f7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:18:59.162631 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f796f65a-b820-4216-ab7b-be82e5a732f7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:59.170388 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f796f65a-b820-4216-ab7b-be82e5a732f7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:59.171898 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f796f65a-b820-4216-ab7b-be82e5a732f7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:18:59.173044 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f796f65a-b820-4216-ab7b-be82e5a732f7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1723 microversion: 2.20 time: 0.156995 Apr 08 11:18:59.173606 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 241/483] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:18:59 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:00.192243 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e476851d-d3fe-4cae-af54-6a4f8bc2b4ac tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:00.192797 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e476851d-d3fe-4cae-af54-6a4f8bc2b4ac tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:00.199391 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e476851d-d3fe-4cae-af54-6a4f8bc2b4ac tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:00.199849 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e476851d-d3fe-4cae-af54-6a4f8bc2b4ac tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:00.200647 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e476851d-d3fe-4cae-af54-6a4f8bc2b4ac tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:00.201091 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e476851d-d3fe-4cae-af54-6a4f8bc2b4ac tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:00.344554 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e476851d-d3fe-4cae-af54-6a4f8bc2b4ac tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:00.353737 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e476851d-d3fe-4cae-af54-6a4f8bc2b4ac tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:00.355304 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e476851d-d3fe-4cae-af54-6a4f8bc2b4ac tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:00.356505 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e476851d-d3fe-4cae-af54-6a4f8bc2b4ac tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1723 microversion: 2.20 time: 0.168779 Apr 08 11:19:00.357070 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 243/484] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:00 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:01.380687 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-466e54b3-1b67-4cd1-962b-1b76967b2fe1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:01.381297 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-466e54b3-1b67-4cd1-962b-1b76967b2fe1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:01.387258 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-466e54b3-1b67-4cd1-962b-1b76967b2fe1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:01.387707 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-466e54b3-1b67-4cd1-962b-1b76967b2fe1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:01.388471 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-466e54b3-1b67-4cd1-962b-1b76967b2fe1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:01.388903 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-466e54b3-1b67-4cd1-962b-1b76967b2fe1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:01.528417 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-466e54b3-1b67-4cd1-962b-1b76967b2fe1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:01.537726 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-466e54b3-1b67-4cd1-962b-1b76967b2fe1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:01.539263 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-466e54b3-1b67-4cd1-962b-1b76967b2fe1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:01.540422 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-466e54b3-1b67-4cd1-962b-1b76967b2fe1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1723 microversion: 2.20 time: 0.163683 Apr 08 11:19:01.540981 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 242/485] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:01 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:02.558902 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-1e11d458-dc81-4860-b1e6-59d96ff5e8c3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:02.559500 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-1e11d458-dc81-4860-b1e6-59d96ff5e8c3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:02.566061 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1e11d458-dc81-4860-b1e6-59d96ff5e8c3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:02.567041 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1e11d458-dc81-4860-b1e6-59d96ff5e8c3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:02.567791 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1e11d458-dc81-4860-b1e6-59d96ff5e8c3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:02.568242 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1e11d458-dc81-4860-b1e6-59d96ff5e8c3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:02.711995 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1e11d458-dc81-4860-b1e6-59d96ff5e8c3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:02.719939 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1e11d458-dc81-4860-b1e6-59d96ff5e8c3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:02.721582 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1e11d458-dc81-4860-b1e6-59d96ff5e8c3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:02.722746 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-1e11d458-dc81-4860-b1e6-59d96ff5e8c3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1723 microversion: 2.20 time: 0.167856 Apr 08 11:19:02.723412 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 244/486] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:02 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:03.741101 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-73260d5b-a802-4959-94ad-f9b8c7c7aabf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:03.741742 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-73260d5b-a802-4959-94ad-f9b8c7c7aabf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:03.748112 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-73260d5b-a802-4959-94ad-f9b8c7c7aabf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:03.748731 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-73260d5b-a802-4959-94ad-f9b8c7c7aabf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:03.749321 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-73260d5b-a802-4959-94ad-f9b8c7c7aabf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:03.749760 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-73260d5b-a802-4959-94ad-f9b8c7c7aabf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:03.896812 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-73260d5b-a802-4959-94ad-f9b8c7c7aabf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:03.904666 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-73260d5b-a802-4959-94ad-f9b8c7c7aabf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:03.906198 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-73260d5b-a802-4959-94ad-f9b8c7c7aabf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:03.907349 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-73260d5b-a802-4959-94ad-f9b8c7c7aabf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1723 microversion: 2.20 time: 0.170840 Apr 08 11:19:03.907915 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 243/487] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:03 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:04.202059 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-df89a489-1ed6-470e-8461-952ef13387a5 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:19:04.208974 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-df89a489-1ed6-470e-8461-952ef13387a5 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:04.209425 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-df89a489-1ed6-470e-8461-952ef13387a5 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:04.280668 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-df89a489-1ed6-470e-8461-952ef13387a5 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Going to try to stop instance {{(pid=117801) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 08 11:19:04.469603 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-df89a489-1ed6-470e-8461-952ef13387a5 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "POST /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/action" status: 202 len: 0 microversion: 2.1 time: 0.271128 Apr 08 11:19:04.470154 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 245/488] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Apr 8 11:19:04 2022] POST /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 11:19:04.479011 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e75e70b5-6298-433d-b731-b35e03e27ab8 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:04.479621 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e75e70b5-6298-433d-b731-b35e03e27ab8 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:04.485563 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e75e70b5-6298-433d-b731-b35e03e27ab8 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:04.486057 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e75e70b5-6298-433d-b731-b35e03e27ab8 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:04.486834 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e75e70b5-6298-433d-b731-b35e03e27ab8 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:04.487321 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e75e70b5-6298-433d-b731-b35e03e27ab8 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:04.634360 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e75e70b5-6298-433d-b731-b35e03e27ab8 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:04.642849 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e75e70b5-6298-433d-b731-b35e03e27ab8 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1723 microversion: 2.1 time: 0.167660 Apr 08 11:19:04.643454 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 244/489] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:19:04 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:19:04.926986 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-096c9124-9ec0-49e2-b6e5-d65e9203371c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:04.927723 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-096c9124-9ec0-49e2-b6e5-d65e9203371c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:04.934254 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-096c9124-9ec0-49e2-b6e5-d65e9203371c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:04.934730 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-096c9124-9ec0-49e2-b6e5-d65e9203371c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:04.935515 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-096c9124-9ec0-49e2-b6e5-d65e9203371c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:04.935948 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-096c9124-9ec0-49e2-b6e5-d65e9203371c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:05.079694 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-096c9124-9ec0-49e2-b6e5-d65e9203371c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:05.092783 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-096c9124-9ec0-49e2-b6e5-d65e9203371c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:05.094233 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-096c9124-9ec0-49e2-b6e5-d65e9203371c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:05.095392 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-096c9124-9ec0-49e2-b6e5-d65e9203371c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1723 microversion: 2.20 time: 0.173055 Apr 08 11:19:05.095957 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 246/490] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:04 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:05.660626 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-60bc890a-d2b4-42d9-8c53-e20f15678b35 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:05.661241 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-60bc890a-d2b4-42d9-8c53-e20f15678b35 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:05.667392 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-60bc890a-d2b4-42d9-8c53-e20f15678b35 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:05.668195 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-60bc890a-d2b4-42d9-8c53-e20f15678b35 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:05.668603 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-60bc890a-d2b4-42d9-8c53-e20f15678b35 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:05.669038 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-60bc890a-d2b4-42d9-8c53-e20f15678b35 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:05.804855 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-60bc890a-d2b4-42d9-8c53-e20f15678b35 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:05.813456 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-60bc890a-d2b4-42d9-8c53-e20f15678b35 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1723 microversion: 2.1 time: 0.156714 Apr 08 11:19:05.814071 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 245/491] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:19:05 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:19:06.116404 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-df576399-4f71-4876-ad4a-57b0e92e9f08 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:06.117082 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-df576399-4f71-4876-ad4a-57b0e92e9f08 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:06.127904 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-df576399-4f71-4876-ad4a-57b0e92e9f08 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:06.128759 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-df576399-4f71-4876-ad4a-57b0e92e9f08 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:06.130393 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-df576399-4f71-4876-ad4a-57b0e92e9f08 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:06.131315 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-df576399-4f71-4876-ad4a-57b0e92e9f08 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:06.286355 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-df576399-4f71-4876-ad4a-57b0e92e9f08 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:06.295642 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-df576399-4f71-4876-ad4a-57b0e92e9f08 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:06.297171 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-df576399-4f71-4876-ad4a-57b0e92e9f08 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:06.298394 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-df576399-4f71-4876-ad4a-57b0e92e9f08 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1723 microversion: 2.20 time: 0.187998 Apr 08 11:19:06.298995 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 247/492] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:06 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:06.831488 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-98ceb2fd-e2bf-49f9-98a0-f1ffd0f8d00c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:06.832072 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-98ceb2fd-e2bf-49f9-98a0-f1ffd0f8d00c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:06.837969 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-98ceb2fd-e2bf-49f9-98a0-f1ffd0f8d00c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:06.838412 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-98ceb2fd-e2bf-49f9-98a0-f1ffd0f8d00c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:06.839164 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-98ceb2fd-e2bf-49f9-98a0-f1ffd0f8d00c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:06.839595 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-98ceb2fd-e2bf-49f9-98a0-f1ffd0f8d00c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:06.980664 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-98ceb2fd-e2bf-49f9-98a0-f1ffd0f8d00c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:06.990089 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-98ceb2fd-e2bf-49f9-98a0-f1ffd0f8d00c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1723 microversion: 2.1 time: 0.161018 Apr 08 11:19:06.990678 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 246/493] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:19:06 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:19:07.320569 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-351bffb0-68c0-4335-b2b2-7db26a35864f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:07.321707 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-351bffb0-68c0-4335-b2b2-7db26a35864f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:07.328190 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-351bffb0-68c0-4335-b2b2-7db26a35864f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:07.328648 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-351bffb0-68c0-4335-b2b2-7db26a35864f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:07.329421 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-351bffb0-68c0-4335-b2b2-7db26a35864f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:07.329884 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-351bffb0-68c0-4335-b2b2-7db26a35864f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:07.469952 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-351bffb0-68c0-4335-b2b2-7db26a35864f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:07.478431 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-351bffb0-68c0-4335-b2b2-7db26a35864f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:07.479941 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-351bffb0-68c0-4335-b2b2-7db26a35864f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:07.481122 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-351bffb0-68c0-4335-b2b2-7db26a35864f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1723 microversion: 2.20 time: 0.164896 Apr 08 11:19:07.481681 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 248/494] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:07 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:08.007966 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6fdb75b2-ff3b-450a-bae1-8199394bd91c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:08.009010 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6fdb75b2-ff3b-450a-bae1-8199394bd91c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:08.014660 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6fdb75b2-ff3b-450a-bae1-8199394bd91c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:08.015112 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6fdb75b2-ff3b-450a-bae1-8199394bd91c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:08.015890 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6fdb75b2-ff3b-450a-bae1-8199394bd91c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:08.016322 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6fdb75b2-ff3b-450a-bae1-8199394bd91c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:08.177326 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6fdb75b2-ff3b-450a-bae1-8199394bd91c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:08.185813 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6fdb75b2-ff3b-450a-bae1-8199394bd91c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1723 microversion: 2.1 time: 0.181732 Apr 08 11:19:08.186407 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 247/495] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:19:08 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:19:08.500444 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-34a80b7d-3603-410d-a4a3-8c87002778ea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:08.501039 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-34a80b7d-3603-410d-a4a3-8c87002778ea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:08.507947 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-34a80b7d-3603-410d-a4a3-8c87002778ea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:08.508416 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-34a80b7d-3603-410d-a4a3-8c87002778ea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:08.509180 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-34a80b7d-3603-410d-a4a3-8c87002778ea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:08.509622 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-34a80b7d-3603-410d-a4a3-8c87002778ea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:08.648191 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-34a80b7d-3603-410d-a4a3-8c87002778ea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:08.655481 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-34a80b7d-3603-410d-a4a3-8c87002778ea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:08.656966 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-34a80b7d-3603-410d-a4a3-8c87002778ea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:08.658124 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-34a80b7d-3603-410d-a4a3-8c87002778ea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1723 microversion: 2.20 time: 0.161706 Apr 08 11:19:08.658684 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 249/496] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:08 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:09.203868 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-496425e4-241a-4fd8-8db3-ba8afceaed04 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:09.204479 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-496425e4-241a-4fd8-8db3-ba8afceaed04 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:09.210467 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-496425e4-241a-4fd8-8db3-ba8afceaed04 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:09.210922 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-496425e4-241a-4fd8-8db3-ba8afceaed04 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:09.211728 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-496425e4-241a-4fd8-8db3-ba8afceaed04 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:09.212134 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-496425e4-241a-4fd8-8db3-ba8afceaed04 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:09.351936 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-496425e4-241a-4fd8-8db3-ba8afceaed04 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:09.362894 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-496425e4-241a-4fd8-8db3-ba8afceaed04 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1723 microversion: 2.1 time: 0.162946 Apr 08 11:19:09.363474 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 248/497] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:19:09 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:19:09.676450 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-fd4c320c-f860-443c-a7ca-4dbd7dbe1bf8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:09.680129 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-fd4c320c-f860-443c-a7ca-4dbd7dbe1bf8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:09.683680 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fd4c320c-f860-443c-a7ca-4dbd7dbe1bf8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:09.684133 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fd4c320c-f860-443c-a7ca-4dbd7dbe1bf8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:09.684907 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fd4c320c-f860-443c-a7ca-4dbd7dbe1bf8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:09.685343 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fd4c320c-f860-443c-a7ca-4dbd7dbe1bf8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:09.830986 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-fd4c320c-f860-443c-a7ca-4dbd7dbe1bf8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:09.840392 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-fd4c320c-f860-443c-a7ca-4dbd7dbe1bf8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:09.840593 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-fd4c320c-f860-443c-a7ca-4dbd7dbe1bf8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:09.841820 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-fd4c320c-f860-443c-a7ca-4dbd7dbe1bf8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1723 microversion: 2.20 time: 0.169359 Apr 08 11:19:09.842357 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 250/498] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:09 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:10.380254 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d60706ae-b20f-49cf-84f9-e4b0ba4b8384 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:10.380817 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d60706ae-b20f-49cf-84f9-e4b0ba4b8384 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:10.386626 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d60706ae-b20f-49cf-84f9-e4b0ba4b8384 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:10.387080 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d60706ae-b20f-49cf-84f9-e4b0ba4b8384 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:10.387841 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d60706ae-b20f-49cf-84f9-e4b0ba4b8384 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:10.388273 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d60706ae-b20f-49cf-84f9-e4b0ba4b8384 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:10.525052 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d60706ae-b20f-49cf-84f9-e4b0ba4b8384 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:10.532897 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d60706ae-b20f-49cf-84f9-e4b0ba4b8384 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1723 microversion: 2.1 time: 0.156545 Apr 08 11:19:10.533691 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 249/499] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:19:10 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:19:10.860611 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-783e57fe-8a70-484d-a1c5-a62a3dae40cf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:10.867015 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-783e57fe-8a70-484d-a1c5-a62a3dae40cf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:10.868271 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-783e57fe-8a70-484d-a1c5-a62a3dae40cf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:10.868730 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-783e57fe-8a70-484d-a1c5-a62a3dae40cf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:10.869512 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-783e57fe-8a70-484d-a1c5-a62a3dae40cf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:10.869983 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-783e57fe-8a70-484d-a1c5-a62a3dae40cf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:11.008282 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-783e57fe-8a70-484d-a1c5-a62a3dae40cf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:11.016541 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-783e57fe-8a70-484d-a1c5-a62a3dae40cf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:11.018070 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-783e57fe-8a70-484d-a1c5-a62a3dae40cf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:11.019229 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-783e57fe-8a70-484d-a1c5-a62a3dae40cf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1744 microversion: 2.20 time: 0.162483 Apr 08 11:19:11.019791 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 251/500] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:10 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:11.550193 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-13cd1611-ac8d-4d96-b67f-768ad6cf0394 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:11.550908 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-13cd1611-ac8d-4d96-b67f-768ad6cf0394 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:11.558309 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-13cd1611-ac8d-4d96-b67f-768ad6cf0394 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:11.558801 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-13cd1611-ac8d-4d96-b67f-768ad6cf0394 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:11.559660 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-13cd1611-ac8d-4d96-b67f-768ad6cf0394 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:11.560103 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-13cd1611-ac8d-4d96-b67f-768ad6cf0394 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:11.704652 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-13cd1611-ac8d-4d96-b67f-768ad6cf0394 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:11.713440 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-13cd1611-ac8d-4d96-b67f-768ad6cf0394 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1723 microversion: 2.1 time: 0.167145 Apr 08 11:19:11.714092 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 250/501] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:19:11 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:19:12.037458 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-4c40ca45-967c-4765-8129-807f421a9368 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:12.038115 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-4c40ca45-967c-4765-8129-807f421a9368 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:12.044704 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4c40ca45-967c-4765-8129-807f421a9368 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:12.045167 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4c40ca45-967c-4765-8129-807f421a9368 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:12.045981 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4c40ca45-967c-4765-8129-807f421a9368 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:12.046422 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4c40ca45-967c-4765-8129-807f421a9368 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:12.184146 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-4c40ca45-967c-4765-8129-807f421a9368 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:12.192557 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-4c40ca45-967c-4765-8129-807f421a9368 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:12.194126 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-4c40ca45-967c-4765-8129-807f421a9368 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:12.195294 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-4c40ca45-967c-4765-8129-807f421a9368 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1744 microversion: 2.20 time: 0.161801 Apr 08 11:19:12.195859 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 252/502] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:12 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:12.731502 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-110192c5-60b6-4b17-ad66-3f9599a5ec5c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:12.732109 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-110192c5-60b6-4b17-ad66-3f9599a5ec5c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:12.737965 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-110192c5-60b6-4b17-ad66-3f9599a5ec5c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:12.738456 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-110192c5-60b6-4b17-ad66-3f9599a5ec5c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:12.739800 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-110192c5-60b6-4b17-ad66-3f9599a5ec5c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:12.740243 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-110192c5-60b6-4b17-ad66-3f9599a5ec5c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:12.879157 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-110192c5-60b6-4b17-ad66-3f9599a5ec5c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:12.883504 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-110192c5-60b6-4b17-ad66-3f9599a5ec5c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1723 microversion: 2.1 time: 0.155953 Apr 08 11:19:12.884073 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 251/503] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:19:12 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:19:13.220488 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-5f2a1701-72a4-4740-abd6-2dc1b9b96f54 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:13.221081 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-5f2a1701-72a4-4740-abd6-2dc1b9b96f54 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:13.228390 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5f2a1701-72a4-4740-abd6-2dc1b9b96f54 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:13.228842 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5f2a1701-72a4-4740-abd6-2dc1b9b96f54 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:13.229657 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5f2a1701-72a4-4740-abd6-2dc1b9b96f54 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:13.230284 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5f2a1701-72a4-4740-abd6-2dc1b9b96f54 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:13.377022 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-5f2a1701-72a4-4740-abd6-2dc1b9b96f54 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:13.381197 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-5f2a1701-72a4-4740-abd6-2dc1b9b96f54 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:13.382734 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-5f2a1701-72a4-4740-abd6-2dc1b9b96f54 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:13.383998 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-5f2a1701-72a4-4740-abd6-2dc1b9b96f54 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1744 microversion: 2.20 time: 0.167450 Apr 08 11:19:13.384554 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 253/504] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:13 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1744 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:13.900694 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-23d2ce26-4fd0-45c4-bc7a-f6f28ceca3f4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:13.901247 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-23d2ce26-4fd0-45c4-bc7a-f6f28ceca3f4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:13.907306 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-23d2ce26-4fd0-45c4-bc7a-f6f28ceca3f4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:13.907760 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-23d2ce26-4fd0-45c4-bc7a-f6f28ceca3f4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:13.908532 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-23d2ce26-4fd0-45c4-bc7a-f6f28ceca3f4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:13.908969 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-23d2ce26-4fd0-45c4-bc7a-f6f28ceca3f4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:14.040707 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-23d2ce26-4fd0-45c4-bc7a-f6f28ceca3f4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:14.048376 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-23d2ce26-4fd0-45c4-bc7a-f6f28ceca3f4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1723 microversion: 2.1 time: 0.151629 Apr 08 11:19:14.048937 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 252/505] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:19:13 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:19:14.404816 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-054e5cd5-d445-4b86-b3e0-ebd0deb9dd6f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:14.405996 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-054e5cd5-d445-4b86-b3e0-ebd0deb9dd6f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:14.417509 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-054e5cd5-d445-4b86-b3e0-ebd0deb9dd6f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:14.418356 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-054e5cd5-d445-4b86-b3e0-ebd0deb9dd6f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:14.419330 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-054e5cd5-d445-4b86-b3e0-ebd0deb9dd6f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:14.420062 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-054e5cd5-d445-4b86-b3e0-ebd0deb9dd6f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:14.553119 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-054e5cd5-d445-4b86-b3e0-ebd0deb9dd6f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:14.560843 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-054e5cd5-d445-4b86-b3e0-ebd0deb9dd6f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:14.562410 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-054e5cd5-d445-4b86-b3e0-ebd0deb9dd6f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:14.563556 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-054e5cd5-d445-4b86-b3e0-ebd0deb9dd6f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1744 microversion: 2.20 time: 0.164122 Apr 08 11:19:14.564111 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 254/506] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:14 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:19:14.771351 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-de78c66e-ca69-448f-94b8-86510f2f7521 req-e40ce35b-4a1f-488e-8de9-0529495c96ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "594ceb52-9d1f-494f-818d-eb66144bc49d", "name": "network-vif-plugged", "status": "completed", "tag": "0095761d-6242-494c-b486-fc86278e0746"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:19:14.779432 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-de78c66e-ca69-448f-94b8-86510f2f7521 req-e40ce35b-4a1f-488e-8de9-0529495c96ee service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:14.779883 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-de78c66e-ca69-448f-94b8-86510f2f7521 req-e40ce35b-4a1f-488e-8de9-0529495c96ee service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:14.791741 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-de78c66e-ca69-448f-94b8-86510f2f7521 req-e40ce35b-4a1f-488e-8de9-0529495c96ee service nova] Creating event network-vif-plugged:0095761d-6242-494c-b486-fc86278e0746 for instance 594ceb52-9d1f-494f-818d-eb66144bc49d on hv-cinder-83607 Apr 08 11:19:14.796900 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-de78c66e-ca69-448f-94b8-86510f2f7521 req-e40ce35b-4a1f-488e-8de9-0529495c96ee service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029907 Apr 08 11:19:14.797729 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 253/507] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:19:15.066550 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-8a8a2b56-11e8-483f-863e-84812651b2ed tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:15.067649 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-8a8a2b56-11e8-483f-863e-84812651b2ed tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:15.073792 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8a8a2b56-11e8-483f-863e-84812651b2ed tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:15.074284 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8a8a2b56-11e8-483f-863e-84812651b2ed tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:15.075443 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8a8a2b56-11e8-483f-863e-84812651b2ed tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:15.075598 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8a8a2b56-11e8-483f-863e-84812651b2ed tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:15.219421 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-8a8a2b56-11e8-483f-863e-84812651b2ed tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:15.227323 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-8a8a2b56-11e8-483f-863e-84812651b2ed tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1723 microversion: 2.1 time: 0.164848 Apr 08 11:19:15.227893 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 255/508] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:19:15 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:19:15.582597 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-34d71572-f88e-4263-9dd1-f3362b275ad5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:15.583281 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-34d71572-f88e-4263-9dd1-f3362b275ad5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:15.589295 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-34d71572-f88e-4263-9dd1-f3362b275ad5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:15.589732 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-34d71572-f88e-4263-9dd1-f3362b275ad5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:15.590536 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-34d71572-f88e-4263-9dd1-f3362b275ad5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:15.590964 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-34d71572-f88e-4263-9dd1-f3362b275ad5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:15.724904 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-34d71572-f88e-4263-9dd1-f3362b275ad5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:15.732665 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-34d71572-f88e-4263-9dd1-f3362b275ad5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:15.734194 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-34d71572-f88e-4263-9dd1-f3362b275ad5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:15.735333 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-34d71572-f88e-4263-9dd1-f3362b275ad5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1744 microversion: 2.20 time: 0.157254 Apr 08 11:19:15.735889 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 254/509] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:15 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:16.243710 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-9e38ee0c-6d31-45a8-8fd8-ca4a006f54a4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:16.244310 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-9e38ee0c-6d31-45a8-8fd8-ca4a006f54a4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:16.255251 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9e38ee0c-6d31-45a8-8fd8-ca4a006f54a4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:16.256106 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9e38ee0c-6d31-45a8-8fd8-ca4a006f54a4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:16.257491 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9e38ee0c-6d31-45a8-8fd8-ca4a006f54a4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:16.258336 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9e38ee0c-6d31-45a8-8fd8-ca4a006f54a4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:16.394499 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-9e38ee0c-6d31-45a8-8fd8-ca4a006f54a4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:16.404359 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-9e38ee0c-6d31-45a8-8fd8-ca4a006f54a4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1723 microversion: 2.1 time: 0.164398 Apr 08 11:19:16.405080 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 256/510] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:19:16 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:19:16.754779 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-445ea505-7fae-4961-a397-79afebfc29bc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:16.755400 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-445ea505-7fae-4961-a397-79afebfc29bc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:16.761285 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-445ea505-7fae-4961-a397-79afebfc29bc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:16.761738 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-445ea505-7fae-4961-a397-79afebfc29bc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:16.762538 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-445ea505-7fae-4961-a397-79afebfc29bc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:16.762980 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-445ea505-7fae-4961-a397-79afebfc29bc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:16.891950 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-445ea505-7fae-4961-a397-79afebfc29bc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:16.899778 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-445ea505-7fae-4961-a397-79afebfc29bc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:16.901220 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-445ea505-7fae-4961-a397-79afebfc29bc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:16.902395 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-445ea505-7fae-4961-a397-79afebfc29bc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1744 microversion: 2.20 time: 0.152015 Apr 08 11:19:16.902960 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 255/511] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:16 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:17.426883 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-59bde313-b004-4ea2-92d6-c5b6df4a8a10 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:17.427481 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-59bde313-b004-4ea2-92d6-c5b6df4a8a10 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:17.433638 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-59bde313-b004-4ea2-92d6-c5b6df4a8a10 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:17.434115 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-59bde313-b004-4ea2-92d6-c5b6df4a8a10 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:17.434876 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-59bde313-b004-4ea2-92d6-c5b6df4a8a10 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:17.435312 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-59bde313-b004-4ea2-92d6-c5b6df4a8a10 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:17.572602 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-59bde313-b004-4ea2-92d6-c5b6df4a8a10 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:17.581788 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-59bde313-b004-4ea2-92d6-c5b6df4a8a10 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1723 microversion: 2.1 time: 0.158357 Apr 08 11:19:17.581788 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 257/512] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:19:17 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:19:17.920523 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7b4ae744-b08d-4246-8ebe-b0c13af4e252 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:17.921133 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7b4ae744-b08d-4246-8ebe-b0c13af4e252 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:17.927068 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7b4ae744-b08d-4246-8ebe-b0c13af4e252 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:17.927512 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7b4ae744-b08d-4246-8ebe-b0c13af4e252 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:17.928278 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7b4ae744-b08d-4246-8ebe-b0c13af4e252 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:17.928714 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7b4ae744-b08d-4246-8ebe-b0c13af4e252 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:18.068935 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7b4ae744-b08d-4246-8ebe-b0c13af4e252 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:18.077056 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7b4ae744-b08d-4246-8ebe-b0c13af4e252 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:18.078754 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7b4ae744-b08d-4246-8ebe-b0c13af4e252 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:18.079994 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7b4ae744-b08d-4246-8ebe-b0c13af4e252 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1744 microversion: 2.20 time: 0.163349 Apr 08 11:19:18.080563 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 256/513] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:17 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:18.598741 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-b0f1f88d-eb6e-4a71-9fde-95163f536697 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:18.599354 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-b0f1f88d-eb6e-4a71-9fde-95163f536697 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:18.605962 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b0f1f88d-eb6e-4a71-9fde-95163f536697 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:18.606423 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b0f1f88d-eb6e-4a71-9fde-95163f536697 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:18.607198 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b0f1f88d-eb6e-4a71-9fde-95163f536697 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:18.607638 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b0f1f88d-eb6e-4a71-9fde-95163f536697 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:18.742174 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b0f1f88d-eb6e-4a71-9fde-95163f536697 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:18.750742 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-b0f1f88d-eb6e-4a71-9fde-95163f536697 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1723 microversion: 2.1 time: 0.156031 Apr 08 11:19:18.751321 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 258/514] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:19:18 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:19:19.099634 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-20bd30ed-5380-4c5e-a883-0091b7061475 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:19.100249 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-20bd30ed-5380-4c5e-a883-0091b7061475 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:19.106353 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-20bd30ed-5380-4c5e-a883-0091b7061475 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:19.106883 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-20bd30ed-5380-4c5e-a883-0091b7061475 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:19.107611 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-20bd30ed-5380-4c5e-a883-0091b7061475 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:19.108048 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-20bd30ed-5380-4c5e-a883-0091b7061475 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:19.248193 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-20bd30ed-5380-4c5e-a883-0091b7061475 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:19.257246 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-20bd30ed-5380-4c5e-a883-0091b7061475 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:19.259295 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-20bd30ed-5380-4c5e-a883-0091b7061475 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:19.260439 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-20bd30ed-5380-4c5e-a883-0091b7061475 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1744 microversion: 2.20 time: 0.165477 Apr 08 11:19:19.260995 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 257/515] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:19 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:19.768058 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-753fe53a-766d-443d-b4b9-457de032653f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:19.768660 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-753fe53a-766d-443d-b4b9-457de032653f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:19.775108 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-753fe53a-766d-443d-b4b9-457de032653f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:19.775558 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-753fe53a-766d-443d-b4b9-457de032653f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:19.784005 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-753fe53a-766d-443d-b4b9-457de032653f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:19.784005 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-753fe53a-766d-443d-b4b9-457de032653f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:19.928949 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-753fe53a-766d-443d-b4b9-457de032653f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:19.938488 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-753fe53a-766d-443d-b4b9-457de032653f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1723 microversion: 2.1 time: 0.173715 Apr 08 11:19:19.939166 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 259/516] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:19:19 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:19:20.279235 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3dd52e82-4a46-4c7f-ab36-38ad5c01804d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:20.279876 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3dd52e82-4a46-4c7f-ab36-38ad5c01804d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:20.287155 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3dd52e82-4a46-4c7f-ab36-38ad5c01804d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:20.287155 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3dd52e82-4a46-4c7f-ab36-38ad5c01804d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:20.287903 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3dd52e82-4a46-4c7f-ab36-38ad5c01804d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:20.288351 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3dd52e82-4a46-4c7f-ab36-38ad5c01804d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:20.445832 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3dd52e82-4a46-4c7f-ab36-38ad5c01804d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:20.454214 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3dd52e82-4a46-4c7f-ab36-38ad5c01804d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:20.455726 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3dd52e82-4a46-4c7f-ab36-38ad5c01804d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:20.457783 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3dd52e82-4a46-4c7f-ab36-38ad5c01804d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1739 microversion: 2.20 time: 0.182203 Apr 08 11:19:20.457783 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 258/517] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:20 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:20.961410 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-5b1ee21b-353d-4738-b355-bb6a37d87c32 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:20.962730 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-5b1ee21b-353d-4738-b355-bb6a37d87c32 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:20.976113 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5b1ee21b-353d-4738-b355-bb6a37d87c32 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:20.976113 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5b1ee21b-353d-4738-b355-bb6a37d87c32 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:20.976818 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5b1ee21b-353d-4738-b355-bb6a37d87c32 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:20.977172 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5b1ee21b-353d-4738-b355-bb6a37d87c32 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:21.124564 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-5b1ee21b-353d-4738-b355-bb6a37d87c32 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:21.134583 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-5b1ee21b-353d-4738-b355-bb6a37d87c32 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1700 microversion: 2.1 time: 0.178541 Apr 08 11:19:21.135167 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 260/518] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:19:20 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1700 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:19:21.152940 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c5b7ffaf-c3de-492f-abbc-75ea94e05394 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:19:21.164036 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c5b7ffaf-c3de-492f-abbc-75ea94e05394 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:21.164513 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c5b7ffaf-c3de-492f-abbc-75ea94e05394 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:21.227900 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c5b7ffaf-c3de-492f-abbc-75ea94e05394 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Going to try to start instance {{(pid=117800) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 08 11:19:21.479672 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-576f8655-54cc-47d3-9f78-2dec03427517 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:21.480197 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-576f8655-54cc-47d3-9f78-2dec03427517 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:21.486112 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-576f8655-54cc-47d3-9f78-2dec03427517 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:21.486565 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-576f8655-54cc-47d3-9f78-2dec03427517 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:21.487337 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-576f8655-54cc-47d3-9f78-2dec03427517 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:21.487775 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-576f8655-54cc-47d3-9f78-2dec03427517 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:21.547387 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c5b7ffaf-c3de-492f-abbc-75ea94e05394 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "POST /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/action" status: 202 len: 0 microversion: 2.1 time: 0.398546 Apr 08 11:19:21.548391 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 259/519] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Apr 8 11:19:21 2022] POST /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/action => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 11:19:21.566855 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-21414ca4-1c1d-40ef-a715-f3762dfd90c8 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:21.568645 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-21414ca4-1c1d-40ef-a715-f3762dfd90c8 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:21.575381 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-21414ca4-1c1d-40ef-a715-f3762dfd90c8 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:21.576252 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-21414ca4-1c1d-40ef-a715-f3762dfd90c8 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:21.577136 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-21414ca4-1c1d-40ef-a715-f3762dfd90c8 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:21.577706 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-21414ca4-1c1d-40ef-a715-f3762dfd90c8 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:21.687806 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-576f8655-54cc-47d3-9f78-2dec03427517 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:21.701739 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-576f8655-54cc-47d3-9f78-2dec03427517 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:21.703871 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-576f8655-54cc-47d3-9f78-2dec03427517 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:21.705283 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-576f8655-54cc-47d3-9f78-2dec03427517 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1739 microversion: 2.20 time: 0.229930 Apr 08 11:19:21.706402 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 261/520] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:21 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1739 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:19:21.787646 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-21414ca4-1c1d-40ef-a715-f3762dfd90c8 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:21.796557 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-21414ca4-1c1d-40ef-a715-f3762dfd90c8 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1709 microversion: 2.1 time: 0.237346 Apr 08 11:19:21.797237 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 260/521] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:19:21 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1709 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:19:22.728576 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-1c88ea64-bd00-451a-a740-6aa767898bf3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:22.729990 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-1c88ea64-bd00-451a-a740-6aa767898bf3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:22.742065 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1c88ea64-bd00-451a-a740-6aa767898bf3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:22.742757 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1c88ea64-bd00-451a-a740-6aa767898bf3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:22.744011 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1c88ea64-bd00-451a-a740-6aa767898bf3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:22.744663 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1c88ea64-bd00-451a-a740-6aa767898bf3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:22.816541 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d75f1c10-b3b1-4420-996b-b9a9d4aee6ad tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:22.817170 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d75f1c10-b3b1-4420-996b-b9a9d4aee6ad tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:22.824481 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d75f1c10-b3b1-4420-996b-b9a9d4aee6ad tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:22.824985 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d75f1c10-b3b1-4420-996b-b9a9d4aee6ad tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:22.825936 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d75f1c10-b3b1-4420-996b-b9a9d4aee6ad tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:22.826673 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d75f1c10-b3b1-4420-996b-b9a9d4aee6ad tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:23.363906 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1c88ea64-bd00-451a-a740-6aa767898bf3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:23.375008 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1c88ea64-bd00-451a-a740-6aa767898bf3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:23.377389 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1c88ea64-bd00-451a-a740-6aa767898bf3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:23.379037 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-1c88ea64-bd00-451a-a740-6aa767898bf3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1739 microversion: 2.20 time: 0.657874 Apr 08 11:19:23.379816 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 262/522] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:22 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1739 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:23.405351 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d75f1c10-b3b1-4420-996b-b9a9d4aee6ad tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:23.424197 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d75f1c10-b3b1-4420-996b-b9a9d4aee6ad tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1709 microversion: 2.1 time: 0.611432 Apr 08 11:19:23.424921 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 261/523] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:19:22 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1709 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:19:24.425631 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-23ce9f1a-af5d-4fd6-ab85-0b0e5bc80933 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:24.437271 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-23ce9f1a-af5d-4fd6-ab85-0b0e5bc80933 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:24.454734 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d6a4b59d-c0da-49c7-99df-4018617b3ec9 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:24.456015 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d6a4b59d-c0da-49c7-99df-4018617b3ec9 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:24.510816 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d6a4b59d-c0da-49c7-99df-4018617b3ec9 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:24.510816 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d6a4b59d-c0da-49c7-99df-4018617b3ec9 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:24.511194 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-23ce9f1a-af5d-4fd6-ab85-0b0e5bc80933 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:24.511194 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-23ce9f1a-af5d-4fd6-ab85-0b0e5bc80933 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:24.511194 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-23ce9f1a-af5d-4fd6-ab85-0b0e5bc80933 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:24.511610 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d6a4b59d-c0da-49c7-99df-4018617b3ec9 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:24.511610 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d6a4b59d-c0da-49c7-99df-4018617b3ec9 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:24.511785 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-23ce9f1a-af5d-4fd6-ab85-0b0e5bc80933 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:24.906285 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-23ce9f1a-af5d-4fd6-ab85-0b0e5bc80933 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:24.916595 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-23ce9f1a-af5d-4fd6-ab85-0b0e5bc80933 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:24.920397 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-23ce9f1a-af5d-4fd6-ab85-0b0e5bc80933 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:24.923230 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-23ce9f1a-af5d-4fd6-ab85-0b0e5bc80933 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1739 microversion: 2.20 time: 0.523399 Apr 08 11:19:24.927021 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 263/524] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:24 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1739 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:24.931766 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d6a4b59d-c0da-49c7-99df-4018617b3ec9 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:24.946278 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d6a4b59d-c0da-49c7-99df-4018617b3ec9 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1713 microversion: 2.1 time: 0.494923 Apr 08 11:19:24.960271 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 262/525] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:19:24 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1713 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:19:25.944903 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-ce343f58-29ea-4a0d-96c9-776203537400 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:25.946413 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-ce343f58-29ea-4a0d-96c9-776203537400 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:25.956384 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ce343f58-29ea-4a0d-96c9-776203537400 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:25.957594 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ce343f58-29ea-4a0d-96c9-776203537400 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:25.960256 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ce343f58-29ea-4a0d-96c9-776203537400 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:25.961051 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ce343f58-29ea-4a0d-96c9-776203537400 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:26.043521 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5eb9da80-dba9-4add-9bda-09f9e048586a tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d348daf5-6c07-4a76-ad4c-c62fbc6003fd", "device": "/dev/sdb"}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:19:26.045939 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5eb9da80-dba9-4add-9bda-09f9e048586a tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:26.053611 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5eb9da80-dba9-4add-9bda-09f9e048586a tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:26.054426 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5eb9da80-dba9-4add-9bda-09f9e048586a tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:26.055440 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5eb9da80-dba9-4add-9bda-09f9e048586a tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:26.056093 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5eb9da80-dba9-4add-9bda-09f9e048586a tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:26.425400 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-ce343f58-29ea-4a0d-96c9-776203537400 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:26.447253 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-ce343f58-29ea-4a0d-96c9-776203537400 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:26.456073 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-ce343f58-29ea-4a0d-96c9-776203537400 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:26.461143 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-ce343f58-29ea-4a0d-96c9-776203537400 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1739 microversion: 2.20 time: 0.521242 Apr 08 11:19:26.475148 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 264/526] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:25 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1739 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:27.216112 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5eb9da80-dba9-4add-9bda-09f9e048586a tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "POST /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.176869 Apr 08 11:19:27.222738 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 263/527] 10.222.0.46 () {60 vars in 1322 bytes} [Fri Apr 8 11:19:26 2022] POST /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments => generated 194 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:19:27.490388 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-6d9bdc13-283a-4f7a-91d8-38662ac3edef tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:27.491514 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-6d9bdc13-283a-4f7a-91d8-38662ac3edef tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:27.506218 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6d9bdc13-283a-4f7a-91d8-38662ac3edef tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:27.508001 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6d9bdc13-283a-4f7a-91d8-38662ac3edef tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:27.508431 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6d9bdc13-283a-4f7a-91d8-38662ac3edef tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:27.509560 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6d9bdc13-283a-4f7a-91d8-38662ac3edef tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:27.773465 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6d9bdc13-283a-4f7a-91d8-38662ac3edef tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:27.788807 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6d9bdc13-283a-4f7a-91d8-38662ac3edef tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:27.791944 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6d9bdc13-283a-4f7a-91d8-38662ac3edef tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:27.794392 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-6d9bdc13-283a-4f7a-91d8-38662ac3edef tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1739 microversion: 2.20 time: 0.313440 Apr 08 11:19:27.806222 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 265/528] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:27 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1739 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:28.821114 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b7c00c0c-30d5-4053-9331-8558907d0585 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:28.823328 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b7c00c0c-30d5-4053-9331-8558907d0585 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:28.830843 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b7c00c0c-30d5-4053-9331-8558907d0585 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:28.831415 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b7c00c0c-30d5-4053-9331-8558907d0585 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:28.832286 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b7c00c0c-30d5-4053-9331-8558907d0585 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:28.832819 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b7c00c0c-30d5-4053-9331-8558907d0585 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:29.030739 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b7c00c0c-30d5-4053-9331-8558907d0585 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:29.043630 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b7c00c0c-30d5-4053-9331-8558907d0585 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:29.045215 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b7c00c0c-30d5-4053-9331-8558907d0585 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:29.046428 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b7c00c0c-30d5-4053-9331-8558907d0585 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1739 microversion: 2.20 time: 0.229875 Apr 08 11:19:29.047012 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 264/529] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:28 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1739 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:30.064895 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-b9695091-f4ce-47a0-a36b-02ac4533cbc6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:30.065517 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-b9695091-f4ce-47a0-a36b-02ac4533cbc6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:30.072652 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b9695091-f4ce-47a0-a36b-02ac4533cbc6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:30.073192 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b9695091-f4ce-47a0-a36b-02ac4533cbc6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:30.074077 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b9695091-f4ce-47a0-a36b-02ac4533cbc6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:30.074686 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b9695091-f4ce-47a0-a36b-02ac4533cbc6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:30.221617 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b9695091-f4ce-47a0-a36b-02ac4533cbc6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:30.230129 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b9695091-f4ce-47a0-a36b-02ac4533cbc6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:30.231625 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b9695091-f4ce-47a0-a36b-02ac4533cbc6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:30.232769 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-b9695091-f4ce-47a0-a36b-02ac4533cbc6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1739 microversion: 2.20 time: 0.171719 Apr 08 11:19:30.233333 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 266/530] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:30 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:31.251937 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f15fc611-91fe-470c-82fb-2e5d67b3f3cd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:31.252787 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f15fc611-91fe-470c-82fb-2e5d67b3f3cd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:31.263010 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f15fc611-91fe-470c-82fb-2e5d67b3f3cd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:31.263457 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f15fc611-91fe-470c-82fb-2e5d67b3f3cd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:31.264262 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f15fc611-91fe-470c-82fb-2e5d67b3f3cd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:31.264697 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f15fc611-91fe-470c-82fb-2e5d67b3f3cd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:31.404664 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f15fc611-91fe-470c-82fb-2e5d67b3f3cd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:31.414778 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f15fc611-91fe-470c-82fb-2e5d67b3f3cd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:31.416668 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f15fc611-91fe-470c-82fb-2e5d67b3f3cd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:31.417849 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f15fc611-91fe-470c-82fb-2e5d67b3f3cd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1739 microversion: 2.20 time: 0.170102 Apr 08 11:19:31.429715 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 265/531] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:31 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:32.438145 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-d5e8d728-d8fb-401f-88e3-f901d6bb8835 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:32.438145 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-d5e8d728-d8fb-401f-88e3-f901d6bb8835 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:32.445055 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d5e8d728-d8fb-401f-88e3-f901d6bb8835 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:32.445506 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d5e8d728-d8fb-401f-88e3-f901d6bb8835 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:32.446334 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d5e8d728-d8fb-401f-88e3-f901d6bb8835 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:32.446829 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d5e8d728-d8fb-401f-88e3-f901d6bb8835 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:32.613419 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d5e8d728-d8fb-401f-88e3-f901d6bb8835 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:32.627266 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d5e8d728-d8fb-401f-88e3-f901d6bb8835 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:32.627266 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d5e8d728-d8fb-401f-88e3-f901d6bb8835 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:32.629262 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-d5e8d728-d8fb-401f-88e3-f901d6bb8835 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1739 microversion: 2.20 time: 0.196074 Apr 08 11:19:32.630941 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 267/532] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:32 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:33.654001 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e545ada8-863b-4da9-b3d3-90ef22b00576 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:33.654989 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e545ada8-863b-4da9-b3d3-90ef22b00576 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:33.663088 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e545ada8-863b-4da9-b3d3-90ef22b00576 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:33.663852 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e545ada8-863b-4da9-b3d3-90ef22b00576 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:33.665018 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e545ada8-863b-4da9-b3d3-90ef22b00576 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:33.665673 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e545ada8-863b-4da9-b3d3-90ef22b00576 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:33.839560 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e545ada8-863b-4da9-b3d3-90ef22b00576 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:33.850747 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e545ada8-863b-4da9-b3d3-90ef22b00576 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:33.852475 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e545ada8-863b-4da9-b3d3-90ef22b00576 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:33.853647 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e545ada8-863b-4da9-b3d3-90ef22b00576 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1739 microversion: 2.20 time: 0.203568 Apr 08 11:19:33.854440 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 266/533] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:33 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1739 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:34.871788 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-38fc76c6-8c9d-4701-bb33-bab9a235509c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:34.872692 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-38fc76c6-8c9d-4701-bb33-bab9a235509c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:34.879016 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-38fc76c6-8c9d-4701-bb33-bab9a235509c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:34.879471 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-38fc76c6-8c9d-4701-bb33-bab9a235509c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:34.880239 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-38fc76c6-8c9d-4701-bb33-bab9a235509c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:34.880678 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-38fc76c6-8c9d-4701-bb33-bab9a235509c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:35.011767 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-38fc76c6-8c9d-4701-bb33-bab9a235509c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:35.019541 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-38fc76c6-8c9d-4701-bb33-bab9a235509c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:35.021563 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-38fc76c6-8c9d-4701-bb33-bab9a235509c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:35.022736 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-38fc76c6-8c9d-4701-bb33-bab9a235509c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1739 microversion: 2.20 time: 0.154898 Apr 08 11:19:35.023296 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 268/534] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:34 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:36.041505 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7ac3d5bc-389e-4678-be46-6ec329f70db8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:36.042237 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7ac3d5bc-389e-4678-be46-6ec329f70db8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:36.048617 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7ac3d5bc-389e-4678-be46-6ec329f70db8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:36.049072 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7ac3d5bc-389e-4678-be46-6ec329f70db8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:36.049885 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7ac3d5bc-389e-4678-be46-6ec329f70db8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:36.050394 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7ac3d5bc-389e-4678-be46-6ec329f70db8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:36.187590 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7ac3d5bc-389e-4678-be46-6ec329f70db8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:36.195832 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7ac3d5bc-389e-4678-be46-6ec329f70db8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:36.197355 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7ac3d5bc-389e-4678-be46-6ec329f70db8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:36.198597 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7ac3d5bc-389e-4678-be46-6ec329f70db8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1739 microversion: 2.20 time: 0.161922 Apr 08 11:19:36.199382 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 267/535] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:36 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:37.217711 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-72bef304-2ce6-4470-89ed-df0fd69229a3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:37.218299 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-72bef304-2ce6-4470-89ed-df0fd69229a3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:37.224561 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-72bef304-2ce6-4470-89ed-df0fd69229a3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:37.225012 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-72bef304-2ce6-4470-89ed-df0fd69229a3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:37.225790 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-72bef304-2ce6-4470-89ed-df0fd69229a3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:37.226252 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-72bef304-2ce6-4470-89ed-df0fd69229a3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:37.364836 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-72bef304-2ce6-4470-89ed-df0fd69229a3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:37.372970 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-72bef304-2ce6-4470-89ed-df0fd69229a3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:37.374504 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-72bef304-2ce6-4470-89ed-df0fd69229a3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:37.375711 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-72bef304-2ce6-4470-89ed-df0fd69229a3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1721 microversion: 2.20 time: 0.161893 Apr 08 11:19:37.376273 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 269/536] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:37 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:38.241402 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e3221f8e-837d-45d9-bfe0-3e0859037a64 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6945a5b2-ef63-469c-9b0d-2b0a67470855"}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:19:38.242548 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e3221f8e-837d-45d9-bfe0-3e0859037a64 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:38.248645 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e3221f8e-837d-45d9-bfe0-3e0859037a64 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:38.249095 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e3221f8e-837d-45d9-bfe0-3e0859037a64 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:38.249885 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e3221f8e-837d-45d9-bfe0-3e0859037a64 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:38.250316 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e3221f8e-837d-45d9-bfe0-3e0859037a64 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:38.393753 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-1e0132cf-ab27-4ded-88c9-0655709d4b40 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:38.394438 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-1e0132cf-ab27-4ded-88c9-0655709d4b40 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:38.401238 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1e0132cf-ab27-4ded-88c9-0655709d4b40 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:38.401692 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1e0132cf-ab27-4ded-88c9-0655709d4b40 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:38.402489 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1e0132cf-ab27-4ded-88c9-0655709d4b40 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:38.402929 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1e0132cf-ab27-4ded-88c9-0655709d4b40 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:38.535848 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1e0132cf-ab27-4ded-88c9-0655709d4b40 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:38.543787 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1e0132cf-ab27-4ded-88c9-0655709d4b40 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:38.545315 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1e0132cf-ab27-4ded-88c9-0655709d4b40 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:38.546501 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-1e0132cf-ab27-4ded-88c9-0655709d4b40 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1721 microversion: 2.20 time: 0.156597 Apr 08 11:19:38.547060 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 270/537] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:38 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:19:39.565345 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-1bd35b53-d185-47e7-8326-64d2611537c2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:39.566059 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-1bd35b53-d185-47e7-8326-64d2611537c2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:39.572384 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1bd35b53-d185-47e7-8326-64d2611537c2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:39.572841 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1bd35b53-d185-47e7-8326-64d2611537c2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:39.573606 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1bd35b53-d185-47e7-8326-64d2611537c2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:39.574084 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1bd35b53-d185-47e7-8326-64d2611537c2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:39.711671 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1bd35b53-d185-47e7-8326-64d2611537c2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:39.719408 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1bd35b53-d185-47e7-8326-64d2611537c2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:39.720936 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1bd35b53-d185-47e7-8326-64d2611537c2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:39.722104 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-1bd35b53-d185-47e7-8326-64d2611537c2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1721 microversion: 2.20 time: 0.160627 Apr 08 11:19:39.722661 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 271/538] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:39 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:19:40.740108 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-dd692edc-3a0c-4b29-8cb7-f9127c714a54 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:40.740754 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-dd692edc-3a0c-4b29-8cb7-f9127c714a54 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:40.746908 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dd692edc-3a0c-4b29-8cb7-f9127c714a54 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:40.747352 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dd692edc-3a0c-4b29-8cb7-f9127c714a54 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:40.748373 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dd692edc-3a0c-4b29-8cb7-f9127c714a54 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:40.748804 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dd692edc-3a0c-4b29-8cb7-f9127c714a54 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:40.885582 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-dd692edc-3a0c-4b29-8cb7-f9127c714a54 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:40.893643 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-dd692edc-3a0c-4b29-8cb7-f9127c714a54 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:40.895339 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-dd692edc-3a0c-4b29-8cb7-f9127c714a54 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:40.897102 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-dd692edc-3a0c-4b29-8cb7-f9127c714a54 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1721 microversion: 2.20 time: 0.161056 Apr 08 11:19:40.897665 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 272/539] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:40 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:19:41.175773 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 11:19:41.176017 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: Fri Apr 8 11:19:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 11:19:42.025733 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-020e68ed-fd54-47d4-8f63-de3079e38d6a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:42.026353 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-020e68ed-fd54-47d4-8f63-de3079e38d6a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:42.033258 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-020e68ed-fd54-47d4-8f63-de3079e38d6a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:42.033708 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-020e68ed-fd54-47d4-8f63-de3079e38d6a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:42.034570 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-020e68ed-fd54-47d4-8f63-de3079e38d6a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:42.035008 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-020e68ed-fd54-47d4-8f63-de3079e38d6a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:42.172953 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-020e68ed-fd54-47d4-8f63-de3079e38d6a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:42.183120 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-020e68ed-fd54-47d4-8f63-de3079e38d6a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:42.184627 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-020e68ed-fd54-47d4-8f63-de3079e38d6a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:42.185817 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-020e68ed-fd54-47d4-8f63-de3079e38d6a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1721 microversion: 2.20 time: 0.274168 Apr 08 11:19:42.186373 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 273/540] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:41 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1721 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:42.366094 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [req-d63b9745-93f8-497c-a62e-371740cbc724 req-19372e09-f298-4c4b-bfe9-1df6d18e7626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "594ceb52-9d1f-494f-818d-eb66144bc49d", "name": "network-vif-unplugged", "status": "completed", "tag": "0095761d-6242-494c-b486-fc86278e0746"}]} {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:19:42.375186 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-d63b9745-93f8-497c-a62e-371740cbc724 req-19372e09-f298-4c4b-bfe9-1df6d18e7626 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:42.375628 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-d63b9745-93f8-497c-a62e-371740cbc724 req-19372e09-f298-4c4b-bfe9-1df6d18e7626 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:42.387062 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.compute.server_external_events [req-d63b9745-93f8-497c-a62e-371740cbc724 req-19372e09-f298-4c4b-bfe9-1df6d18e7626 service nova] Creating event network-vif-unplugged:0095761d-6242-494c-b486-fc86278e0746 for instance 594ceb52-9d1f-494f-818d-eb66144bc49d on hv-cinder-83607 Apr 08 11:19:42.392224 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [req-d63b9745-93f8-497c-a62e-371740cbc724 req-19372e09-f298-4c4b-bfe9-1df6d18e7626 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029964 Apr 08 11:19:42.393023 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 274/541] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:19:43.076974 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e3221f8e-837d-45d9-bfe0-3e0859037a64 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "POST /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.939628 Apr 08 11:19:43.080576 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 268/542] 10.222.0.46 () {60 vars in 1322 bytes} [Fri Apr 8 11:19:38 2022] POST /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 194 bytes in 4941 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:19:43.205287 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-59bcce0f-e241-46a6-8ebc-5e8944371306 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:43.205998 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-59bcce0f-e241-46a6-8ebc-5e8944371306 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:43.212767 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-59bcce0f-e241-46a6-8ebc-5e8944371306 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:43.213216 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-59bcce0f-e241-46a6-8ebc-5e8944371306 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:43.214002 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-59bcce0f-e241-46a6-8ebc-5e8944371306 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:43.214439 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-59bcce0f-e241-46a6-8ebc-5e8944371306 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:43.357317 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-59bcce0f-e241-46a6-8ebc-5e8944371306 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:43.365901 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-59bcce0f-e241-46a6-8ebc-5e8944371306 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:43.367292 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-59bcce0f-e241-46a6-8ebc-5e8944371306 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:43.368435 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-59bcce0f-e241-46a6-8ebc-5e8944371306 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1721 microversion: 2.20 time: 0.167806 Apr 08 11:19:43.368979 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 275/543] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:43 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:19:44.388080 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5b9a8fbd-be62-418c-b9f1-323005ec1d94 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:44.388805 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5b9a8fbd-be62-418c-b9f1-323005ec1d94 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:44.395039 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5b9a8fbd-be62-418c-b9f1-323005ec1d94 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:44.395442 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5b9a8fbd-be62-418c-b9f1-323005ec1d94 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:44.396231 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5b9a8fbd-be62-418c-b9f1-323005ec1d94 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:44.397185 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5b9a8fbd-be62-418c-b9f1-323005ec1d94 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:44.533365 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5b9a8fbd-be62-418c-b9f1-323005ec1d94 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:44.541797 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5b9a8fbd-be62-418c-b9f1-323005ec1d94 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:44.543286 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5b9a8fbd-be62-418c-b9f1-323005ec1d94 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:44.544522 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5b9a8fbd-be62-418c-b9f1-323005ec1d94 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1664 microversion: 2.20 time: 0.161138 Apr 08 11:19:44.545233 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 269/544] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:44 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1664 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:44.562142 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-d92e6dab-bc5d-494b-a8de-bbc8f0ffda8a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "669b69f8-d539-406d-a440-9704f783db13"}} {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:19:44.563228 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-d92e6dab-bc5d-494b-a8de-bbc8f0ffda8a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:44.572840 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d92e6dab-bc5d-494b-a8de-bbc8f0ffda8a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:44.573287 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d92e6dab-bc5d-494b-a8de-bbc8f0ffda8a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:44.574085 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d92e6dab-bc5d-494b-a8de-bbc8f0ffda8a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:44.574514 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d92e6dab-bc5d-494b-a8de-bbc8f0ffda8a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:45.486600 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-d92e6dab-bc5d-494b-a8de-bbc8f0ffda8a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "POST /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.928452 Apr 08 11:19:45.487215 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 276/545] 10.222.0.46 () {62 vars in 1363 bytes} [Fri Apr 8 11:19:44 2022] POST /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/os-volume_attachments => generated 188 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 11:19:45.599690 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0d561d7b-c949-4967-870f-52e72d075043 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:19:45.600764 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0d561d7b-c949-4967-870f-52e72d075043 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:45.607124 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0d561d7b-c949-4967-870f-52e72d075043 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:45.607577 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0d561d7b-c949-4967-870f-52e72d075043 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:45.608346 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0d561d7b-c949-4967-870f-52e72d075043 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:45.608785 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0d561d7b-c949-4967-870f-52e72d075043 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:45.944445 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0d561d7b-c949-4967-870f-52e72d075043 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "POST /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/action" status: 202 len: 0 microversion: 2.20 time: 0.348433 Apr 08 11:19:45.945062 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 270/546] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Apr 8 11:19:45 2022] POST /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 08 11:19:45.953308 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-f12fd446-8cd3-436d-ac00-76518f90fadb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:45.954748 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-f12fd446-8cd3-436d-ac00-76518f90fadb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:45.961799 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f12fd446-8cd3-436d-ac00-76518f90fadb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:45.962303 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f12fd446-8cd3-436d-ac00-76518f90fadb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:45.963114 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f12fd446-8cd3-436d-ac00-76518f90fadb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:45.963549 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f12fd446-8cd3-436d-ac00-76518f90fadb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:46.108662 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f12fd446-8cd3-436d-ac00-76518f90fadb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:46.117183 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f12fd446-8cd3-436d-ac00-76518f90fadb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:46.118763 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f12fd446-8cd3-436d-ac00-76518f90fadb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:46.119924 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-f12fd446-8cd3-436d-ac00-76518f90fadb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1750 microversion: 2.20 time: 0.170738 Apr 08 11:19:46.120487 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 277/547] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:45 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1750 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:47.138868 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-73f9eeec-a61f-4983-8b85-e13ceb09a25a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:47.139483 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-73f9eeec-a61f-4983-8b85-e13ceb09a25a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:47.145745 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-73f9eeec-a61f-4983-8b85-e13ceb09a25a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:47.146223 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-73f9eeec-a61f-4983-8b85-e13ceb09a25a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:47.147012 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-73f9eeec-a61f-4983-8b85-e13ceb09a25a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:47.147455 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-73f9eeec-a61f-4983-8b85-e13ceb09a25a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:47.290046 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-73f9eeec-a61f-4983-8b85-e13ceb09a25a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:47.298693 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-73f9eeec-a61f-4983-8b85-e13ceb09a25a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:47.300327 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-73f9eeec-a61f-4983-8b85-e13ceb09a25a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:47.301646 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-73f9eeec-a61f-4983-8b85-e13ceb09a25a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1750 microversion: 2.20 time: 0.166959 Apr 08 11:19:47.302312 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 271/548] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:47 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1750 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:48.321324 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-0c289124-9bf6-471e-8474-d3660d840aa9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:48.321955 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-0c289124-9bf6-471e-8474-d3660d840aa9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:48.328228 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0c289124-9bf6-471e-8474-d3660d840aa9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:48.328677 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0c289124-9bf6-471e-8474-d3660d840aa9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:48.329435 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0c289124-9bf6-471e-8474-d3660d840aa9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:48.329899 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0c289124-9bf6-471e-8474-d3660d840aa9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:48.467585 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-0c289124-9bf6-471e-8474-d3660d840aa9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:48.476342 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-0c289124-9bf6-471e-8474-d3660d840aa9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:48.477937 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-0c289124-9bf6-471e-8474-d3660d840aa9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:48.479104 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-0c289124-9bf6-471e-8474-d3660d840aa9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.162428 Apr 08 11:19:48.479656 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 278/549] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:48 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:49.497355 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-546f8e6b-10eb-4c58-8f95-5a8ed9863f50 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:49.498357 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-546f8e6b-10eb-4c58-8f95-5a8ed9863f50 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:49.504871 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-546f8e6b-10eb-4c58-8f95-5a8ed9863f50 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:49.505328 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-546f8e6b-10eb-4c58-8f95-5a8ed9863f50 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:49.506184 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-546f8e6b-10eb-4c58-8f95-5a8ed9863f50 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:49.507204 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-546f8e6b-10eb-4c58-8f95-5a8ed9863f50 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:49.641922 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-546f8e6b-10eb-4c58-8f95-5a8ed9863f50 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:49.650855 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-546f8e6b-10eb-4c58-8f95-5a8ed9863f50 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:49.652402 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-546f8e6b-10eb-4c58-8f95-5a8ed9863f50 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:49.653544 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-546f8e6b-10eb-4c58-8f95-5a8ed9863f50 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.160102 Apr 08 11:19:49.654142 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 272/550] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:49 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:50.671949 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e46687fd-8fac-4ee5-b4c7-0b9ff3717e22 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:50.680607 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e46687fd-8fac-4ee5-b4c7-0b9ff3717e22 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:50.680607 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e46687fd-8fac-4ee5-b4c7-0b9ff3717e22 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:50.680607 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e46687fd-8fac-4ee5-b4c7-0b9ff3717e22 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:50.680607 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e46687fd-8fac-4ee5-b4c7-0b9ff3717e22 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:50.681094 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e46687fd-8fac-4ee5-b4c7-0b9ff3717e22 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:50.815379 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e46687fd-8fac-4ee5-b4c7-0b9ff3717e22 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:50.823632 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e46687fd-8fac-4ee5-b4c7-0b9ff3717e22 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:50.825128 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e46687fd-8fac-4ee5-b4c7-0b9ff3717e22 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:50.826334 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e46687fd-8fac-4ee5-b4c7-0b9ff3717e22 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.158305 Apr 08 11:19:50.826894 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 279/551] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:50 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:51.844592 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7215c1fe-528a-497d-9e97-0b356651c290 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:51.845142 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7215c1fe-528a-497d-9e97-0b356651c290 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:51.851567 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7215c1fe-528a-497d-9e97-0b356651c290 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:51.852023 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7215c1fe-528a-497d-9e97-0b356651c290 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:51.852798 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7215c1fe-528a-497d-9e97-0b356651c290 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:51.853243 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7215c1fe-528a-497d-9e97-0b356651c290 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:51.984560 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7215c1fe-528a-497d-9e97-0b356651c290 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:51.993623 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7215c1fe-528a-497d-9e97-0b356651c290 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:51.995185 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7215c1fe-528a-497d-9e97-0b356651c290 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:51.996356 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7215c1fe-528a-497d-9e97-0b356651c290 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.155771 Apr 08 11:19:51.996928 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 273/552] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:51 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:53.015226 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-fcf96ace-d915-4269-90b3-c334af3c6944 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:53.015832 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-fcf96ace-d915-4269-90b3-c334af3c6944 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:53.022276 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fcf96ace-d915-4269-90b3-c334af3c6944 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:53.022726 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fcf96ace-d915-4269-90b3-c334af3c6944 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:53.024126 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fcf96ace-d915-4269-90b3-c334af3c6944 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:53.024564 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fcf96ace-d915-4269-90b3-c334af3c6944 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:53.165533 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-fcf96ace-d915-4269-90b3-c334af3c6944 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:53.174072 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-fcf96ace-d915-4269-90b3-c334af3c6944 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:53.175589 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-fcf96ace-d915-4269-90b3-c334af3c6944 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:53.176743 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-fcf96ace-d915-4269-90b3-c334af3c6944 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.165416 Apr 08 11:19:53.177296 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 280/553] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:53 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:54.195783 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9bdea5ea-77a7-4060-be25-8cdde77cb840 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:54.196528 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9bdea5ea-77a7-4060-be25-8cdde77cb840 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:54.203165 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9bdea5ea-77a7-4060-be25-8cdde77cb840 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:54.203617 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9bdea5ea-77a7-4060-be25-8cdde77cb840 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:54.204390 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9bdea5ea-77a7-4060-be25-8cdde77cb840 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:54.204831 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9bdea5ea-77a7-4060-be25-8cdde77cb840 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:54.336326 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9bdea5ea-77a7-4060-be25-8cdde77cb840 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:54.345276 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9bdea5ea-77a7-4060-be25-8cdde77cb840 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:54.346785 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9bdea5ea-77a7-4060-be25-8cdde77cb840 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:54.347936 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9bdea5ea-77a7-4060-be25-8cdde77cb840 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.156121 Apr 08 11:19:54.348501 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 274/554] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:54 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:55.366184 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-594897c8-29e5-4b74-b64e-b94c0bb767a2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:55.366734 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-594897c8-29e5-4b74-b64e-b94c0bb767a2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:55.373997 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-594897c8-29e5-4b74-b64e-b94c0bb767a2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:55.374448 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-594897c8-29e5-4b74-b64e-b94c0bb767a2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:55.375217 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-594897c8-29e5-4b74-b64e-b94c0bb767a2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:55.375661 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-594897c8-29e5-4b74-b64e-b94c0bb767a2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:55.507519 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-594897c8-29e5-4b74-b64e-b94c0bb767a2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:55.516129 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-594897c8-29e5-4b74-b64e-b94c0bb767a2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:55.517624 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-594897c8-29e5-4b74-b64e-b94c0bb767a2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:55.518799 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-594897c8-29e5-4b74-b64e-b94c0bb767a2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.156659 Apr 08 11:19:55.519359 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 281/555] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:55 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:56.537001 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9199572e-e25d-4581-8ee3-67dd5291295a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:56.537615 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9199572e-e25d-4581-8ee3-67dd5291295a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:56.544302 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9199572e-e25d-4581-8ee3-67dd5291295a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:56.544761 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9199572e-e25d-4581-8ee3-67dd5291295a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:56.545550 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9199572e-e25d-4581-8ee3-67dd5291295a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:56.546027 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9199572e-e25d-4581-8ee3-67dd5291295a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:56.686053 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9199572e-e25d-4581-8ee3-67dd5291295a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:56.694474 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9199572e-e25d-4581-8ee3-67dd5291295a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:56.697491 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9199572e-e25d-4581-8ee3-67dd5291295a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:56.697491 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9199572e-e25d-4581-8ee3-67dd5291295a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.164233 Apr 08 11:19:56.700012 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 275/556] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:56 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:57.715410 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-6577cc5e-92f3-472a-87a6-79a4994bcbbf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:57.716027 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-6577cc5e-92f3-472a-87a6-79a4994bcbbf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:57.722543 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6577cc5e-92f3-472a-87a6-79a4994bcbbf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:57.723037 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6577cc5e-92f3-472a-87a6-79a4994bcbbf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:57.723820 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6577cc5e-92f3-472a-87a6-79a4994bcbbf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:57.724258 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6577cc5e-92f3-472a-87a6-79a4994bcbbf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:57.857633 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6577cc5e-92f3-472a-87a6-79a4994bcbbf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:57.865683 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6577cc5e-92f3-472a-87a6-79a4994bcbbf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:57.867192 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6577cc5e-92f3-472a-87a6-79a4994bcbbf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:57.869053 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-6577cc5e-92f3-472a-87a6-79a4994bcbbf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.157492 Apr 08 11:19:57.869558 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 282/557] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:57 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:19:58.887309 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3e9923c7-5038-4ff7-a5db-cea525294809 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:19:58.887916 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3e9923c7-5038-4ff7-a5db-cea525294809 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:19:58.894198 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3e9923c7-5038-4ff7-a5db-cea525294809 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:58.894643 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3e9923c7-5038-4ff7-a5db-cea525294809 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:58.895406 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3e9923c7-5038-4ff7-a5db-cea525294809 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:19:58.895840 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3e9923c7-5038-4ff7-a5db-cea525294809 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:19:59.028848 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3e9923c7-5038-4ff7-a5db-cea525294809 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:59.037021 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3e9923c7-5038-4ff7-a5db-cea525294809 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:59.038561 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3e9923c7-5038-4ff7-a5db-cea525294809 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:19:59.039702 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3e9923c7-5038-4ff7-a5db-cea525294809 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.156924 Apr 08 11:19:59.040256 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 276/558] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:19:58 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:20:00.057733 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-26051c8a-07de-4834-9e88-9471e39935e9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:00.058555 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-26051c8a-07de-4834-9e88-9471e39935e9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:00.064592 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-26051c8a-07de-4834-9e88-9471e39935e9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:00.065060 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-26051c8a-07de-4834-9e88-9471e39935e9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:00.065838 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-26051c8a-07de-4834-9e88-9471e39935e9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:00.066285 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-26051c8a-07de-4834-9e88-9471e39935e9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:00.198187 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-26051c8a-07de-4834-9e88-9471e39935e9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:00.206875 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-26051c8a-07de-4834-9e88-9471e39935e9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:00.208368 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-26051c8a-07de-4834-9e88-9471e39935e9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:00.209522 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-26051c8a-07de-4834-9e88-9471e39935e9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.155720 Apr 08 11:20:00.210112 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 283/559] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:00 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:20:00.838076 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 11:20:00.838624 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:20:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 11:20:01.228174 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-30e5e6d0-e68d-4873-980f-5f3322232462 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:01.229291 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-30e5e6d0-e68d-4873-980f-5f3322232462 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:01.235622 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-30e5e6d0-e68d-4873-980f-5f3322232462 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:01.236015 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-30e5e6d0-e68d-4873-980f-5f3322232462 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:01.236778 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-30e5e6d0-e68d-4873-980f-5f3322232462 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:01.237216 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-30e5e6d0-e68d-4873-980f-5f3322232462 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:01.368367 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-30e5e6d0-e68d-4873-980f-5f3322232462 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:01.377593 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-30e5e6d0-e68d-4873-980f-5f3322232462 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:01.379132 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-30e5e6d0-e68d-4873-980f-5f3322232462 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:01.380321 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-30e5e6d0-e68d-4873-980f-5f3322232462 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.156022 Apr 08 11:20:01.380871 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 277/560] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:01 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:20:02.398655 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-50adad50-7123-41b8-bc44-4dece8f9aa49 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:02.399262 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-50adad50-7123-41b8-bc44-4dece8f9aa49 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:02.409299 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-50adad50-7123-41b8-bc44-4dece8f9aa49 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:02.409754 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-50adad50-7123-41b8-bc44-4dece8f9aa49 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:02.410563 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-50adad50-7123-41b8-bc44-4dece8f9aa49 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:02.411010 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-50adad50-7123-41b8-bc44-4dece8f9aa49 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:02.540331 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-50adad50-7123-41b8-bc44-4dece8f9aa49 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:02.549154 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-50adad50-7123-41b8-bc44-4dece8f9aa49 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:02.550598 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-50adad50-7123-41b8-bc44-4dece8f9aa49 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:02.551748 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-50adad50-7123-41b8-bc44-4dece8f9aa49 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.157082 Apr 08 11:20:02.552296 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 284/561] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:02 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:20:03.571337 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7d19b335-54ff-4013-a44d-263ff93a862c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:03.572546 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7d19b335-54ff-4013-a44d-263ff93a862c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:03.578831 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d19b335-54ff-4013-a44d-263ff93a862c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:03.579283 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d19b335-54ff-4013-a44d-263ff93a862c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:03.580050 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d19b335-54ff-4013-a44d-263ff93a862c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:03.580488 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d19b335-54ff-4013-a44d-263ff93a862c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:03.714849 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7d19b335-54ff-4013-a44d-263ff93a862c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:03.723065 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7d19b335-54ff-4013-a44d-263ff93a862c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:03.724576 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7d19b335-54ff-4013-a44d-263ff93a862c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:03.725727 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7d19b335-54ff-4013-a44d-263ff93a862c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.158453 Apr 08 11:20:03.726328 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 278/562] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:03 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:20:04.743984 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-ac2911b4-8512-4fca-9607-d842906d8f75 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:04.744602 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-ac2911b4-8512-4fca-9607-d842906d8f75 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:04.751143 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ac2911b4-8512-4fca-9607-d842906d8f75 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:04.751592 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ac2911b4-8512-4fca-9607-d842906d8f75 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:04.752361 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ac2911b4-8512-4fca-9607-d842906d8f75 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:04.752817 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ac2911b4-8512-4fca-9607-d842906d8f75 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:04.886068 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-ac2911b4-8512-4fca-9607-d842906d8f75 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:04.894333 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-ac2911b4-8512-4fca-9607-d842906d8f75 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:04.895831 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-ac2911b4-8512-4fca-9607-d842906d8f75 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:04.897042 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-ac2911b4-8512-4fca-9607-d842906d8f75 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.156925 Apr 08 11:20:04.897547 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 285/563] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:04 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:20:05.916722 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-93620e1d-73d7-41f4-a820-f1fe464eaf4f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:05.917264 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-93620e1d-73d7-41f4-a820-f1fe464eaf4f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:05.923571 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-93620e1d-73d7-41f4-a820-f1fe464eaf4f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:05.924023 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-93620e1d-73d7-41f4-a820-f1fe464eaf4f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:05.924820 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-93620e1d-73d7-41f4-a820-f1fe464eaf4f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:05.925239 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-93620e1d-73d7-41f4-a820-f1fe464eaf4f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:06.054527 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-93620e1d-73d7-41f4-a820-f1fe464eaf4f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:06.063544 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-93620e1d-73d7-41f4-a820-f1fe464eaf4f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:06.065052 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-93620e1d-73d7-41f4-a820-f1fe464eaf4f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:06.066243 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-93620e1d-73d7-41f4-a820-f1fe464eaf4f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.154145 Apr 08 11:20:06.066802 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 279/564] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:05 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:20:07.085373 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a4ec6735-71dc-4685-9630-859f8faebc9e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:07.086141 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a4ec6735-71dc-4685-9630-859f8faebc9e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:07.092612 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a4ec6735-71dc-4685-9630-859f8faebc9e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:07.093071 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a4ec6735-71dc-4685-9630-859f8faebc9e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:07.093871 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a4ec6735-71dc-4685-9630-859f8faebc9e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:07.094318 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a4ec6735-71dc-4685-9630-859f8faebc9e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:07.233737 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a4ec6735-71dc-4685-9630-859f8faebc9e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:07.242121 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a4ec6735-71dc-4685-9630-859f8faebc9e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:07.243633 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a4ec6735-71dc-4685-9630-859f8faebc9e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:07.245370 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a4ec6735-71dc-4685-9630-859f8faebc9e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.164299 Apr 08 11:20:07.245977 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 286/565] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:07 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:20:08.264002 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4d561783-a62f-4760-b317-4955b79ca112 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:08.264624 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4d561783-a62f-4760-b317-4955b79ca112 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:08.270999 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4d561783-a62f-4760-b317-4955b79ca112 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:08.271456 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4d561783-a62f-4760-b317-4955b79ca112 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:08.272229 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4d561783-a62f-4760-b317-4955b79ca112 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:08.272671 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4d561783-a62f-4760-b317-4955b79ca112 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:08.404521 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4d561783-a62f-4760-b317-4955b79ca112 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:08.412637 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4d561783-a62f-4760-b317-4955b79ca112 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:08.414178 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4d561783-a62f-4760-b317-4955b79ca112 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:08.415322 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4d561783-a62f-4760-b317-4955b79ca112 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.155240 Apr 08 11:20:08.415877 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 280/566] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:08 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:20:09.434356 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-d2eed46f-e738-4adb-bfb6-4fdfd1ab2be8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:09.438448 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-d2eed46f-e738-4adb-bfb6-4fdfd1ab2be8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:09.441493 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d2eed46f-e738-4adb-bfb6-4fdfd1ab2be8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:09.442086 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d2eed46f-e738-4adb-bfb6-4fdfd1ab2be8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:09.442859 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d2eed46f-e738-4adb-bfb6-4fdfd1ab2be8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:09.443298 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d2eed46f-e738-4adb-bfb6-4fdfd1ab2be8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:09.576568 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d2eed46f-e738-4adb-bfb6-4fdfd1ab2be8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:09.584725 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d2eed46f-e738-4adb-bfb6-4fdfd1ab2be8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:09.586254 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d2eed46f-e738-4adb-bfb6-4fdfd1ab2be8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:09.587436 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-d2eed46f-e738-4adb-bfb6-4fdfd1ab2be8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.157589 Apr 08 11:20:09.587991 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 287/567] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:09 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:20:10.606112 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-07ff6e28-b650-4a74-92f7-f79be052c5cb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:10.606738 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-07ff6e28-b650-4a74-92f7-f79be052c5cb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:10.613102 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-07ff6e28-b650-4a74-92f7-f79be052c5cb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:10.613559 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-07ff6e28-b650-4a74-92f7-f79be052c5cb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:10.614364 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-07ff6e28-b650-4a74-92f7-f79be052c5cb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:10.614824 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-07ff6e28-b650-4a74-92f7-f79be052c5cb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:10.747239 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-07ff6e28-b650-4a74-92f7-f79be052c5cb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:10.755630 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-07ff6e28-b650-4a74-92f7-f79be052c5cb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:10.757176 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-07ff6e28-b650-4a74-92f7-f79be052c5cb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:10.758367 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-07ff6e28-b650-4a74-92f7-f79be052c5cb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.156953 Apr 08 11:20:10.758931 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 281/568] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:10 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:20:11.777118 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-b5e841ff-c32d-4a20-b9ab-56cd0ec17cc5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:11.777723 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-b5e841ff-c32d-4a20-b9ab-56cd0ec17cc5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:11.783971 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b5e841ff-c32d-4a20-b9ab-56cd0ec17cc5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:11.784413 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b5e841ff-c32d-4a20-b9ab-56cd0ec17cc5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:11.785166 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b5e841ff-c32d-4a20-b9ab-56cd0ec17cc5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:11.785598 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b5e841ff-c32d-4a20-b9ab-56cd0ec17cc5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:11.914969 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b5e841ff-c32d-4a20-b9ab-56cd0ec17cc5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:11.923850 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b5e841ff-c32d-4a20-b9ab-56cd0ec17cc5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:11.925347 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b5e841ff-c32d-4a20-b9ab-56cd0ec17cc5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:11.926524 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-b5e841ff-c32d-4a20-b9ab-56cd0ec17cc5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.153516 Apr 08 11:20:11.927086 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 288/569] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:11 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:20:12.944590 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-482b6a74-9a23-4f9f-876c-078c0659d12a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:12.945137 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-482b6a74-9a23-4f9f-876c-078c0659d12a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:12.952142 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-482b6a74-9a23-4f9f-876c-078c0659d12a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:12.952595 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-482b6a74-9a23-4f9f-876c-078c0659d12a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:12.953407 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-482b6a74-9a23-4f9f-876c-078c0659d12a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:12.953878 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-482b6a74-9a23-4f9f-876c-078c0659d12a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:13.091088 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-482b6a74-9a23-4f9f-876c-078c0659d12a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:13.101188 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-482b6a74-9a23-4f9f-876c-078c0659d12a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:13.102715 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-482b6a74-9a23-4f9f-876c-078c0659d12a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:13.104427 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-482b6a74-9a23-4f9f-876c-078c0659d12a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.163320 Apr 08 11:20:13.104987 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 282/570] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:12 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:20:14.123323 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-8bd9a4c2-f82a-4a19-831d-fd8d920fd687 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:14.123940 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-8bd9a4c2-f82a-4a19-831d-fd8d920fd687 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:14.130675 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8bd9a4c2-f82a-4a19-831d-fd8d920fd687 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:14.131128 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8bd9a4c2-f82a-4a19-831d-fd8d920fd687 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:14.131910 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8bd9a4c2-f82a-4a19-831d-fd8d920fd687 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:14.132357 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8bd9a4c2-f82a-4a19-831d-fd8d920fd687 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:14.265437 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-8bd9a4c2-f82a-4a19-831d-fd8d920fd687 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:14.273720 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-8bd9a4c2-f82a-4a19-831d-fd8d920fd687 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:14.275261 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-8bd9a4c2-f82a-4a19-831d-fd8d920fd687 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:14.276448 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-8bd9a4c2-f82a-4a19-831d-fd8d920fd687 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.157516 Apr 08 11:20:14.277016 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 289/571] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:14 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:20:15.295794 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-70560222-1e39-40b7-8629-c7199f38b1e0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:15.296395 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-70560222-1e39-40b7-8629-c7199f38b1e0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:15.302801 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-70560222-1e39-40b7-8629-c7199f38b1e0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:15.303254 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-70560222-1e39-40b7-8629-c7199f38b1e0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:15.304025 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-70560222-1e39-40b7-8629-c7199f38b1e0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:15.304467 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-70560222-1e39-40b7-8629-c7199f38b1e0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:15.441522 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-70560222-1e39-40b7-8629-c7199f38b1e0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:15.450297 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-70560222-1e39-40b7-8629-c7199f38b1e0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:15.451814 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-70560222-1e39-40b7-8629-c7199f38b1e0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:15.452996 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-70560222-1e39-40b7-8629-c7199f38b1e0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.161824 Apr 08 11:20:15.453560 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 283/572] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:15 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:20:16.471683 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-1f16cb55-1123-43cc-8cc8-e6c0f215af05 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:16.472326 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-1f16cb55-1123-43cc-8cc8-e6c0f215af05 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:16.478616 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1f16cb55-1123-43cc-8cc8-e6c0f215af05 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:16.479073 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1f16cb55-1123-43cc-8cc8-e6c0f215af05 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:16.479850 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1f16cb55-1123-43cc-8cc8-e6c0f215af05 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:16.480293 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1f16cb55-1123-43cc-8cc8-e6c0f215af05 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:16.610933 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1f16cb55-1123-43cc-8cc8-e6c0f215af05 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:16.619079 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1f16cb55-1123-43cc-8cc8-e6c0f215af05 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:16.620589 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1f16cb55-1123-43cc-8cc8-e6c0f215af05 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:16.621746 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-1f16cb55-1123-43cc-8cc8-e6c0f215af05 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.154009 Apr 08 11:20:16.622921 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 290/573] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:16 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:20:17.641161 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1c3e0dfd-a1ba-4c2f-9b6d-d2e3c70400ec tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:17.641808 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1c3e0dfd-a1ba-4c2f-9b6d-d2e3c70400ec tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:17.648596 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1c3e0dfd-a1ba-4c2f-9b6d-d2e3c70400ec tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:17.649056 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1c3e0dfd-a1ba-4c2f-9b6d-d2e3c70400ec tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:17.650028 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1c3e0dfd-a1ba-4c2f-9b6d-d2e3c70400ec tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:17.650483 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1c3e0dfd-a1ba-4c2f-9b6d-d2e3c70400ec tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:17.786909 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1c3e0dfd-a1ba-4c2f-9b6d-d2e3c70400ec tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:17.795555 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1c3e0dfd-a1ba-4c2f-9b6d-d2e3c70400ec tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:17.797233 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1c3e0dfd-a1ba-4c2f-9b6d-d2e3c70400ec tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:17.798432 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1c3e0dfd-a1ba-4c2f-9b6d-d2e3c70400ec tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.161785 Apr 08 11:20:17.799195 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 284/574] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:17 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:20:18.816419 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-86e309e8-c3d3-46b5-8198-8455af8f4d70 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:18.817019 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-86e309e8-c3d3-46b5-8198-8455af8f4d70 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:18.823604 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-86e309e8-c3d3-46b5-8198-8455af8f4d70 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:18.824051 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-86e309e8-c3d3-46b5-8198-8455af8f4d70 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:18.824814 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-86e309e8-c3d3-46b5-8198-8455af8f4d70 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:18.825798 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-86e309e8-c3d3-46b5-8198-8455af8f4d70 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:18.957107 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-86e309e8-c3d3-46b5-8198-8455af8f4d70 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:18.965275 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-86e309e8-c3d3-46b5-8198-8455af8f4d70 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:18.967415 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-86e309e8-c3d3-46b5-8198-8455af8f4d70 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:18.968572 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-86e309e8-c3d3-46b5-8198-8455af8f4d70 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.156051 Apr 08 11:20:18.969131 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 291/575] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:18 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:20:19.987086 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b1a43e41-8da1-4634-849f-c72a354c6a12 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:19.987701 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b1a43e41-8da1-4634-849f-c72a354c6a12 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:19.994284 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b1a43e41-8da1-4634-849f-c72a354c6a12 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:19.994741 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b1a43e41-8da1-4634-849f-c72a354c6a12 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:19.995553 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b1a43e41-8da1-4634-849f-c72a354c6a12 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:19.995995 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b1a43e41-8da1-4634-849f-c72a354c6a12 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:20.126254 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b1a43e41-8da1-4634-849f-c72a354c6a12 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:20.134534 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b1a43e41-8da1-4634-849f-c72a354c6a12 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:20.136049 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b1a43e41-8da1-4634-849f-c72a354c6a12 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:20.137210 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b1a43e41-8da1-4634-849f-c72a354c6a12 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.154031 Apr 08 11:20:20.138401 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 285/576] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:19 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:20:21.156977 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-98bdd976-a519-441d-a32f-7ada43c7b80a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:21.157585 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-98bdd976-a519-441d-a32f-7ada43c7b80a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:21.163622 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-98bdd976-a519-441d-a32f-7ada43c7b80a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:21.164079 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-98bdd976-a519-441d-a32f-7ada43c7b80a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:21.164870 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-98bdd976-a519-441d-a32f-7ada43c7b80a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:21.165308 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-98bdd976-a519-441d-a32f-7ada43c7b80a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:21.311940 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-98bdd976-a519-441d-a32f-7ada43c7b80a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:21.320065 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-98bdd976-a519-441d-a32f-7ada43c7b80a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:21.321553 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-98bdd976-a519-441d-a32f-7ada43c7b80a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:21.322718 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-98bdd976-a519-441d-a32f-7ada43c7b80a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.170327 Apr 08 11:20:21.323266 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 292/577] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:21 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:20:22.340924 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c6118322-cc7d-4473-8e8e-27ff4dcdb6eb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:22.341473 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c6118322-cc7d-4473-8e8e-27ff4dcdb6eb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:22.347775 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c6118322-cc7d-4473-8e8e-27ff4dcdb6eb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:22.348226 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c6118322-cc7d-4473-8e8e-27ff4dcdb6eb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:22.349024 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c6118322-cc7d-4473-8e8e-27ff4dcdb6eb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:22.349459 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c6118322-cc7d-4473-8e8e-27ff4dcdb6eb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:22.483636 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c6118322-cc7d-4473-8e8e-27ff4dcdb6eb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:22.491838 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c6118322-cc7d-4473-8e8e-27ff4dcdb6eb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:22.493347 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c6118322-cc7d-4473-8e8e-27ff4dcdb6eb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:22.494550 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c6118322-cc7d-4473-8e8e-27ff4dcdb6eb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.157679 Apr 08 11:20:22.495110 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 286/578] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:22 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:20:23.514908 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-509de235-a6f9-4ca9-80bd-abea9b1f98b3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:23.515526 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-509de235-a6f9-4ca9-80bd-abea9b1f98b3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:23.522033 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-509de235-a6f9-4ca9-80bd-abea9b1f98b3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:23.522490 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-509de235-a6f9-4ca9-80bd-abea9b1f98b3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:23.523279 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-509de235-a6f9-4ca9-80bd-abea9b1f98b3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:23.523716 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-509de235-a6f9-4ca9-80bd-abea9b1f98b3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:23.662487 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-509de235-a6f9-4ca9-80bd-abea9b1f98b3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:23.670764 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-509de235-a6f9-4ca9-80bd-abea9b1f98b3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:23.672259 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-509de235-a6f9-4ca9-80bd-abea9b1f98b3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:23.673419 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-509de235-a6f9-4ca9-80bd-abea9b1f98b3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.163016 Apr 08 11:20:23.674388 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 293/579] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:23 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:20:24.691616 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-15afdd79-dd3f-4e58-81e9-49651f447ae7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:24.692268 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-15afdd79-dd3f-4e58-81e9-49651f447ae7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:24.698740 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-15afdd79-dd3f-4e58-81e9-49651f447ae7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:24.699200 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-15afdd79-dd3f-4e58-81e9-49651f447ae7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:24.699997 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-15afdd79-dd3f-4e58-81e9-49651f447ae7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:24.700440 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-15afdd79-dd3f-4e58-81e9-49651f447ae7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:24.836210 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-15afdd79-dd3f-4e58-81e9-49651f447ae7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:24.845100 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-15afdd79-dd3f-4e58-81e9-49651f447ae7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:24.846630 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-15afdd79-dd3f-4e58-81e9-49651f447ae7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:24.847776 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-15afdd79-dd3f-4e58-81e9-49651f447ae7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.160121 Apr 08 11:20:24.848338 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 287/580] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:24 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:20:25.865892 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-f171bcc5-b939-43af-b977-92c4fd735e28 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:25.866529 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-f171bcc5-b939-43af-b977-92c4fd735e28 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:25.873026 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f171bcc5-b939-43af-b977-92c4fd735e28 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:25.873486 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f171bcc5-b939-43af-b977-92c4fd735e28 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:25.874301 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f171bcc5-b939-43af-b977-92c4fd735e28 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:25.874747 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f171bcc5-b939-43af-b977-92c4fd735e28 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:26.004660 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f171bcc5-b939-43af-b977-92c4fd735e28 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:26.012827 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f171bcc5-b939-43af-b977-92c4fd735e28 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:26.014371 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f171bcc5-b939-43af-b977-92c4fd735e28 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:26.015510 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-f171bcc5-b939-43af-b977-92c4fd735e28 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.153619 Apr 08 11:20:26.016055 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 294/581] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:25 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:20:27.034194 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-adb041a3-4dfe-43ae-b6e3-4b799f94afd3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:27.034896 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-adb041a3-4dfe-43ae-b6e3-4b799f94afd3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:27.040870 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-adb041a3-4dfe-43ae-b6e3-4b799f94afd3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:27.041360 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-adb041a3-4dfe-43ae-b6e3-4b799f94afd3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:27.042122 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-adb041a3-4dfe-43ae-b6e3-4b799f94afd3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:27.042564 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-adb041a3-4dfe-43ae-b6e3-4b799f94afd3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:27.181748 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-adb041a3-4dfe-43ae-b6e3-4b799f94afd3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:27.190576 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-adb041a3-4dfe-43ae-b6e3-4b799f94afd3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:27.192143 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-adb041a3-4dfe-43ae-b6e3-4b799f94afd3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:27.193270 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-adb041a3-4dfe-43ae-b6e3-4b799f94afd3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.162944 Apr 08 11:20:27.193844 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 288/582] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:27 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:20:28.211975 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a261add9-ba75-4046-9beb-5b81f85bd47a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:28.212596 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a261add9-ba75-4046-9beb-5b81f85bd47a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:28.219245 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a261add9-ba75-4046-9beb-5b81f85bd47a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:28.219700 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a261add9-ba75-4046-9beb-5b81f85bd47a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:28.220474 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a261add9-ba75-4046-9beb-5b81f85bd47a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:28.220947 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a261add9-ba75-4046-9beb-5b81f85bd47a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:28.363766 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a261add9-ba75-4046-9beb-5b81f85bd47a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:28.372645 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a261add9-ba75-4046-9beb-5b81f85bd47a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:28.374209 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a261add9-ba75-4046-9beb-5b81f85bd47a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:28.380553 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a261add9-ba75-4046-9beb-5b81f85bd47a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.167268 Apr 08 11:20:28.380553 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 295/583] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:28 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:20:29.395123 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2103a87d-7916-4e14-9de0-03cbaa086984 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:29.395676 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2103a87d-7916-4e14-9de0-03cbaa086984 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:29.401844 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2103a87d-7916-4e14-9de0-03cbaa086984 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:29.402291 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2103a87d-7916-4e14-9de0-03cbaa086984 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:29.403041 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2103a87d-7916-4e14-9de0-03cbaa086984 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:29.403472 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2103a87d-7916-4e14-9de0-03cbaa086984 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:29.538338 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2103a87d-7916-4e14-9de0-03cbaa086984 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:29.547091 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2103a87d-7916-4e14-9de0-03cbaa086984 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:29.548606 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2103a87d-7916-4e14-9de0-03cbaa086984 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:29.549760 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2103a87d-7916-4e14-9de0-03cbaa086984 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.158592 Apr 08 11:20:29.550348 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 289/584] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:29 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:20:30.568024 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-4bb9d7a5-7350-4e61-b66a-cc13422affd5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:30.568636 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-4bb9d7a5-7350-4e61-b66a-cc13422affd5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:30.575009 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4bb9d7a5-7350-4e61-b66a-cc13422affd5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:30.575460 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4bb9d7a5-7350-4e61-b66a-cc13422affd5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:30.576226 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4bb9d7a5-7350-4e61-b66a-cc13422affd5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:30.576662 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4bb9d7a5-7350-4e61-b66a-cc13422affd5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:30.709381 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-4bb9d7a5-7350-4e61-b66a-cc13422affd5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:30.717496 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-4bb9d7a5-7350-4e61-b66a-cc13422affd5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:30.718956 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-4bb9d7a5-7350-4e61-b66a-cc13422affd5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:30.720781 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-4bb9d7a5-7350-4e61-b66a-cc13422affd5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.156200 Apr 08 11:20:30.721335 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 296/585] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:30 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:20:31.739346 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9e9c9686-794c-4999-aca1-4a63626662b4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:31.739950 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9e9c9686-794c-4999-aca1-4a63626662b4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:31.746173 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9e9c9686-794c-4999-aca1-4a63626662b4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:31.746614 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9e9c9686-794c-4999-aca1-4a63626662b4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:31.747371 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9e9c9686-794c-4999-aca1-4a63626662b4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:31.747798 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9e9c9686-794c-4999-aca1-4a63626662b4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:31.878025 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9e9c9686-794c-4999-aca1-4a63626662b4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:31.886466 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9e9c9686-794c-4999-aca1-4a63626662b4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:31.887985 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9e9c9686-794c-4999-aca1-4a63626662b4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:31.889143 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9e9c9686-794c-4999-aca1-4a63626662b4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.154330 Apr 08 11:20:31.889702 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 290/586] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:31 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:20:32.907901 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-3c60ba2b-9017-4d18-85f9-e2f064a6e359 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:32.908448 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-3c60ba2b-9017-4d18-85f9-e2f064a6e359 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:32.914721 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3c60ba2b-9017-4d18-85f9-e2f064a6e359 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:32.915177 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3c60ba2b-9017-4d18-85f9-e2f064a6e359 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:32.915944 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3c60ba2b-9017-4d18-85f9-e2f064a6e359 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:32.916383 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3c60ba2b-9017-4d18-85f9-e2f064a6e359 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:33.056081 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-3c60ba2b-9017-4d18-85f9-e2f064a6e359 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:33.066880 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-3c60ba2b-9017-4d18-85f9-e2f064a6e359 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:33.066880 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-3c60ba2b-9017-4d18-85f9-e2f064a6e359 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:33.066880 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-3c60ba2b-9017-4d18-85f9-e2f064a6e359 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.163528 Apr 08 11:20:33.067376 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 297/587] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:32 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:20:34.085845 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a5f0e0e9-e1cc-4929-bedc-5dd5b41545c9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:34.086461 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a5f0e0e9-e1cc-4929-bedc-5dd5b41545c9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:34.092725 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a5f0e0e9-e1cc-4929-bedc-5dd5b41545c9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:34.093179 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a5f0e0e9-e1cc-4929-bedc-5dd5b41545c9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:34.094009 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a5f0e0e9-e1cc-4929-bedc-5dd5b41545c9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:34.094459 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a5f0e0e9-e1cc-4929-bedc-5dd5b41545c9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:34.231976 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a5f0e0e9-e1cc-4929-bedc-5dd5b41545c9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:34.241110 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a5f0e0e9-e1cc-4929-bedc-5dd5b41545c9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:34.242888 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a5f0e0e9-e1cc-4929-bedc-5dd5b41545c9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:34.244107 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a5f0e0e9-e1cc-4929-bedc-5dd5b41545c9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.162142 Apr 08 11:20:34.244726 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 291/588] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:34 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:20:34.776946 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-ca951a29-a7a3-4626-b37e-bf6abfa43e1c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:20:34.777990 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-ca951a29-a7a3-4626-b37e-bf6abfa43e1c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:34.784855 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ca951a29-a7a3-4626-b37e-bf6abfa43e1c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:34.785314 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ca951a29-a7a3-4626-b37e-bf6abfa43e1c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:34.786118 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ca951a29-a7a3-4626-b37e-bf6abfa43e1c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:34.786564 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ca951a29-a7a3-4626-b37e-bf6abfa43e1c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:34.810307 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.objects.instance [None req-ca951a29-a7a3-4626-b37e-bf6abfa43e1c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lazy-loading 'flavor' on Instance uuid bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 {{(pid=117801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 11:20:35.186194 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-ca951a29-a7a3-4626-b37e-bf6abfa43e1c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "POST /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/action" status: 200 len: 32 microversion: 2.1 time: 0.413105 Apr 08 11:20:35.190281 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 298/589] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Apr 8 11:20:34 2022] POST /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/action => generated 32 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 11:20:35.196578 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d26642fb-c07d-4104-9ad1-ec3c31dacfed tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:35.197193 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d26642fb-c07d-4104-9ad1-ec3c31dacfed tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:35.203513 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d26642fb-c07d-4104-9ad1-ec3c31dacfed tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:35.203969 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d26642fb-c07d-4104-9ad1-ec3c31dacfed tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:35.204743 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d26642fb-c07d-4104-9ad1-ec3c31dacfed tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:35.205184 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d26642fb-c07d-4104-9ad1-ec3c31dacfed tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:35.270037 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a94c3cab-a350-4a7a-b960-3c8c3bf7c71a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:35.271513 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a94c3cab-a350-4a7a-b960-3c8c3bf7c71a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:35.282233 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a94c3cab-a350-4a7a-b960-3c8c3bf7c71a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:35.283159 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a94c3cab-a350-4a7a-b960-3c8c3bf7c71a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:35.284352 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a94c3cab-a350-4a7a-b960-3c8c3bf7c71a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:35.285122 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a94c3cab-a350-4a7a-b960-3c8c3bf7c71a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:35.403082 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d26642fb-c07d-4104-9ad1-ec3c31dacfed tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:35.411646 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d26642fb-c07d-4104-9ad1-ec3c31dacfed tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1735 microversion: 2.1 time: 0.218906 Apr 08 11:20:35.412227 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 292/590] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:20:35 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1735 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:20:35.471308 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a94c3cab-a350-4a7a-b960-3c8c3bf7c71a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:35.479521 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a94c3cab-a350-4a7a-b960-3c8c3bf7c71a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:35.481041 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a94c3cab-a350-4a7a-b960-3c8c3bf7c71a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:35.482222 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a94c3cab-a350-4a7a-b960-3c8c3bf7c71a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.220602 Apr 08 11:20:35.482782 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 299/591] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:35 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:20:36.428718 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-790f744d-cdd5-40e9-8f5e-2505aa745429 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:36.429469 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-790f744d-cdd5-40e9-8f5e-2505aa745429 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:36.436024 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-790f744d-cdd5-40e9-8f5e-2505aa745429 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:36.436476 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-790f744d-cdd5-40e9-8f5e-2505aa745429 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:36.437254 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-790f744d-cdd5-40e9-8f5e-2505aa745429 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:36.437697 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-790f744d-cdd5-40e9-8f5e-2505aa745429 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:36.501534 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-5bad0f81-2cba-4fab-bd0d-6ce93614d722 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:36.502628 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-5bad0f81-2cba-4fab-bd0d-6ce93614d722 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:36.509080 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5bad0f81-2cba-4fab-bd0d-6ce93614d722 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:36.509536 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5bad0f81-2cba-4fab-bd0d-6ce93614d722 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:36.510351 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5bad0f81-2cba-4fab-bd0d-6ce93614d722 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:36.510796 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5bad0f81-2cba-4fab-bd0d-6ce93614d722 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:36.876040 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-790f744d-cdd5-40e9-8f5e-2505aa745429 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:36.880684 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-5bad0f81-2cba-4fab-bd0d-6ce93614d722 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:36.884430 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-790f744d-cdd5-40e9-8f5e-2505aa745429 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1735 microversion: 2.1 time: 0.459497 Apr 08 11:20:36.885012 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 293/592] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:20:36 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1735 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:20:36.889021 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-5bad0f81-2cba-4fab-bd0d-6ce93614d722 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:36.890556 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-5bad0f81-2cba-4fab-bd0d-6ce93614d722 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:36.891713 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-5bad0f81-2cba-4fab-bd0d-6ce93614d722 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.394497 Apr 08 11:20:36.892254 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 300/593] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:36 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:20:37.901317 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-74cb6d6b-9aeb-4283-aa66-dc50ffe85e6c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:37.901896 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-74cb6d6b-9aeb-4283-aa66-dc50ffe85e6c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:37.908389 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-74cb6d6b-9aeb-4283-aa66-dc50ffe85e6c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:37.908836 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-74cb6d6b-9aeb-4283-aa66-dc50ffe85e6c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:37.909603 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-74cb6d6b-9aeb-4283-aa66-dc50ffe85e6c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:37.909708 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-3800858b-cc9e-4aae-9e36-7050fbb155ae tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:37.910173 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-74cb6d6b-9aeb-4283-aa66-dc50ffe85e6c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:37.910292 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-3800858b-cc9e-4aae-9e36-7050fbb155ae tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:37.916456 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3800858b-cc9e-4aae-9e36-7050fbb155ae tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:37.916916 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3800858b-cc9e-4aae-9e36-7050fbb155ae tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:37.917685 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3800858b-cc9e-4aae-9e36-7050fbb155ae tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:37.918173 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3800858b-cc9e-4aae-9e36-7050fbb155ae tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:38.119119 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-74cb6d6b-9aeb-4283-aa66-dc50ffe85e6c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:38.122228 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-3800858b-cc9e-4aae-9e36-7050fbb155ae tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:38.128763 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-74cb6d6b-9aeb-4283-aa66-dc50ffe85e6c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1735 microversion: 2.1 time: 0.231361 Apr 08 11:20:38.129441 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 294/594] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:20:37 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1735 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:20:38.131241 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-3800858b-cc9e-4aae-9e36-7050fbb155ae tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:38.132743 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-3800858b-cc9e-4aae-9e36-7050fbb155ae tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:38.133910 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-3800858b-cc9e-4aae-9e36-7050fbb155ae tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.228069 Apr 08 11:20:38.134481 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 301/595] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:37 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:20:39.146564 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-783c0d5a-620d-4731-87a5-c3169f3d5de7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:39.147197 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-783c0d5a-620d-4731-87a5-c3169f3d5de7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:39.152104 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-0d6e7ee1-211c-47f6-b790-d9173da7eada tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:39.152711 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-0d6e7ee1-211c-47f6-b790-d9173da7eada tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:39.153572 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-783c0d5a-620d-4731-87a5-c3169f3d5de7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:39.154064 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-783c0d5a-620d-4731-87a5-c3169f3d5de7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:39.154848 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-783c0d5a-620d-4731-87a5-c3169f3d5de7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:39.155286 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-783c0d5a-620d-4731-87a5-c3169f3d5de7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:39.159009 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0d6e7ee1-211c-47f6-b790-d9173da7eada tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:39.159521 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0d6e7ee1-211c-47f6-b790-d9173da7eada tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:39.160287 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0d6e7ee1-211c-47f6-b790-d9173da7eada tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:39.160718 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0d6e7ee1-211c-47f6-b790-d9173da7eada tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:39.362150 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-783c0d5a-620d-4731-87a5-c3169f3d5de7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:39.368728 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-0d6e7ee1-211c-47f6-b790-d9173da7eada tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:39.370281 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-783c0d5a-620d-4731-87a5-c3169f3d5de7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1735 microversion: 2.1 time: 0.228288 Apr 08 11:20:39.370873 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 295/596] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:20:39 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1735 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:20:39.378063 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-0d6e7ee1-211c-47f6-b790-d9173da7eada tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:39.379515 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-0d6e7ee1-211c-47f6-b790-d9173da7eada tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:39.380671 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-0d6e7ee1-211c-47f6-b790-d9173da7eada tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.232417 Apr 08 11:20:39.381234 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 302/597] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:39 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:20:40.387246 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-59874449-3361-4dda-8691-e54c622600b7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:40.387842 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-59874449-3361-4dda-8691-e54c622600b7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:40.394275 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-59874449-3361-4dda-8691-e54c622600b7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:40.394776 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-59874449-3361-4dda-8691-e54c622600b7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:40.395561 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-59874449-3361-4dda-8691-e54c622600b7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:40.396007 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-59874449-3361-4dda-8691-e54c622600b7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:40.398575 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-d42476a7-bfac-4d39-a7d9-9de0035eb6bd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:40.399199 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-d42476a7-bfac-4d39-a7d9-9de0035eb6bd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:40.405261 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d42476a7-bfac-4d39-a7d9-9de0035eb6bd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:40.405718 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d42476a7-bfac-4d39-a7d9-9de0035eb6bd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:40.406521 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d42476a7-bfac-4d39-a7d9-9de0035eb6bd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:40.406969 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d42476a7-bfac-4d39-a7d9-9de0035eb6bd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:40.591211 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d42476a7-bfac-4d39-a7d9-9de0035eb6bd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:40.598211 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-59874449-3361-4dda-8691-e54c622600b7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:40.600240 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d42476a7-bfac-4d39-a7d9-9de0035eb6bd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:40.601228 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d42476a7-bfac-4d39-a7d9-9de0035eb6bd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:40.602447 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-d42476a7-bfac-4d39-a7d9-9de0035eb6bd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.207743 Apr 08 11:20:40.603001 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 303/598] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:40 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:20:40.607494 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-59874449-3361-4dda-8691-e54c622600b7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1735 microversion: 2.1 time: 0.223942 Apr 08 11:20:40.615044 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 296/599] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:20:40 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1735 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:20:41.621108 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-14ee18e5-3fda-466a-9147-a3c53940b36b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:41.621692 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-14ee18e5-3fda-466a-9147-a3c53940b36b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:41.629574 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-14ee18e5-3fda-466a-9147-a3c53940b36b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:41.630051 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-14ee18e5-3fda-466a-9147-a3c53940b36b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:41.630847 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-14ee18e5-3fda-466a-9147-a3c53940b36b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:41.631170 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6594e1e7-b30c-481c-8f21-9cc7f099760a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:41.631644 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-14ee18e5-3fda-466a-9147-a3c53940b36b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:41.631795 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6594e1e7-b30c-481c-8f21-9cc7f099760a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:41.638715 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6594e1e7-b30c-481c-8f21-9cc7f099760a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:41.639176 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6594e1e7-b30c-481c-8f21-9cc7f099760a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:41.640058 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6594e1e7-b30c-481c-8f21-9cc7f099760a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:41.640975 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6594e1e7-b30c-481c-8f21-9cc7f099760a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:41.834129 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-14ee18e5-3fda-466a-9147-a3c53940b36b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:41.841566 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6594e1e7-b30c-481c-8f21-9cc7f099760a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:41.842609 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-14ee18e5-3fda-466a-9147-a3c53940b36b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:41.844120 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-14ee18e5-3fda-466a-9147-a3c53940b36b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:41.845280 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-14ee18e5-3fda-466a-9147-a3c53940b36b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.228217 Apr 08 11:20:41.845847 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 304/600] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:41 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:20:41.849709 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6594e1e7-b30c-481c-8f21-9cc7f099760a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1735 microversion: 2.1 time: 0.222846 Apr 08 11:20:41.850315 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 297/601] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:20:41 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1735 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:20:42.862997 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-43690973-a084-4ad0-b9f2-da097de5d0b8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:42.863539 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-43690973-a084-4ad0-b9f2-da097de5d0b8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:42.866596 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8f39912d-1a0e-4ca6-94a6-64b0734757ae tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:42.867215 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8f39912d-1a0e-4ca6-94a6-64b0734757ae tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:42.869923 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-43690973-a084-4ad0-b9f2-da097de5d0b8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:42.870379 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-43690973-a084-4ad0-b9f2-da097de5d0b8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:42.871144 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-43690973-a084-4ad0-b9f2-da097de5d0b8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:42.871578 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-43690973-a084-4ad0-b9f2-da097de5d0b8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:42.873553 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8f39912d-1a0e-4ca6-94a6-64b0734757ae tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:42.874046 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8f39912d-1a0e-4ca6-94a6-64b0734757ae tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:42.875087 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8f39912d-1a0e-4ca6-94a6-64b0734757ae tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:42.875531 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8f39912d-1a0e-4ca6-94a6-64b0734757ae tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:43.065516 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-43690973-a084-4ad0-b9f2-da097de5d0b8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:43.074339 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8f39912d-1a0e-4ca6-94a6-64b0734757ae tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:43.074579 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-43690973-a084-4ad0-b9f2-da097de5d0b8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:43.075911 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-43690973-a084-4ad0-b9f2-da097de5d0b8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:43.077082 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-43690973-a084-4ad0-b9f2-da097de5d0b8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.218338 Apr 08 11:20:43.077640 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 305/602] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:42 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:20:43.084055 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8f39912d-1a0e-4ca6-94a6-64b0734757ae tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1735 microversion: 2.1 time: 0.221227 Apr 08 11:20:43.084636 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 298/603] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:20:42 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1735 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:20:44.097489 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-4bfd9430-b74a-4a8e-a7f9-b57eeb5a2622 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:44.098247 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-4bfd9430-b74a-4a8e-a7f9-b57eeb5a2622 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:44.100632 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-cf8861f0-da46-4187-bd63-483dd84c06b9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:44.101246 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-cf8861f0-da46-4187-bd63-483dd84c06b9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:44.104698 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4bfd9430-b74a-4a8e-a7f9-b57eeb5a2622 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:44.105141 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4bfd9430-b74a-4a8e-a7f9-b57eeb5a2622 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:44.105941 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4bfd9430-b74a-4a8e-a7f9-b57eeb5a2622 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:44.106382 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4bfd9430-b74a-4a8e-a7f9-b57eeb5a2622 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:44.107699 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cf8861f0-da46-4187-bd63-483dd84c06b9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:44.108150 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cf8861f0-da46-4187-bd63-483dd84c06b9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:44.108930 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cf8861f0-da46-4187-bd63-483dd84c06b9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:44.109368 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cf8861f0-da46-4187-bd63-483dd84c06b9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:44.304845 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-cf8861f0-da46-4187-bd63-483dd84c06b9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:44.308693 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-4bfd9430-b74a-4a8e-a7f9-b57eeb5a2622 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:44.312920 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-cf8861f0-da46-4187-bd63-483dd84c06b9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1735 microversion: 2.1 time: 0.216001 Apr 08 11:20:44.313504 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 299/604] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:20:44 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1735 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:20:44.316919 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-4bfd9430-b74a-4a8e-a7f9-b57eeb5a2622 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:44.318432 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-4bfd9430-b74a-4a8e-a7f9-b57eeb5a2622 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:44.319612 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-4bfd9430-b74a-4a8e-a7f9-b57eeb5a2622 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.226771 Apr 08 11:20:44.320156 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 306/605] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:44 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:20:45.332513 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d5d4b0c2-bdfb-4152-9093-a14ae09da84e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:45.333591 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d5d4b0c2-bdfb-4152-9093-a14ae09da84e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:45.341366 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d5d4b0c2-bdfb-4152-9093-a14ae09da84e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:45.341668 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-636d8b85-3b5a-4b46-a471-5a0ea15eba3f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:45.342143 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d5d4b0c2-bdfb-4152-9093-a14ae09da84e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:45.342320 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-636d8b85-3b5a-4b46-a471-5a0ea15eba3f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:45.342618 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d5d4b0c2-bdfb-4152-9093-a14ae09da84e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:45.343063 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d5d4b0c2-bdfb-4152-9093-a14ae09da84e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:45.349596 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-636d8b85-3b5a-4b46-a471-5a0ea15eba3f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:45.350068 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-636d8b85-3b5a-4b46-a471-5a0ea15eba3f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:45.350837 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-636d8b85-3b5a-4b46-a471-5a0ea15eba3f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:45.351270 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-636d8b85-3b5a-4b46-a471-5a0ea15eba3f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:45.542675 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d5d4b0c2-bdfb-4152-9093-a14ae09da84e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:45.549647 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-636d8b85-3b5a-4b46-a471-5a0ea15eba3f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:45.551079 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d5d4b0c2-bdfb-4152-9093-a14ae09da84e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1735 microversion: 2.1 time: 0.224859 Apr 08 11:20:45.551667 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 300/606] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:20:45 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1735 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:20:45.558047 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-636d8b85-3b5a-4b46-a471-5a0ea15eba3f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:45.559579 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-636d8b85-3b5a-4b46-a471-5a0ea15eba3f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:45.560753 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-636d8b85-3b5a-4b46-a471-5a0ea15eba3f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.223073 Apr 08 11:20:45.561293 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 307/607] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:45 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:20:46.568626 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-36f51dc3-c783-4ea1-aa16-9dfd56d4be8c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:46.569291 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-36f51dc3-c783-4ea1-aa16-9dfd56d4be8c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:46.575548 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-36f51dc3-c783-4ea1-aa16-9dfd56d4be8c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:46.576003 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-36f51dc3-c783-4ea1-aa16-9dfd56d4be8c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:46.576779 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-36f51dc3-c783-4ea1-aa16-9dfd56d4be8c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:46.577223 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-36f51dc3-c783-4ea1-aa16-9dfd56d4be8c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:46.579242 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-12bfa9a7-f6e3-4825-9be8-af8c5413818b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:46.580004 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-12bfa9a7-f6e3-4825-9be8-af8c5413818b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:46.587057 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-12bfa9a7-f6e3-4825-9be8-af8c5413818b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:46.587535 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-12bfa9a7-f6e3-4825-9be8-af8c5413818b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:46.588316 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-12bfa9a7-f6e3-4825-9be8-af8c5413818b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:46.588757 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-12bfa9a7-f6e3-4825-9be8-af8c5413818b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:46.781484 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-36f51dc3-c783-4ea1-aa16-9dfd56d4be8c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:46.784267 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-12bfa9a7-f6e3-4825-9be8-af8c5413818b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:46.789390 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-36f51dc3-c783-4ea1-aa16-9dfd56d4be8c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1735 microversion: 2.1 time: 0.224588 Apr 08 11:20:46.789987 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 301/608] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:20:46 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1735 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:20:46.792922 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-12bfa9a7-f6e3-4825-9be8-af8c5413818b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:46.794462 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-12bfa9a7-f6e3-4825-9be8-af8c5413818b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:46.795613 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-12bfa9a7-f6e3-4825-9be8-af8c5413818b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.221154 Apr 08 11:20:46.796162 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 308/609] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:46 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:20:47.806136 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0c0c52c1-62e1-46f3-9036-32622d5b3d47 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:47.806766 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0c0c52c1-62e1-46f3-9036-32622d5b3d47 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:47.812756 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-6b79204d-e847-43fc-8988-128bc7a4a0c6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:47.813233 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0c0c52c1-62e1-46f3-9036-32622d5b3d47 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:47.813395 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-6b79204d-e847-43fc-8988-128bc7a4a0c6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:47.813544 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0c0c52c1-62e1-46f3-9036-32622d5b3d47 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:47.814337 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0c0c52c1-62e1-46f3-9036-32622d5b3d47 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:47.814769 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0c0c52c1-62e1-46f3-9036-32622d5b3d47 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:47.819834 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6b79204d-e847-43fc-8988-128bc7a4a0c6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:47.820290 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6b79204d-e847-43fc-8988-128bc7a4a0c6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:47.821074 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6b79204d-e847-43fc-8988-128bc7a4a0c6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:47.821516 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6b79204d-e847-43fc-8988-128bc7a4a0c6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:48.023700 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0c0c52c1-62e1-46f3-9036-32622d5b3d47 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:48.027231 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6b79204d-e847-43fc-8988-128bc7a4a0c6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:48.032741 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0c0c52c1-62e1-46f3-9036-32622d5b3d47 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1735 microversion: 2.1 time: 0.229794 Apr 08 11:20:48.044069 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 302/610] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:20:47 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1735 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:20:48.044223 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6b79204d-e847-43fc-8988-128bc7a4a0c6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:48.044223 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6b79204d-e847-43fc-8988-128bc7a4a0c6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:48.044223 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-6b79204d-e847-43fc-8988-128bc7a4a0c6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.229903 Apr 08 11:20:48.044532 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 309/611] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:47 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:20:49.050654 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-531743cd-80ef-42fc-8100-4d646698c2a9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:49.051299 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-531743cd-80ef-42fc-8100-4d646698c2a9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:49.056180 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-5fc190d4-2c59-494b-a90d-3c87776257d1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:49.058026 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-5fc190d4-2c59-494b-a90d-3c87776257d1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:49.058895 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-531743cd-80ef-42fc-8100-4d646698c2a9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:49.059354 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-531743cd-80ef-42fc-8100-4d646698c2a9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:49.060148 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-531743cd-80ef-42fc-8100-4d646698c2a9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:49.060591 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-531743cd-80ef-42fc-8100-4d646698c2a9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:49.063533 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5fc190d4-2c59-494b-a90d-3c87776257d1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:49.064047 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5fc190d4-2c59-494b-a90d-3c87776257d1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:49.064829 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5fc190d4-2c59-494b-a90d-3c87776257d1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:49.065264 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5fc190d4-2c59-494b-a90d-3c87776257d1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:49.287710 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-531743cd-80ef-42fc-8100-4d646698c2a9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:49.291639 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-5fc190d4-2c59-494b-a90d-3c87776257d1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:49.295703 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-531743cd-80ef-42fc-8100-4d646698c2a9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1735 microversion: 2.1 time: 0.249605 Apr 08 11:20:49.296295 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 303/612] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:20:49 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1735 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:20:49.302273 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-5fc190d4-2c59-494b-a90d-3c87776257d1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:49.303716 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-5fc190d4-2c59-494b-a90d-3c87776257d1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:49.304876 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-5fc190d4-2c59-494b-a90d-3c87776257d1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.252536 Apr 08 11:20:49.305424 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 310/613] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:49 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:20:50.313532 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8b1930da-da3a-448f-9f7b-67976ec3b527 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:50.314146 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8b1930da-da3a-448f-9f7b-67976ec3b527 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:50.320491 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8b1930da-da3a-448f-9f7b-67976ec3b527 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:50.320935 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8b1930da-da3a-448f-9f7b-67976ec3b527 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:50.321749 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8b1930da-da3a-448f-9f7b-67976ec3b527 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:50.322212 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8b1930da-da3a-448f-9f7b-67976ec3b527 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:50.323397 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-8cd4d593-829e-4793-9900-bf7bb378d7c2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:50.324009 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-8cd4d593-829e-4793-9900-bf7bb378d7c2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:50.330713 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8cd4d593-829e-4793-9900-bf7bb378d7c2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:50.331158 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8cd4d593-829e-4793-9900-bf7bb378d7c2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:50.331941 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8cd4d593-829e-4793-9900-bf7bb378d7c2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:50.332380 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8cd4d593-829e-4793-9900-bf7bb378d7c2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:50.523387 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8b1930da-da3a-448f-9f7b-67976ec3b527 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:50.526131 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-8cd4d593-829e-4793-9900-bf7bb378d7c2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:50.531369 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8b1930da-da3a-448f-9f7b-67976ec3b527 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1735 microversion: 2.1 time: 0.221704 Apr 08 11:20:50.531985 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 304/614] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:20:50 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1735 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:20:50.534806 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-8cd4d593-829e-4793-9900-bf7bb378d7c2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:50.536324 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-8cd4d593-829e-4793-9900-bf7bb378d7c2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:50.537473 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-8cd4d593-829e-4793-9900-bf7bb378d7c2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.217964 Apr 08 11:20:50.538112 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 311/615] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:50 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:20:51.548909 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-658aed03-a3e8-48df-914b-4cc02cb96406 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:51.549601 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-658aed03-a3e8-48df-914b-4cc02cb96406 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:51.554629 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-21ee168d-d5da-478f-95f8-639ee3c30838 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:51.555244 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-21ee168d-d5da-478f-95f8-639ee3c30838 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:51.555880 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-658aed03-a3e8-48df-914b-4cc02cb96406 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:51.556363 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-658aed03-a3e8-48df-914b-4cc02cb96406 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:51.557135 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-658aed03-a3e8-48df-914b-4cc02cb96406 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:51.557570 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-658aed03-a3e8-48df-914b-4cc02cb96406 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:51.561450 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-21ee168d-d5da-478f-95f8-639ee3c30838 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:51.561931 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-21ee168d-d5da-478f-95f8-639ee3c30838 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:51.562709 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-21ee168d-d5da-478f-95f8-639ee3c30838 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:51.563186 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-21ee168d-d5da-478f-95f8-639ee3c30838 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:51.760458 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-658aed03-a3e8-48df-914b-4cc02cb96406 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:51.764537 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-21ee168d-d5da-478f-95f8-639ee3c30838 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:51.768199 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-658aed03-a3e8-48df-914b-4cc02cb96406 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1735 microversion: 2.1 time: 0.223612 Apr 08 11:20:51.768770 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 305/616] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:20:51 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1735 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:20:51.772743 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-21ee168d-d5da-478f-95f8-639ee3c30838 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:51.774267 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-21ee168d-d5da-478f-95f8-639ee3c30838 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:51.775425 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-21ee168d-d5da-478f-95f8-639ee3c30838 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.224579 Apr 08 11:20:51.775975 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 312/617] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:51 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:20:52.785092 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0b0621c9-0cdf-4818-94a3-cc876a27c75a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:52.785619 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0b0621c9-0cdf-4818-94a3-cc876a27c75a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:52.791960 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0b0621c9-0cdf-4818-94a3-cc876a27c75a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:52.792308 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-0e2ac924-80e3-4531-9a27-c6555f8b839f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:52.792769 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0b0621c9-0cdf-4818-94a3-cc876a27c75a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:52.792961 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-0e2ac924-80e3-4531-9a27-c6555f8b839f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:52.793169 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0b0621c9-0cdf-4818-94a3-cc876a27c75a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:52.793606 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0b0621c9-0cdf-4818-94a3-cc876a27c75a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:52.799828 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0e2ac924-80e3-4531-9a27-c6555f8b839f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:52.800282 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0e2ac924-80e3-4531-9a27-c6555f8b839f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:52.801057 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0e2ac924-80e3-4531-9a27-c6555f8b839f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:52.801500 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0e2ac924-80e3-4531-9a27-c6555f8b839f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:52.996453 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0b0621c9-0cdf-4818-94a3-cc876a27c75a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:53.000085 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-0e2ac924-80e3-4531-9a27-c6555f8b839f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:53.004712 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0b0621c9-0cdf-4818-94a3-cc876a27c75a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1735 microversion: 2.1 time: 0.223981 Apr 08 11:20:53.006089 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 306/618] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:20:52 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1735 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:20:53.008666 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-0e2ac924-80e3-4531-9a27-c6555f8b839f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:53.010220 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-0e2ac924-80e3-4531-9a27-c6555f8b839f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:53.011364 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-0e2ac924-80e3-4531-9a27-c6555f8b839f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.223024 Apr 08 11:20:53.011905 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 313/619] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:52 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:20:54.022509 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-03013586-eab1-4db4-984f-1a49390470dd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:54.023123 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-03013586-eab1-4db4-984f-1a49390470dd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:54.029556 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-03013586-eab1-4db4-984f-1a49390470dd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:54.029863 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-407fa84b-4bfc-473c-b0c1-783bb91e11c9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:54.030322 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-03013586-eab1-4db4-984f-1a49390470dd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:54.030450 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-407fa84b-4bfc-473c-b0c1-783bb91e11c9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:54.030818 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-03013586-eab1-4db4-984f-1a49390470dd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:54.031260 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-03013586-eab1-4db4-984f-1a49390470dd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:54.036930 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-407fa84b-4bfc-473c-b0c1-783bb91e11c9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:54.042757 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-407fa84b-4bfc-473c-b0c1-783bb91e11c9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:54.042757 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-407fa84b-4bfc-473c-b0c1-783bb91e11c9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:54.042757 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-407fa84b-4bfc-473c-b0c1-783bb91e11c9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:54.233720 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-03013586-eab1-4db4-984f-1a49390470dd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:54.237576 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-407fa84b-4bfc-473c-b0c1-783bb91e11c9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:54.242460 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-03013586-eab1-4db4-984f-1a49390470dd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1735 microversion: 2.1 time: 0.223713 Apr 08 11:20:54.243039 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 307/620] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:20:54 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1735 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:20:54.245923 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-407fa84b-4bfc-473c-b0c1-783bb91e11c9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:54.247418 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-407fa84b-4bfc-473c-b0c1-783bb91e11c9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:54.248646 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-407fa84b-4bfc-473c-b0c1-783bb91e11c9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.222774 Apr 08 11:20:54.249464 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 314/621] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:54 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:20:54.646315 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c0c602de-c859-4184-9f67-5c540a2836e9 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:54.646817 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c0c602de-c859-4184-9f67-5c540a2836e9 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:54.652782 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c0c602de-c859-4184-9f67-5c540a2836e9 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:54.653235 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c0c602de-c859-4184-9f67-5c540a2836e9 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:54.654037 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c0c602de-c859-4184-9f67-5c540a2836e9 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:54.654475 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c0c602de-c859-4184-9f67-5c540a2836e9 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:54.774890 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-c0c602de-c859-4184-9f67-5c540a2836e9 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lazy-loading 'services' on Instance uuid eff1b1a4-3738-43db-86ce-a17e2f08ffc0 {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 11:20:55.054378 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c0c602de-c859-4184-9f67-5c540a2836e9 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "DELETE /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/os-volume_attachments/71f32ab3-7067-48a5-90d2-edfdfa694080" status: 202 len: 0 microversion: 2.1 time: 0.508492 Apr 08 11:20:55.055278 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 308/622] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Apr 8 11:20:54 2022] DELETE /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/os-volume_attachments/71f32ab3-7067-48a5-90d2-edfdfa694080 => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 11:20:55.260067 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-9d9ef074-720d-4994-b4f0-a7089a8f94bb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:55.261035 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-9d9ef074-720d-4994-b4f0-a7089a8f94bb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:55.266960 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b7ce24a1-82b7-452a-bbe1-79c3d72da076 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:55.267891 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b7ce24a1-82b7-452a-bbe1-79c3d72da076 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:55.268351 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9d9ef074-720d-4994-b4f0-a7089a8f94bb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:55.268814 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9d9ef074-720d-4994-b4f0-a7089a8f94bb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:55.269599 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9d9ef074-720d-4994-b4f0-a7089a8f94bb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:55.270067 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9d9ef074-720d-4994-b4f0-a7089a8f94bb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:55.278970 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b7ce24a1-82b7-452a-bbe1-79c3d72da076 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:55.279415 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b7ce24a1-82b7-452a-bbe1-79c3d72da076 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:55.280184 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b7ce24a1-82b7-452a-bbe1-79c3d72da076 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:55.280613 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b7ce24a1-82b7-452a-bbe1-79c3d72da076 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:55.474734 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-9d9ef074-720d-4994-b4f0-a7089a8f94bb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:55.481683 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b7ce24a1-82b7-452a-bbe1-79c3d72da076 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:55.482535 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-9d9ef074-720d-4994-b4f0-a7089a8f94bb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1735 microversion: 2.1 time: 0.226278 Apr 08 11:20:55.483109 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 315/623] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:20:55 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1735 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:20:55.490404 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b7ce24a1-82b7-452a-bbe1-79c3d72da076 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:55.491899 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b7ce24a1-82b7-452a-bbe1-79c3d72da076 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:55.493032 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b7ce24a1-82b7-452a-bbe1-79c3d72da076 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.231005 Apr 08 11:20:55.493573 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 309/624] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:55 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:20:56.501047 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-67f97dd9-c6fd-4d7c-ae0c-c64e2e08874c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:56.501591 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-67f97dd9-c6fd-4d7c-ae0c-c64e2e08874c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:56.508016 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-67f97dd9-c6fd-4d7c-ae0c-c64e2e08874c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:56.508462 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-67f97dd9-c6fd-4d7c-ae0c-c64e2e08874c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:56.509223 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-67f97dd9-c6fd-4d7c-ae0c-c64e2e08874c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:56.509656 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-67f97dd9-c6fd-4d7c-ae0c-c64e2e08874c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:56.511959 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1e3ff341-2914-4017-b8a8-17c215280019 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:56.512589 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1e3ff341-2914-4017-b8a8-17c215280019 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:56.518571 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1e3ff341-2914-4017-b8a8-17c215280019 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:56.519027 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1e3ff341-2914-4017-b8a8-17c215280019 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:56.519814 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1e3ff341-2914-4017-b8a8-17c215280019 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:56.520256 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1e3ff341-2914-4017-b8a8-17c215280019 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:56.721111 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-67f97dd9-c6fd-4d7c-ae0c-c64e2e08874c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:56.729483 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-67f97dd9-c6fd-4d7c-ae0c-c64e2e08874c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1735 microversion: 2.1 time: 0.233128 Apr 08 11:20:56.730101 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 316/625] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:20:56 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1735 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:20:56.733208 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1e3ff341-2914-4017-b8a8-17c215280019 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:56.745009 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1e3ff341-2914-4017-b8a8-17c215280019 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:56.746565 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1e3ff341-2914-4017-b8a8-17c215280019 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:56.747754 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1e3ff341-2914-4017-b8a8-17c215280019 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.239771 Apr 08 11:20:56.755100 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 310/626] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:56 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:20:57.746198 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-d4c3fb46-f468-485f-8294-d13c7b176db8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:57.746895 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-d4c3fb46-f468-485f-8294-d13c7b176db8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:57.753822 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d4c3fb46-f468-485f-8294-d13c7b176db8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:57.754269 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d4c3fb46-f468-485f-8294-d13c7b176db8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:57.755043 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d4c3fb46-f468-485f-8294-d13c7b176db8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:57.755475 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d4c3fb46-f468-485f-8294-d13c7b176db8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:57.771765 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a1b6d887-e1ff-4771-b5b1-294965a4d3b9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:57.772468 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a1b6d887-e1ff-4771-b5b1-294965a4d3b9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:57.779259 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a1b6d887-e1ff-4771-b5b1-294965a4d3b9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:57.779809 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a1b6d887-e1ff-4771-b5b1-294965a4d3b9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:57.780708 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a1b6d887-e1ff-4771-b5b1-294965a4d3b9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:57.781225 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a1b6d887-e1ff-4771-b5b1-294965a4d3b9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:57.962153 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d4c3fb46-f468-485f-8294-d13c7b176db8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:57.969459 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a1b6d887-e1ff-4771-b5b1-294965a4d3b9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:57.970039 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-d4c3fb46-f468-485f-8294-d13c7b176db8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1735 microversion: 2.1 time: 0.227598 Apr 08 11:20:57.970628 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 317/627] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:20:57 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1735 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:20:57.977917 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a1b6d887-e1ff-4771-b5b1-294965a4d3b9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:57.979432 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a1b6d887-e1ff-4771-b5b1-294965a4d3b9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:57.980627 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a1b6d887-e1ff-4771-b5b1-294965a4d3b9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.212645 Apr 08 11:20:57.981239 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 311/628] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:57 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:20:58.987924 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-d4c5495a-082b-4ebd-b6ac-eb43c7280ac5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:58.988532 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-d4c5495a-082b-4ebd-b6ac-eb43c7280ac5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:58.994903 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d4c5495a-082b-4ebd-b6ac-eb43c7280ac5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:58.995398 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d4c5495a-082b-4ebd-b6ac-eb43c7280ac5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:58.996135 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d4c5495a-082b-4ebd-b6ac-eb43c7280ac5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:58.996573 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d4c5495a-082b-4ebd-b6ac-eb43c7280ac5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:58.999245 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-69cc157c-af7c-4604-9be6-a31de249aa10 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:20:59.001321 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-69cc157c-af7c-4604-9be6-a31de249aa10 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:20:59.006536 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-69cc157c-af7c-4604-9be6-a31de249aa10 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:59.006668 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-69cc157c-af7c-4604-9be6-a31de249aa10 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:59.007364 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-69cc157c-af7c-4604-9be6-a31de249aa10 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:20:59.007804 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-69cc157c-af7c-4604-9be6-a31de249aa10 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:20:59.184342 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d4c5495a-082b-4ebd-b6ac-eb43c7280ac5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:59.192165 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-d4c5495a-082b-4ebd-b6ac-eb43c7280ac5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1735 microversion: 2.1 time: 0.208689 Apr 08 11:20:59.194887 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 318/629] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:20:58 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1735 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:20:59.195485 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-69cc157c-af7c-4604-9be6-a31de249aa10 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:59.204630 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-69cc157c-af7c-4604-9be6-a31de249aa10 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:59.206155 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-69cc157c-af7c-4604-9be6-a31de249aa10 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:20:59.207315 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-69cc157c-af7c-4604-9be6-a31de249aa10 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.212220 Apr 08 11:20:59.207862 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 312/630] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:20:58 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:21:00.208550 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2df62e7f-6543-484b-a709-c29311e59230 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:00.209210 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-2df62e7f-6543-484b-a709-c29311e59230 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:00.215502 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2df62e7f-6543-484b-a709-c29311e59230 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:00.215972 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2df62e7f-6543-484b-a709-c29311e59230 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:00.216744 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2df62e7f-6543-484b-a709-c29311e59230 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:00.217185 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2df62e7f-6543-484b-a709-c29311e59230 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:00.226183 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f0f91d86-03ff-4ba9-971e-ac2b5bd02313 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:00.226800 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f0f91d86-03ff-4ba9-971e-ac2b5bd02313 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:00.233522 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f0f91d86-03ff-4ba9-971e-ac2b5bd02313 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:00.233998 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f0f91d86-03ff-4ba9-971e-ac2b5bd02313 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:00.235368 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f0f91d86-03ff-4ba9-971e-ac2b5bd02313 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:00.235803 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f0f91d86-03ff-4ba9-971e-ac2b5bd02313 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:00.424625 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2df62e7f-6543-484b-a709-c29311e59230 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:00.432398 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-2df62e7f-6543-484b-a709-c29311e59230 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1735 microversion: 2.1 time: 0.227712 Apr 08 11:21:00.433258 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 319/631] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:00 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1735 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:00.435771 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f0f91d86-03ff-4ba9-971e-ac2b5bd02313 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:00.444101 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f0f91d86-03ff-4ba9-971e-ac2b5bd02313 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:00.445619 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f0f91d86-03ff-4ba9-971e-ac2b5bd02313 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:00.446794 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f0f91d86-03ff-4ba9-971e-ac2b5bd02313 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.224520 Apr 08 11:21:00.447354 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 313/632] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:00 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:21:01.448919 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-18d4e78d-832d-4715-a561-3a7a2a6d5a16 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:01.449618 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-18d4e78d-832d-4715-a561-3a7a2a6d5a16 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:01.455945 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-18d4e78d-832d-4715-a561-3a7a2a6d5a16 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:01.456357 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-18d4e78d-832d-4715-a561-3a7a2a6d5a16 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:01.457129 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-18d4e78d-832d-4715-a561-3a7a2a6d5a16 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:01.457568 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-18d4e78d-832d-4715-a561-3a7a2a6d5a16 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:01.464235 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-422c445d-0dc8-451a-bc8a-d5b14af59491 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:01.464860 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-422c445d-0dc8-451a-bc8a-d5b14af59491 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:01.471109 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-422c445d-0dc8-451a-bc8a-d5b14af59491 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:01.471558 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-422c445d-0dc8-451a-bc8a-d5b14af59491 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:01.472328 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-422c445d-0dc8-451a-bc8a-d5b14af59491 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:01.472756 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-422c445d-0dc8-451a-bc8a-d5b14af59491 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:01.662663 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-18d4e78d-832d-4715-a561-3a7a2a6d5a16 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:01.666130 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-422c445d-0dc8-451a-bc8a-d5b14af59491 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:01.670644 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-18d4e78d-832d-4715-a561-3a7a2a6d5a16 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1715 microversion: 2.1 time: 0.225442 Apr 08 11:21:01.671236 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 320/633] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:01 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1715 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:01.675377 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-422c445d-0dc8-451a-bc8a-d5b14af59491 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:01.676917 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-422c445d-0dc8-451a-bc8a-d5b14af59491 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:01.678238 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-422c445d-0dc8-451a-bc8a-d5b14af59491 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.217833 Apr 08 11:21:01.678936 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 314/634] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:01 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:21:01.731968 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-39bb2964-7b1d-4467-b3d1-1ea9939b44f1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:01.732472 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-39bb2964-7b1d-4467-b3d1-1ea9939b44f1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:01.738929 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-39bb2964-7b1d-4467-b3d1-1ea9939b44f1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:01.739384 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-39bb2964-7b1d-4467-b3d1-1ea9939b44f1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:01.740157 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-39bb2964-7b1d-4467-b3d1-1ea9939b44f1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:01.740599 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-39bb2964-7b1d-4467-b3d1-1ea9939b44f1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:01.861043 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.wsgi [None req-39bb2964-7b1d-4467-b3d1-1ea9939b44f1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] HTTP exception thrown: Cannot 'detach_volume' instance bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 while it is in vm_state rescued Apr 08 11:21:01.861652 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-39bb2964-7b1d-4467-b3d1-1ea9939b44f1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Returning 409 to user: Cannot 'detach_volume' instance bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 while it is in vm_state rescued {{(pid=117801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:21:01.862522 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-39bb2964-7b1d-4467-b3d1-1ea9939b44f1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "DELETE /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments/6945a5b2-ef63-469c-9b0d-2b0a67470855" status: 409 len: 152 microversion: 2.1 time: 0.134758 Apr 08 11:21:01.863074 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 321/635] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Apr 8 11:21:01 2022] DELETE /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments/6945a5b2-ef63-469c-9b0d-2b0a67470855 => generated 152 bytes in 136 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 08 11:21:01.871419 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-56037569-ea54-45aa-ba93-f81caa1ada4e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:21:01.871977 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-56037569-ea54-45aa-ba93-f81caa1ada4e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:01.878287 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-56037569-ea54-45aa-ba93-f81caa1ada4e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:01.878742 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-56037569-ea54-45aa-ba93-f81caa1ada4e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:01.879533 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-56037569-ea54-45aa-ba93-f81caa1ada4e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:01.879976 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-56037569-ea54-45aa-ba93-f81caa1ada4e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:02.098573 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-56037569-ea54-45aa-ba93-f81caa1ada4e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "POST /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/action" status: 202 len: 0 microversion: 2.1 time: 0.230763 Apr 08 11:21:02.099451 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 315/636] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Apr 8 11:21:01 2022] POST /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 08 11:21:02.107407 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-192e7885-dc64-45e5-9c43-f2a2551d032b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:02.108015 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-192e7885-dc64-45e5-9c43-f2a2551d032b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:02.114545 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-192e7885-dc64-45e5-9c43-f2a2551d032b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:02.115018 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-192e7885-dc64-45e5-9c43-f2a2551d032b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:02.115830 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-192e7885-dc64-45e5-9c43-f2a2551d032b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:02.116226 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-192e7885-dc64-45e5-9c43-f2a2551d032b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:02.278258 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-192e7885-dc64-45e5-9c43-f2a2551d032b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:02.286682 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-192e7885-dc64-45e5-9c43-f2a2551d032b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1723 microversion: 2.1 time: 0.183182 Apr 08 11:21:02.287246 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 322/637] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:02 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:02.697205 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e00ea210-e655-4aba-892f-744c4ce9f04b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:02.697934 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e00ea210-e655-4aba-892f-744c4ce9f04b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:02.705101 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e00ea210-e655-4aba-892f-744c4ce9f04b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:02.705559 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e00ea210-e655-4aba-892f-744c4ce9f04b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:02.706390 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e00ea210-e655-4aba-892f-744c4ce9f04b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:02.706862 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e00ea210-e655-4aba-892f-744c4ce9f04b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:02.842296 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e00ea210-e655-4aba-892f-744c4ce9f04b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:02.851174 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e00ea210-e655-4aba-892f-744c4ce9f04b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:02.853311 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e00ea210-e655-4aba-892f-744c4ce9f04b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:02.854511 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e00ea210-e655-4aba-892f-744c4ce9f04b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.162173 Apr 08 11:21:02.855075 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 316/638] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:02 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:03.303929 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-6d51dada-0a7e-4d06-b3f0-2c1cea3501be tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:03.304572 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-6d51dada-0a7e-4d06-b3f0-2c1cea3501be tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:03.310802 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6d51dada-0a7e-4d06-b3f0-2c1cea3501be tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:03.311248 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6d51dada-0a7e-4d06-b3f0-2c1cea3501be tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:03.312006 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6d51dada-0a7e-4d06-b3f0-2c1cea3501be tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:03.312436 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6d51dada-0a7e-4d06-b3f0-2c1cea3501be tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:03.446960 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6d51dada-0a7e-4d06-b3f0-2c1cea3501be tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:03.454705 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-6d51dada-0a7e-4d06-b3f0-2c1cea3501be tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1723 microversion: 2.1 time: 0.154606 Apr 08 11:21:03.455283 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 323/639] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:03 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:03.872373 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a1e35503-fae0-44e9-9ff7-dba9994bae71 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:03.872984 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a1e35503-fae0-44e9-9ff7-dba9994bae71 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:03.880026 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a1e35503-fae0-44e9-9ff7-dba9994bae71 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:03.880478 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a1e35503-fae0-44e9-9ff7-dba9994bae71 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:03.881244 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a1e35503-fae0-44e9-9ff7-dba9994bae71 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:03.881678 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a1e35503-fae0-44e9-9ff7-dba9994bae71 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:04.030604 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a1e35503-fae0-44e9-9ff7-dba9994bae71 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:04.039394 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a1e35503-fae0-44e9-9ff7-dba9994bae71 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:04.041414 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a1e35503-fae0-44e9-9ff7-dba9994bae71 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:04.042842 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a1e35503-fae0-44e9-9ff7-dba9994bae71 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.174341 Apr 08 11:21:04.043677 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 317/640] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:03 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:04.471983 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2e0b65b5-d787-4e34-8fc8-f0f7fd6cca30 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:04.472589 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-2e0b65b5-d787-4e34-8fc8-f0f7fd6cca30 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:04.478964 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2e0b65b5-d787-4e34-8fc8-f0f7fd6cca30 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:04.479416 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2e0b65b5-d787-4e34-8fc8-f0f7fd6cca30 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:04.480176 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2e0b65b5-d787-4e34-8fc8-f0f7fd6cca30 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:04.480610 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2e0b65b5-d787-4e34-8fc8-f0f7fd6cca30 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:04.614218 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2e0b65b5-d787-4e34-8fc8-f0f7fd6cca30 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:04.622083 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-2e0b65b5-d787-4e34-8fc8-f0f7fd6cca30 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1723 microversion: 2.1 time: 0.153880 Apr 08 11:21:04.622645 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 324/641] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:04 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:05.062888 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b6675d23-adae-4309-8b1b-979fdb7407fa tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:05.063498 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b6675d23-adae-4309-8b1b-979fdb7407fa tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:05.069728 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b6675d23-adae-4309-8b1b-979fdb7407fa tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:05.070206 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b6675d23-adae-4309-8b1b-979fdb7407fa tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:05.070968 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b6675d23-adae-4309-8b1b-979fdb7407fa tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:05.071403 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b6675d23-adae-4309-8b1b-979fdb7407fa tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:05.204919 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b6675d23-adae-4309-8b1b-979fdb7407fa tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:05.213087 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b6675d23-adae-4309-8b1b-979fdb7407fa tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:05.214619 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b6675d23-adae-4309-8b1b-979fdb7407fa tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:05.215763 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b6675d23-adae-4309-8b1b-979fdb7407fa tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.156751 Apr 08 11:21:05.216328 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 318/642] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:05 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:05.641320 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-05279ced-4032-4767-a896-f0f7fed449a0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:05.642021 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-05279ced-4032-4767-a896-f0f7fed449a0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:05.650666 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-05279ced-4032-4767-a896-f0f7fed449a0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:05.651122 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-05279ced-4032-4767-a896-f0f7fed449a0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:05.651907 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-05279ced-4032-4767-a896-f0f7fed449a0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:05.652347 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-05279ced-4032-4767-a896-f0f7fed449a0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:05.782956 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-05279ced-4032-4767-a896-f0f7fed449a0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:05.790642 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-05279ced-4032-4767-a896-f0f7fed449a0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1723 microversion: 2.1 time: 0.154508 Apr 08 11:21:05.791201 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 325/643] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:05 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:06.233511 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b428abfb-7079-4c79-bcdd-28163f681648 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:06.234969 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b428abfb-7079-4c79-bcdd-28163f681648 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:06.241371 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b428abfb-7079-4c79-bcdd-28163f681648 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:06.241851 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b428abfb-7079-4c79-bcdd-28163f681648 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:06.242634 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b428abfb-7079-4c79-bcdd-28163f681648 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:06.243071 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b428abfb-7079-4c79-bcdd-28163f681648 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:06.375522 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b428abfb-7079-4c79-bcdd-28163f681648 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:06.384041 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b428abfb-7079-4c79-bcdd-28163f681648 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:06.385541 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b428abfb-7079-4c79-bcdd-28163f681648 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:06.386727 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b428abfb-7079-4c79-bcdd-28163f681648 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.157238 Apr 08 11:21:06.387301 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 319/644] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:06 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:06.808112 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-de80b24c-c17b-49f3-bc57-3135f8ef079a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:06.808701 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-de80b24c-c17b-49f3-bc57-3135f8ef079a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:06.815014 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-de80b24c-c17b-49f3-bc57-3135f8ef079a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:06.815466 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-de80b24c-c17b-49f3-bc57-3135f8ef079a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:06.816228 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-de80b24c-c17b-49f3-bc57-3135f8ef079a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:06.816665 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-de80b24c-c17b-49f3-bc57-3135f8ef079a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:06.951027 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-de80b24c-c17b-49f3-bc57-3135f8ef079a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:06.959194 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-de80b24c-c17b-49f3-bc57-3135f8ef079a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1729 microversion: 2.1 time: 0.154940 Apr 08 11:21:06.959748 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 326/645] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:06 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:06.975204 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b861b8a4-adee-4a80-ac37-0c0b6393bb34 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:06.975698 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b861b8a4-adee-4a80-ac37-0c0b6393bb34 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:06.981678 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b861b8a4-adee-4a80-ac37-0c0b6393bb34 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:06.982164 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b861b8a4-adee-4a80-ac37-0c0b6393bb34 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:06.982933 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b861b8a4-adee-4a80-ac37-0c0b6393bb34 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:06.983378 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b861b8a4-adee-4a80-ac37-0c0b6393bb34 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:07.064524 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b861b8a4-adee-4a80-ac37-0c0b6393bb34 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093086 Apr 08 11:21:07.065129 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 320/646] 10.222.0.46 () {58 vars in 1274 bytes} [Fri Apr 8 11:21:06 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:21:07.404849 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-bdb6f3ce-5320-48df-92e4-5564ee403ed3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:07.405477 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-bdb6f3ce-5320-48df-92e4-5564ee403ed3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:07.413923 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bdb6f3ce-5320-48df-92e4-5564ee403ed3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:07.414389 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bdb6f3ce-5320-48df-92e4-5564ee403ed3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:07.415188 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bdb6f3ce-5320-48df-92e4-5564ee403ed3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:07.415632 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bdb6f3ce-5320-48df-92e4-5564ee403ed3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:07.557803 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-bdb6f3ce-5320-48df-92e4-5564ee403ed3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:07.566899 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-bdb6f3ce-5320-48df-92e4-5564ee403ed3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:07.572936 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-bdb6f3ce-5320-48df-92e4-5564ee403ed3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:07.572936 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-bdb6f3ce-5320-48df-92e4-5564ee403ed3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.168734 Apr 08 11:21:07.572936 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 327/647] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:07 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:08.331153 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-4fb3c4bf-3c7f-482e-9fae-a03cd1155b2e req-7c0affe0-c807-4119-b1ee-c6442eedbf5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb50c1bb-d2f9-47b0-bc8b-3b6759348c47", "tag": "c15e181d-7b77-4316-acf3-d678657a02e0"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:21:08.339570 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-4fb3c4bf-3c7f-482e-9fae-a03cd1155b2e req-7c0affe0-c807-4119-b1ee-c6442eedbf5e service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:08.340099 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-4fb3c4bf-3c7f-482e-9fae-a03cd1155b2e req-7c0affe0-c807-4119-b1ee-c6442eedbf5e service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:08.351244 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-4fb3c4bf-3c7f-482e-9fae-a03cd1155b2e req-7c0affe0-c807-4119-b1ee-c6442eedbf5e service nova] Creating event network-changed:c15e181d-7b77-4316-acf3-d678657a02e0 for instance bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 on hv-cinder-83607 Apr 08 11:21:08.356359 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-4fb3c4bf-3c7f-482e-9fae-a03cd1155b2e req-7c0affe0-c807-4119-b1ee-c6442eedbf5e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086127 Apr 08 11:21:08.357208 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 321/648] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:21:08.590607 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-dc764b72-5fd6-413b-919b-9a5a550dbd79 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:08.591214 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-dc764b72-5fd6-413b-919b-9a5a550dbd79 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:08.598318 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dc764b72-5fd6-413b-919b-9a5a550dbd79 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:08.598959 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dc764b72-5fd6-413b-919b-9a5a550dbd79 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:08.599733 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dc764b72-5fd6-413b-919b-9a5a550dbd79 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:08.600343 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dc764b72-5fd6-413b-919b-9a5a550dbd79 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:08.822348 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-dc764b72-5fd6-413b-919b-9a5a550dbd79 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:08.841347 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-dc764b72-5fd6-413b-919b-9a5a550dbd79 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:08.843595 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-dc764b72-5fd6-413b-919b-9a5a550dbd79 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:08.845040 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-dc764b72-5fd6-413b-919b-9a5a550dbd79 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.258411 Apr 08 11:21:08.849810 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 328/649] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:08 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:09.864517 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-061494ca-44f5-448c-9436-72042ab8c845 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:09.865209 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-061494ca-44f5-448c-9436-72042ab8c845 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:09.871596 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-061494ca-44f5-448c-9436-72042ab8c845 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:09.872046 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-061494ca-44f5-448c-9436-72042ab8c845 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:09.872820 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-061494ca-44f5-448c-9436-72042ab8c845 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:09.873534 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-061494ca-44f5-448c-9436-72042ab8c845 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:10.005112 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-061494ca-44f5-448c-9436-72042ab8c845 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:10.013371 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-061494ca-44f5-448c-9436-72042ab8c845 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:10.014908 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-061494ca-44f5-448c-9436-72042ab8c845 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:10.016048 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-061494ca-44f5-448c-9436-72042ab8c845 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.155726 Apr 08 11:21:10.016613 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 322/650] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:09 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:10.371387 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [req-2efe9b36-728d-46c9-a3d9-8b2b0ea27763 req-ae4fa580-76ec-455f-9059-f7f8cd60c5f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb50c1bb-d2f9-47b0-bc8b-3b6759348c47", "tag": "c15e181d-7b77-4316-acf3-d678657a02e0"}]} {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:21:10.380079 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-2efe9b36-728d-46c9-a3d9-8b2b0ea27763 req-ae4fa580-76ec-455f-9059-f7f8cd60c5f8 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:10.380524 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-2efe9b36-728d-46c9-a3d9-8b2b0ea27763 req-ae4fa580-76ec-455f-9059-f7f8cd60c5f8 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:10.391661 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.compute.server_external_events [req-2efe9b36-728d-46c9-a3d9-8b2b0ea27763 req-ae4fa580-76ec-455f-9059-f7f8cd60c5f8 service nova] Creating event network-changed:c15e181d-7b77-4316-acf3-d678657a02e0 for instance bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 on hv-cinder-83607 Apr 08 11:21:10.396710 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [req-2efe9b36-728d-46c9-a3d9-8b2b0ea27763 req-ae4fa580-76ec-455f-9059-f7f8cd60c5f8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029010 Apr 08 11:21:10.397563 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 329/651] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:21:11.033957 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4a8dc34e-16a3-4fec-8e0d-7e82a0f05b0e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:11.034574 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4a8dc34e-16a3-4fec-8e0d-7e82a0f05b0e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:11.040865 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4a8dc34e-16a3-4fec-8e0d-7e82a0f05b0e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:11.041319 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4a8dc34e-16a3-4fec-8e0d-7e82a0f05b0e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:11.042117 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4a8dc34e-16a3-4fec-8e0d-7e82a0f05b0e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:11.042562 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4a8dc34e-16a3-4fec-8e0d-7e82a0f05b0e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:11.176885 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4a8dc34e-16a3-4fec-8e0d-7e82a0f05b0e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:11.185088 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4a8dc34e-16a3-4fec-8e0d-7e82a0f05b0e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:11.186815 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4a8dc34e-16a3-4fec-8e0d-7e82a0f05b0e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:11.187976 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4a8dc34e-16a3-4fec-8e0d-7e82a0f05b0e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.157911 Apr 08 11:21:11.188539 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 323/652] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:11 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:12.207026 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-4b93b866-6790-4639-855e-969220a7996d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:12.207650 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-4b93b866-6790-4639-855e-969220a7996d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:12.214151 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4b93b866-6790-4639-855e-969220a7996d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:12.214604 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4b93b866-6790-4639-855e-969220a7996d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:12.215470 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4b93b866-6790-4639-855e-969220a7996d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:12.215892 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4b93b866-6790-4639-855e-969220a7996d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:12.354785 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-4b93b866-6790-4639-855e-969220a7996d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:12.362406 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-4b93b866-6790-4639-855e-969220a7996d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:12.363916 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-4b93b866-6790-4639-855e-969220a7996d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:12.365064 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-4b93b866-6790-4639-855e-969220a7996d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.163298 Apr 08 11:21:12.365620 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 330/653] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:12 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:13.383598 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a5d2b949-2c27-4fa1-af23-3c01660fe4bf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:13.384854 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a5d2b949-2c27-4fa1-af23-3c01660fe4bf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:13.391302 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a5d2b949-2c27-4fa1-af23-3c01660fe4bf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:13.391786 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a5d2b949-2c27-4fa1-af23-3c01660fe4bf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:13.392586 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a5d2b949-2c27-4fa1-af23-3c01660fe4bf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:13.393028 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a5d2b949-2c27-4fa1-af23-3c01660fe4bf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:13.529955 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a5d2b949-2c27-4fa1-af23-3c01660fe4bf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:13.538333 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a5d2b949-2c27-4fa1-af23-3c01660fe4bf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:13.539839 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a5d2b949-2c27-4fa1-af23-3c01660fe4bf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:13.540997 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a5d2b949-2c27-4fa1-af23-3c01660fe4bf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.161342 Apr 08 11:21:13.541560 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 324/654] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:13 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:14.559223 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-f1a521f6-2cea-4e8c-a716-01c1e6936888 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:14.559865 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-f1a521f6-2cea-4e8c-a716-01c1e6936888 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:14.566818 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f1a521f6-2cea-4e8c-a716-01c1e6936888 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:14.567274 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f1a521f6-2cea-4e8c-a716-01c1e6936888 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:14.568041 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f1a521f6-2cea-4e8c-a716-01c1e6936888 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:14.568478 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f1a521f6-2cea-4e8c-a716-01c1e6936888 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:14.699575 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f1a521f6-2cea-4e8c-a716-01c1e6936888 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:14.707787 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f1a521f6-2cea-4e8c-a716-01c1e6936888 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:14.709283 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f1a521f6-2cea-4e8c-a716-01c1e6936888 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:14.710492 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-f1a521f6-2cea-4e8c-a716-01c1e6936888 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.155205 Apr 08 11:21:14.711051 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 331/655] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:14 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:15.728566 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f4743765-a7e3-4346-b6c7-5652a6c530ce tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:15.729199 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f4743765-a7e3-4346-b6c7-5652a6c530ce tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:15.736254 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f4743765-a7e3-4346-b6c7-5652a6c530ce tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:15.736713 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f4743765-a7e3-4346-b6c7-5652a6c530ce tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:15.737480 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f4743765-a7e3-4346-b6c7-5652a6c530ce tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:15.737957 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f4743765-a7e3-4346-b6c7-5652a6c530ce tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:15.869582 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f4743765-a7e3-4346-b6c7-5652a6c530ce tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:15.878004 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f4743765-a7e3-4346-b6c7-5652a6c530ce tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:15.879489 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f4743765-a7e3-4346-b6c7-5652a6c530ce tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:15.880618 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f4743765-a7e3-4346-b6c7-5652a6c530ce tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.156068 Apr 08 11:21:15.881176 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 325/656] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:15 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:16.899078 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-48b037ca-0f2f-40ed-82db-9836d61a50cd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:16.899628 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-48b037ca-0f2f-40ed-82db-9836d61a50cd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:16.906558 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-48b037ca-0f2f-40ed-82db-9836d61a50cd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:16.907012 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-48b037ca-0f2f-40ed-82db-9836d61a50cd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:16.907781 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-48b037ca-0f2f-40ed-82db-9836d61a50cd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:16.908222 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-48b037ca-0f2f-40ed-82db-9836d61a50cd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:17.040120 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-48b037ca-0f2f-40ed-82db-9836d61a50cd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:17.048293 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-48b037ca-0f2f-40ed-82db-9836d61a50cd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:17.050060 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-48b037ca-0f2f-40ed-82db-9836d61a50cd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:17.051541 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-48b037ca-0f2f-40ed-82db-9836d61a50cd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.156435 Apr 08 11:21:17.052091 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 332/657] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:16 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:18.070562 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4d5eec81-fa37-41a8-8a9c-cbd0381e58c9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:18.071248 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4d5eec81-fa37-41a8-8a9c-cbd0381e58c9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:18.077456 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4d5eec81-fa37-41a8-8a9c-cbd0381e58c9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:18.077935 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4d5eec81-fa37-41a8-8a9c-cbd0381e58c9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:18.079281 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4d5eec81-fa37-41a8-8a9c-cbd0381e58c9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:18.079718 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4d5eec81-fa37-41a8-8a9c-cbd0381e58c9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:18.210169 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4d5eec81-fa37-41a8-8a9c-cbd0381e58c9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:18.218560 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4d5eec81-fa37-41a8-8a9c-cbd0381e58c9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:18.220063 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4d5eec81-fa37-41a8-8a9c-cbd0381e58c9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:18.221214 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4d5eec81-fa37-41a8-8a9c-cbd0381e58c9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.154533 Apr 08 11:21:18.221786 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 326/658] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:18 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:19.239280 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-b5adc08b-2f95-4358-8275-d9a58ed48e9b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:19.239887 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-b5adc08b-2f95-4358-8275-d9a58ed48e9b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:19.246457 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b5adc08b-2f95-4358-8275-d9a58ed48e9b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:19.246906 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b5adc08b-2f95-4358-8275-d9a58ed48e9b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:19.247679 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b5adc08b-2f95-4358-8275-d9a58ed48e9b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:19.248385 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b5adc08b-2f95-4358-8275-d9a58ed48e9b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:19.629728 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b5adc08b-2f95-4358-8275-d9a58ed48e9b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:19.638023 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b5adc08b-2f95-4358-8275-d9a58ed48e9b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:19.639514 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b5adc08b-2f95-4358-8275-d9a58ed48e9b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:19.640721 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-b5adc08b-2f95-4358-8275-d9a58ed48e9b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.405303 Apr 08 11:21:19.641285 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 333/659] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:19 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:20.487670 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 11:21:20.488336 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: Fri Apr 8 11:21:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 11:21:20.659584 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-71faa256-586a-408a-812f-f66f4c3fad76 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:20.660203 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-71faa256-586a-408a-812f-f66f4c3fad76 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:20.666482 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-71faa256-586a-408a-812f-f66f4c3fad76 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:20.666933 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-71faa256-586a-408a-812f-f66f4c3fad76 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:20.667707 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-71faa256-586a-408a-812f-f66f4c3fad76 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:20.668140 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-71faa256-586a-408a-812f-f66f4c3fad76 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:20.799344 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-71faa256-586a-408a-812f-f66f4c3fad76 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:20.807739 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-71faa256-586a-408a-812f-f66f4c3fad76 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:20.809252 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-71faa256-586a-408a-812f-f66f4c3fad76 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:20.811408 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-71faa256-586a-408a-812f-f66f4c3fad76 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.156538 Apr 08 11:21:20.811970 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 327/660] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:20 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:21.830389 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-10d4ce8d-1230-4bab-b8c7-7e863f27d0a6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:21.831032 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-10d4ce8d-1230-4bab-b8c7-7e863f27d0a6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:21.836886 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-10d4ce8d-1230-4bab-b8c7-7e863f27d0a6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:21.837332 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-10d4ce8d-1230-4bab-b8c7-7e863f27d0a6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:21.838126 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-10d4ce8d-1230-4bab-b8c7-7e863f27d0a6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:21.838562 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-10d4ce8d-1230-4bab-b8c7-7e863f27d0a6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:21.976323 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-10d4ce8d-1230-4bab-b8c7-7e863f27d0a6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:21.984515 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-10d4ce8d-1230-4bab-b8c7-7e863f27d0a6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:21.986032 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-10d4ce8d-1230-4bab-b8c7-7e863f27d0a6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:21.987230 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-10d4ce8d-1230-4bab-b8c7-7e863f27d0a6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.160882 Apr 08 11:21:21.987753 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 334/661] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:21 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:23.007087 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9c40d1e4-f546-4306-806e-0a1480b53524 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:23.007699 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9c40d1e4-f546-4306-806e-0a1480b53524 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:23.014069 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9c40d1e4-f546-4306-806e-0a1480b53524 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:23.014524 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9c40d1e4-f546-4306-806e-0a1480b53524 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:23.015297 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9c40d1e4-f546-4306-806e-0a1480b53524 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:23.015730 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9c40d1e4-f546-4306-806e-0a1480b53524 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:23.147085 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9c40d1e4-f546-4306-806e-0a1480b53524 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:23.155922 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9c40d1e4-f546-4306-806e-0a1480b53524 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:23.157760 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9c40d1e4-f546-4306-806e-0a1480b53524 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:23.161631 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9c40d1e4-f546-4306-806e-0a1480b53524 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.156229 Apr 08 11:21:23.161631 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 328/662] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:23 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:24.178129 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-d9637767-4028-404c-9527-531f91c9cb71 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:24.178756 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-d9637767-4028-404c-9527-531f91c9cb71 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:24.184956 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d9637767-4028-404c-9527-531f91c9cb71 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:24.185406 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d9637767-4028-404c-9527-531f91c9cb71 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:24.186212 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d9637767-4028-404c-9527-531f91c9cb71 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:24.186646 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d9637767-4028-404c-9527-531f91c9cb71 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:24.335601 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d9637767-4028-404c-9527-531f91c9cb71 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:24.343936 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d9637767-4028-404c-9527-531f91c9cb71 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:24.345441 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d9637767-4028-404c-9527-531f91c9cb71 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:24.346625 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-d9637767-4028-404c-9527-531f91c9cb71 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.173034 Apr 08 11:21:24.347180 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 335/663] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:24 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:25.364502 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7ac34089-ba6e-4254-a543-ee7279bf32c6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:25.365602 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7ac34089-ba6e-4254-a543-ee7279bf32c6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:25.372252 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7ac34089-ba6e-4254-a543-ee7279bf32c6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:25.374178 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7ac34089-ba6e-4254-a543-ee7279bf32c6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:25.374178 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7ac34089-ba6e-4254-a543-ee7279bf32c6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:25.374373 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7ac34089-ba6e-4254-a543-ee7279bf32c6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:25.507714 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7ac34089-ba6e-4254-a543-ee7279bf32c6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:25.515832 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7ac34089-ba6e-4254-a543-ee7279bf32c6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:25.517320 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7ac34089-ba6e-4254-a543-ee7279bf32c6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:25.518481 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7ac34089-ba6e-4254-a543-ee7279bf32c6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.157918 Apr 08 11:21:25.519037 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 329/664] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:25 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:26.454930 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-fbc50e87-39c4-44db-95c9-54a2d6ebb455 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:26.455453 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-fbc50e87-39c4-44db-95c9-54a2d6ebb455 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:26.462511 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fbc50e87-39c4-44db-95c9-54a2d6ebb455 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:26.462965 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fbc50e87-39c4-44db-95c9-54a2d6ebb455 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:26.463735 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fbc50e87-39c4-44db-95c9-54a2d6ebb455 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:26.464176 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fbc50e87-39c4-44db-95c9-54a2d6ebb455 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:26.487367 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-fbc50e87-39c4-44db-95c9-54a2d6ebb455 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Going to try to terminate instance {{(pid=117801) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 08 11:21:26.536467 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-df96d6cf-3629-4cbb-b21e-c05aa0a6f6ad tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:26.537110 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-df96d6cf-3629-4cbb-b21e-c05aa0a6f6ad tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:26.543059 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-df96d6cf-3629-4cbb-b21e-c05aa0a6f6ad tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:26.543508 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-df96d6cf-3629-4cbb-b21e-c05aa0a6f6ad tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:26.544273 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-df96d6cf-3629-4cbb-b21e-c05aa0a6f6ad tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:26.544714 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-df96d6cf-3629-4cbb-b21e-c05aa0a6f6ad tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:26.676875 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-df96d6cf-3629-4cbb-b21e-c05aa0a6f6ad tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:26.688297 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-df96d6cf-3629-4cbb-b21e-c05aa0a6f6ad tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:26.688297 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-df96d6cf-3629-4cbb-b21e-c05aa0a6f6ad tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:26.688645 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-df96d6cf-3629-4cbb-b21e-c05aa0a6f6ad tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.156061 Apr 08 11:21:26.689207 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 330/665] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:26 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:21:26.778561 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-fbc50e87-39c4-44db-95c9-54a2d6ebb455 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "DELETE /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 204 len: 0 microversion: 2.1 time: 0.327125 Apr 08 11:21:26.779246 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 336/666] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 8 11:21:26 2022] DELETE /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 11:21:26.787372 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-116a8129-92a8-4225-996a-2a1baad7c9ce tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:26.788177 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-116a8129-92a8-4225-996a-2a1baad7c9ce tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:26.795025 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-116a8129-92a8-4225-996a-2a1baad7c9ce tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:26.795478 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-116a8129-92a8-4225-996a-2a1baad7c9ce tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:26.796255 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-116a8129-92a8-4225-996a-2a1baad7c9ce tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:26.796685 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-116a8129-92a8-4225-996a-2a1baad7c9ce tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:26.944803 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-116a8129-92a8-4225-996a-2a1baad7c9ce tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:26.952609 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-116a8129-92a8-4225-996a-2a1baad7c9ce tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1578 microversion: 2.1 time: 0.169126 Apr 08 11:21:26.953382 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 331/667] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:26 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1578 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:27.707496 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-4898e499-3223-49a0-a450-5b1c358361bb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:27.708194 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-4898e499-3223-49a0-a450-5b1c358361bb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:27.715048 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4898e499-3223-49a0-a450-5b1c358361bb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:27.715495 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4898e499-3223-49a0-a450-5b1c358361bb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:27.716289 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4898e499-3223-49a0-a450-5b1c358361bb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:27.716730 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4898e499-3223-49a0-a450-5b1c358361bb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:27.857108 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-4898e499-3223-49a0-a450-5b1c358361bb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:27.865242 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-4898e499-3223-49a0-a450-5b1c358361bb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:27.866803 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-4898e499-3223-49a0-a450-5b1c358361bb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:27.867951 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-4898e499-3223-49a0-a450-5b1c358361bb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.164771 Apr 08 11:21:27.868505 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 337/668] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:27 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:27.970026 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0f7041bc-31c0-4042-93ae-ab31df462f01 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:27.970578 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0f7041bc-31c0-4042-93ae-ab31df462f01 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:27.977020 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0f7041bc-31c0-4042-93ae-ab31df462f01 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:27.977478 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0f7041bc-31c0-4042-93ae-ab31df462f01 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:27.978283 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0f7041bc-31c0-4042-93ae-ab31df462f01 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:27.978759 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0f7041bc-31c0-4042-93ae-ab31df462f01 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:28.123134 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0f7041bc-31c0-4042-93ae-ab31df462f01 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:28.130757 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0f7041bc-31c0-4042-93ae-ab31df462f01 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1578 microversion: 2.1 time: 0.164836 Apr 08 11:21:28.131322 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 332/669] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:27 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:28.890060 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-407e239b-1f28-4d34-9d43-1466ec8e1d1f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:28.891212 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-407e239b-1f28-4d34-9d43-1466ec8e1d1f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:28.903294 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-407e239b-1f28-4d34-9d43-1466ec8e1d1f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:28.904123 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-407e239b-1f28-4d34-9d43-1466ec8e1d1f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:28.905509 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-407e239b-1f28-4d34-9d43-1466ec8e1d1f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:28.906351 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-407e239b-1f28-4d34-9d43-1466ec8e1d1f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:29.157271 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3df25808-cfb1-4346-a379-b906810dd392 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:29.158486 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3df25808-cfb1-4346-a379-b906810dd392 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:29.164560 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-407e239b-1f28-4d34-9d43-1466ec8e1d1f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:29.171807 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3df25808-cfb1-4346-a379-b906810dd392 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:29.172502 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3df25808-cfb1-4346-a379-b906810dd392 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:29.174246 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3df25808-cfb1-4346-a379-b906810dd392 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:29.175708 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3df25808-cfb1-4346-a379-b906810dd392 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:29.181692 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-407e239b-1f28-4d34-9d43-1466ec8e1d1f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:29.183752 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-407e239b-1f28-4d34-9d43-1466ec8e1d1f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:29.185238 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-407e239b-1f28-4d34-9d43-1466ec8e1d1f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.302777 Apr 08 11:21:29.186482 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 338/670] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:28 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:29.510790 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3df25808-cfb1-4346-a379-b906810dd392 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:29.525529 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3df25808-cfb1-4346-a379-b906810dd392 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1578 microversion: 2.1 time: 0.378529 Apr 08 11:21:29.534972 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 333/671] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:29 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1578 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:21:30.216421 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-ebabf7dd-4629-40dc-9e3a-59ee4b66ca3a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:30.217263 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-ebabf7dd-4629-40dc-9e3a-59ee4b66ca3a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:30.225794 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ebabf7dd-4629-40dc-9e3a-59ee4b66ca3a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:30.226590 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ebabf7dd-4629-40dc-9e3a-59ee4b66ca3a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:30.227865 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ebabf7dd-4629-40dc-9e3a-59ee4b66ca3a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:30.228630 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ebabf7dd-4629-40dc-9e3a-59ee4b66ca3a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:30.421707 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-ebabf7dd-4629-40dc-9e3a-59ee4b66ca3a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:30.439737 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-ebabf7dd-4629-40dc-9e3a-59ee4b66ca3a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:30.443397 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-ebabf7dd-4629-40dc-9e3a-59ee4b66ca3a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:30.447155 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-ebabf7dd-4629-40dc-9e3a-59ee4b66ca3a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.233404 Apr 08 11:21:30.449078 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 339/672] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:30 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:30.487051 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-bede1b58-36c3-41c3-84a4-38f68ab015d7 req-540e9102-117b-4b01-8254-a41edd7eef18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcbe20ff-6f97-41c3-bde7-c03ad1d3634c", "name": "network-vif-deleted", "tag": "a0f6a311-6139-4dbc-9303-164cfc456792"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:21:30.498711 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-bede1b58-36c3-41c3-84a4-38f68ab015d7 req-540e9102-117b-4b01-8254-a41edd7eef18 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:30.499451 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-bede1b58-36c3-41c3-84a4-38f68ab015d7 req-540e9102-117b-4b01-8254-a41edd7eef18 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:30.512008 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-bede1b58-36c3-41c3-84a4-38f68ab015d7 req-540e9102-117b-4b01-8254-a41edd7eef18 service nova] Creating event network-vif-deleted:a0f6a311-6139-4dbc-9303-164cfc456792 for instance fcbe20ff-6f97-41c3-bde7-c03ad1d3634c on hv-cinder-83607 Apr 08 11:21:30.517867 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-bede1b58-36c3-41c3-84a4-38f68ab015d7 req-540e9102-117b-4b01-8254-a41edd7eef18 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035332 Apr 08 11:21:30.518493 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 334/673] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:21:30.554017 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e7873b45-ff08-42a8-8173-c77c06c3492d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:30.554781 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e7873b45-ff08-42a8-8173-c77c06c3492d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:30.568183 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e7873b45-ff08-42a8-8173-c77c06c3492d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:30.569384 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e7873b45-ff08-42a8-8173-c77c06c3492d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:30.570508 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e7873b45-ff08-42a8-8173-c77c06c3492d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:30.571545 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e7873b45-ff08-42a8-8173-c77c06c3492d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:30.683847 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e7873b45-ff08-42a8-8173-c77c06c3492d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:30.694517 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e7873b45-ff08-42a8-8173-c77c06c3492d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1510 microversion: 2.1 time: 0.146631 Apr 08 11:21:30.700842 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 340/674] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:30 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:31.468034 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-54faed16-4704-4ccf-a90f-5251598bf292 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:31.468839 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-54faed16-4704-4ccf-a90f-5251598bf292 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:31.476000 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-54faed16-4704-4ccf-a90f-5251598bf292 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:31.476548 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-54faed16-4704-4ccf-a90f-5251598bf292 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:31.477442 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-54faed16-4704-4ccf-a90f-5251598bf292 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:31.477980 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-54faed16-4704-4ccf-a90f-5251598bf292 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:31.652836 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-54faed16-4704-4ccf-a90f-5251598bf292 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:31.659715 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-54faed16-4704-4ccf-a90f-5251598bf292 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:31.661169 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-54faed16-4704-4ccf-a90f-5251598bf292 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:31.662420 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-54faed16-4704-4ccf-a90f-5251598bf292 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.198763 Apr 08 11:21:31.663002 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 335/675] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:31 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:31.714090 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-fefb3c54-1239-44f3-9fff-eb7b38beb904 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:31.714695 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-fefb3c54-1239-44f3-9fff-eb7b38beb904 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:31.721309 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fefb3c54-1239-44f3-9fff-eb7b38beb904 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:31.721785 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fefb3c54-1239-44f3-9fff-eb7b38beb904 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:31.722576 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fefb3c54-1239-44f3-9fff-eb7b38beb904 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:31.723045 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fefb3c54-1239-44f3-9fff-eb7b38beb904 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:31.817051 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-fefb3c54-1239-44f3-9fff-eb7b38beb904 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:31.817051 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-fefb3c54-1239-44f3-9fff-eb7b38beb904 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.096952 Apr 08 11:21:31.817051 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 341/676] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:31 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:32.683176 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-826df4fd-4b59-4e1b-a402-80222d804108 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:32.683909 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-826df4fd-4b59-4e1b-a402-80222d804108 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:32.690811 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-826df4fd-4b59-4e1b-a402-80222d804108 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:32.696483 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-826df4fd-4b59-4e1b-a402-80222d804108 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:32.696483 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-826df4fd-4b59-4e1b-a402-80222d804108 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:32.696483 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-826df4fd-4b59-4e1b-a402-80222d804108 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:32.823190 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-c1adece8-196c-4536-b803-28e62435065a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:32.825381 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-c1adece8-196c-4536-b803-28e62435065a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:32.830447 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-826df4fd-4b59-4e1b-a402-80222d804108 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:32.831152 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c1adece8-196c-4536-b803-28e62435065a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:32.831603 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c1adece8-196c-4536-b803-28e62435065a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:32.832471 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c1adece8-196c-4536-b803-28e62435065a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:32.832834 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c1adece8-196c-4536-b803-28e62435065a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:32.839159 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-826df4fd-4b59-4e1b-a402-80222d804108 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:32.840671 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-826df4fd-4b59-4e1b-a402-80222d804108 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:32.841994 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-826df4fd-4b59-4e1b-a402-80222d804108 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.163259 Apr 08 11:21:32.842563 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 336/677] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:32 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:32.896232 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-c1adece8-196c-4536-b803-28e62435065a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:32.903381 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-c1adece8-196c-4536-b803-28e62435065a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.084161 Apr 08 11:21:32.903935 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 342/678] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:32 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:21:33.860688 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-fa103351-0774-4d5e-9726-01e33069c0b1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:33.861321 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-fa103351-0774-4d5e-9726-01e33069c0b1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:33.868154 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fa103351-0774-4d5e-9726-01e33069c0b1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:33.868609 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fa103351-0774-4d5e-9726-01e33069c0b1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:33.869387 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fa103351-0774-4d5e-9726-01e33069c0b1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:33.869852 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fa103351-0774-4d5e-9726-01e33069c0b1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:33.920028 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-dc953a88-c5e4-46ac-80a0-fdb506bf60b0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:33.920605 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-dc953a88-c5e4-46ac-80a0-fdb506bf60b0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:33.927046 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dc953a88-c5e4-46ac-80a0-fdb506bf60b0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:33.927522 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dc953a88-c5e4-46ac-80a0-fdb506bf60b0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:33.928307 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dc953a88-c5e4-46ac-80a0-fdb506bf60b0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:33.928756 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dc953a88-c5e4-46ac-80a0-fdb506bf60b0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:33.998911 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-dc953a88-c5e4-46ac-80a0-fdb506bf60b0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:34.006608 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-dc953a88-c5e4-46ac-80a0-fdb506bf60b0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.090598 Apr 08 11:21:34.007200 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 343/679] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:33 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:21:34.030551 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-fa103351-0774-4d5e-9726-01e33069c0b1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:34.038815 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-fa103351-0774-4d5e-9726-01e33069c0b1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:34.040346 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-fa103351-0774-4d5e-9726-01e33069c0b1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:34.041483 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-fa103351-0774-4d5e-9726-01e33069c0b1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.184793 Apr 08 11:21:34.042085 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 337/680] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:33 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:35.024970 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-fdb2f54a-3b53-46e3-aee0-ea396847a553 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:35.025942 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-fdb2f54a-3b53-46e3-aee0-ea396847a553 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:35.032892 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fdb2f54a-3b53-46e3-aee0-ea396847a553 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:35.033353 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fdb2f54a-3b53-46e3-aee0-ea396847a553 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:35.034199 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fdb2f54a-3b53-46e3-aee0-ea396847a553 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:35.034651 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fdb2f54a-3b53-46e3-aee0-ea396847a553 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:35.059754 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3a4a7d67-2bef-44b7-8216-d27182dcd53e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:35.060595 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3a4a7d67-2bef-44b7-8216-d27182dcd53e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:35.067855 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3a4a7d67-2bef-44b7-8216-d27182dcd53e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:35.068310 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3a4a7d67-2bef-44b7-8216-d27182dcd53e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:35.069142 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3a4a7d67-2bef-44b7-8216-d27182dcd53e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:35.069587 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3a4a7d67-2bef-44b7-8216-d27182dcd53e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:35.105131 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-fdb2f54a-3b53-46e3-aee0-ea396847a553 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:35.113181 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-fdb2f54a-3b53-46e3-aee0-ea396847a553 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.092770 Apr 08 11:21:35.114041 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 344/681] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:35 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:35.212042 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3a4a7d67-2bef-44b7-8216-d27182dcd53e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:35.220667 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3a4a7d67-2bef-44b7-8216-d27182dcd53e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:35.222198 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3a4a7d67-2bef-44b7-8216-d27182dcd53e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:35.223397 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3a4a7d67-2bef-44b7-8216-d27182dcd53e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.167702 Apr 08 11:21:35.223969 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 338/682] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:35 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:21:36.129818 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-0689ea82-3649-4969-9af9-01a5f476037f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:36.130422 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-0689ea82-3649-4969-9af9-01a5f476037f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:36.137382 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0689ea82-3649-4969-9af9-01a5f476037f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:36.137861 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0689ea82-3649-4969-9af9-01a5f476037f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:36.138639 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0689ea82-3649-4969-9af9-01a5f476037f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:36.139079 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0689ea82-3649-4969-9af9-01a5f476037f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:36.200322 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-0689ea82-3649-4969-9af9-01a5f476037f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:36.207836 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-0689ea82-3649-4969-9af9-01a5f476037f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081858 Apr 08 11:21:36.208410 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 345/683] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:36 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:36.241152 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ccefdcba-6519-401c-97a7-5f2e1b719678 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:36.241780 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ccefdcba-6519-401c-97a7-5f2e1b719678 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:36.248537 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ccefdcba-6519-401c-97a7-5f2e1b719678 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:36.249002 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ccefdcba-6519-401c-97a7-5f2e1b719678 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:36.249815 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ccefdcba-6519-401c-97a7-5f2e1b719678 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:36.250269 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ccefdcba-6519-401c-97a7-5f2e1b719678 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:36.386256 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ccefdcba-6519-401c-97a7-5f2e1b719678 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:36.394648 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ccefdcba-6519-401c-97a7-5f2e1b719678 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:36.396160 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ccefdcba-6519-401c-97a7-5f2e1b719678 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:36.397354 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ccefdcba-6519-401c-97a7-5f2e1b719678 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.160084 Apr 08 11:21:36.397999 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 339/684] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:36 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:37.225108 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-6673ec16-4841-4d59-b4c8-e994ebea3178 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:37.225703 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-6673ec16-4841-4d59-b4c8-e994ebea3178 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:37.232210 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6673ec16-4841-4d59-b4c8-e994ebea3178 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:37.232658 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6673ec16-4841-4d59-b4c8-e994ebea3178 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:37.233425 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6673ec16-4841-4d59-b4c8-e994ebea3178 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:37.233887 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6673ec16-4841-4d59-b4c8-e994ebea3178 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:37.293648 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6673ec16-4841-4d59-b4c8-e994ebea3178 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:37.300997 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-6673ec16-4841-4d59-b4c8-e994ebea3178 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079813 Apr 08 11:21:37.301558 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 346/685] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:37 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:37.416303 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-dc43da5d-8f5a-489c-b877-ecff79e781cb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:37.416918 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-dc43da5d-8f5a-489c-b877-ecff79e781cb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:37.423233 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dc43da5d-8f5a-489c-b877-ecff79e781cb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:37.423685 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dc43da5d-8f5a-489c-b877-ecff79e781cb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:37.424447 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dc43da5d-8f5a-489c-b877-ecff79e781cb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:37.424881 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dc43da5d-8f5a-489c-b877-ecff79e781cb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:37.559881 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-dc43da5d-8f5a-489c-b877-ecff79e781cb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:37.568204 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-dc43da5d-8f5a-489c-b877-ecff79e781cb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:37.569711 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-dc43da5d-8f5a-489c-b877-ecff79e781cb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:37.571470 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-dc43da5d-8f5a-489c-b877-ecff79e781cb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.159025 Apr 08 11:21:37.572024 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 340/686] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:37 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:38.317740 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-3a0e7a25-8d79-45fc-bec1-729a66f1bd2f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:38.318407 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-3a0e7a25-8d79-45fc-bec1-729a66f1bd2f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:38.324692 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3a0e7a25-8d79-45fc-bec1-729a66f1bd2f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:38.325143 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3a0e7a25-8d79-45fc-bec1-729a66f1bd2f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:38.325950 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3a0e7a25-8d79-45fc-bec1-729a66f1bd2f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:38.326391 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3a0e7a25-8d79-45fc-bec1-729a66f1bd2f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:38.386784 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-3a0e7a25-8d79-45fc-bec1-729a66f1bd2f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:38.396267 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-3a0e7a25-8d79-45fc-bec1-729a66f1bd2f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082362 Apr 08 11:21:38.396845 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 347/687] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:38 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:38.589392 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ee4390c0-f440-4198-ad78-e13e69bc9846 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:38.590037 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ee4390c0-f440-4198-ad78-e13e69bc9846 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:38.596468 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ee4390c0-f440-4198-ad78-e13e69bc9846 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:38.596923 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ee4390c0-f440-4198-ad78-e13e69bc9846 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:38.597713 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ee4390c0-f440-4198-ad78-e13e69bc9846 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:38.598180 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ee4390c0-f440-4198-ad78-e13e69bc9846 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:38.755396 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ee4390c0-f440-4198-ad78-e13e69bc9846 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:38.764406 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ee4390c0-f440-4198-ad78-e13e69bc9846 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:38.765941 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ee4390c0-f440-4198-ad78-e13e69bc9846 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:38.767094 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ee4390c0-f440-4198-ad78-e13e69bc9846 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.182334 Apr 08 11:21:38.767657 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 341/688] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:38 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:39.415212 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-ac0b5025-d63a-447f-9793-b7f678766cc4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:39.415967 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-ac0b5025-d63a-447f-9793-b7f678766cc4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:39.432448 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ac0b5025-d63a-447f-9793-b7f678766cc4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:39.432926 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ac0b5025-d63a-447f-9793-b7f678766cc4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:39.433709 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ac0b5025-d63a-447f-9793-b7f678766cc4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:39.434255 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ac0b5025-d63a-447f-9793-b7f678766cc4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:39.495087 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-ac0b5025-d63a-447f-9793-b7f678766cc4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:39.502874 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-ac0b5025-d63a-447f-9793-b7f678766cc4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.092304 Apr 08 11:21:39.503469 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 348/689] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:39 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:39.785591 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8032b28a-1899-4fb4-9ef8-bcb16b0cc1c0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:39.786326 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8032b28a-1899-4fb4-9ef8-bcb16b0cc1c0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:39.793439 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8032b28a-1899-4fb4-9ef8-bcb16b0cc1c0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:39.794013 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8032b28a-1899-4fb4-9ef8-bcb16b0cc1c0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:39.794812 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8032b28a-1899-4fb4-9ef8-bcb16b0cc1c0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:39.795254 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8032b28a-1899-4fb4-9ef8-bcb16b0cc1c0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:39.939003 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8032b28a-1899-4fb4-9ef8-bcb16b0cc1c0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:39.947287 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8032b28a-1899-4fb4-9ef8-bcb16b0cc1c0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:39.948889 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8032b28a-1899-4fb4-9ef8-bcb16b0cc1c0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:39.950070 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8032b28a-1899-4fb4-9ef8-bcb16b0cc1c0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.168406 Apr 08 11:21:39.950618 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 342/690] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:39 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:40.520037 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-aa0df5f6-404d-4156-a11b-c180e8554f99 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:40.520648 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-aa0df5f6-404d-4156-a11b-c180e8554f99 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:40.527043 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-aa0df5f6-404d-4156-a11b-c180e8554f99 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:40.527498 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-aa0df5f6-404d-4156-a11b-c180e8554f99 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:40.528276 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-aa0df5f6-404d-4156-a11b-c180e8554f99 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:40.528719 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-aa0df5f6-404d-4156-a11b-c180e8554f99 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:40.591289 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-aa0df5f6-404d-4156-a11b-c180e8554f99 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:40.598734 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-aa0df5f6-404d-4156-a11b-c180e8554f99 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082616 Apr 08 11:21:40.599298 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 349/691] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:40 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:40.968291 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5aedbbc0-642d-4654-aa7b-e5464f34236f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:40.968920 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5aedbbc0-642d-4654-aa7b-e5464f34236f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:40.976538 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5aedbbc0-642d-4654-aa7b-e5464f34236f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:40.976995 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5aedbbc0-642d-4654-aa7b-e5464f34236f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:40.977798 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5aedbbc0-642d-4654-aa7b-e5464f34236f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:40.978230 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5aedbbc0-642d-4654-aa7b-e5464f34236f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:41.108458 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5aedbbc0-642d-4654-aa7b-e5464f34236f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:41.118246 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5aedbbc0-642d-4654-aa7b-e5464f34236f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:41.120006 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5aedbbc0-642d-4654-aa7b-e5464f34236f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:41.120943 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5aedbbc0-642d-4654-aa7b-e5464f34236f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.156763 Apr 08 11:21:41.121510 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 343/692] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:40 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:41.716836 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e1010789-51af-4420-9e22-5593d019e366 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:41.717483 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e1010789-51af-4420-9e22-5593d019e366 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:41.723681 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e1010789-51af-4420-9e22-5593d019e366 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:41.724132 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e1010789-51af-4420-9e22-5593d019e366 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:41.724913 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e1010789-51af-4420-9e22-5593d019e366 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:41.725351 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e1010789-51af-4420-9e22-5593d019e366 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:41.796118 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e1010789-51af-4420-9e22-5593d019e366 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:41.803516 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e1010789-51af-4420-9e22-5593d019e366 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.192580 Apr 08 11:21:41.804268 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 350/693] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:41 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:42.139523 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5a6df1be-b6bf-447c-bd9a-4a1a39b8d1fd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:42.140116 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5a6df1be-b6bf-447c-bd9a-4a1a39b8d1fd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:42.146480 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5a6df1be-b6bf-447c-bd9a-4a1a39b8d1fd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:42.146979 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5a6df1be-b6bf-447c-bd9a-4a1a39b8d1fd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:42.147743 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5a6df1be-b6bf-447c-bd9a-4a1a39b8d1fd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:42.148679 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5a6df1be-b6bf-447c-bd9a-4a1a39b8d1fd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:42.286540 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5a6df1be-b6bf-447c-bd9a-4a1a39b8d1fd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:42.295498 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5a6df1be-b6bf-447c-bd9a-4a1a39b8d1fd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:42.297016 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5a6df1be-b6bf-447c-bd9a-4a1a39b8d1fd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:42.298205 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5a6df1be-b6bf-447c-bd9a-4a1a39b8d1fd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.162589 Apr 08 11:21:42.298822 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 344/694] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:42 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:42.821598 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e67d0f93-23d5-4eb3-9146-b81d95596a34 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:42.822233 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e67d0f93-23d5-4eb3-9146-b81d95596a34 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:42.828955 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e67d0f93-23d5-4eb3-9146-b81d95596a34 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:42.829455 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e67d0f93-23d5-4eb3-9146-b81d95596a34 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:42.830286 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e67d0f93-23d5-4eb3-9146-b81d95596a34 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:42.830730 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e67d0f93-23d5-4eb3-9146-b81d95596a34 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:42.898419 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e67d0f93-23d5-4eb3-9146-b81d95596a34 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:42.905868 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e67d0f93-23d5-4eb3-9146-b81d95596a34 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.088863 Apr 08 11:21:42.906437 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 351/695] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:42 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:43.316251 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3bbfa5b5-9369-4b79-a7d5-76651c2cd4df tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:43.316855 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3bbfa5b5-9369-4b79-a7d5-76651c2cd4df tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:43.323166 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3bbfa5b5-9369-4b79-a7d5-76651c2cd4df tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:43.323603 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3bbfa5b5-9369-4b79-a7d5-76651c2cd4df tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:43.324364 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3bbfa5b5-9369-4b79-a7d5-76651c2cd4df tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:43.324796 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3bbfa5b5-9369-4b79-a7d5-76651c2cd4df tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:43.461020 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3bbfa5b5-9369-4b79-a7d5-76651c2cd4df tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:43.469934 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3bbfa5b5-9369-4b79-a7d5-76651c2cd4df tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:43.471479 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3bbfa5b5-9369-4b79-a7d5-76651c2cd4df tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:43.472692 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3bbfa5b5-9369-4b79-a7d5-76651c2cd4df tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.160331 Apr 08 11:21:43.473273 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 345/696] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:43 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:43.844145 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2602fa4d-8470-41ca-8b9d-62ac08040914 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:21:43.844720 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-2602fa4d-8470-41ca-8b9d-62ac08040914 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:43.851037 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2602fa4d-8470-41ca-8b9d-62ac08040914 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:43.851478 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2602fa4d-8470-41ca-8b9d-62ac08040914 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:43.852266 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2602fa4d-8470-41ca-8b9d-62ac08040914 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:43.852697 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2602fa4d-8470-41ca-8b9d-62ac08040914 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:43.876270 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.objects.instance [None req-2602fa4d-8470-41ca-8b9d-62ac08040914 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lazy-loading 'flavor' on Instance uuid 6031de3c-c187-4e54-b340-ad53edbe9ee6 {{(pid=117801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 11:21:43.922731 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e1d7ca60-8f28-40be-8788-9cc09e37822c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:43.923398 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e1d7ca60-8f28-40be-8788-9cc09e37822c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:43.929472 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e1d7ca60-8f28-40be-8788-9cc09e37822c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:43.929963 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e1d7ca60-8f28-40be-8788-9cc09e37822c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:43.930739 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e1d7ca60-8f28-40be-8788-9cc09e37822c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:43.931178 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e1d7ca60-8f28-40be-8788-9cc09e37822c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:43.995468 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e1d7ca60-8f28-40be-8788-9cc09e37822c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:44.003388 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e1d7ca60-8f28-40be-8788-9cc09e37822c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.084594 Apr 08 11:21:44.003970 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 346/697] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:43 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:44.154062 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-2602fa4d-8470-41ca-8b9d-62ac08040914 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "POST /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6/action" status: 202 len: 0 microversion: 2.1 time: 0.313513 Apr 08 11:21:44.154662 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 352/698] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Apr 8 11:21:43 2022] POST /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 11:21:44.163187 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f1a9f077-7651-412f-9f21-c5324e471762 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:44.163961 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f1a9f077-7651-412f-9f21-c5324e471762 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:44.170135 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f1a9f077-7651-412f-9f21-c5324e471762 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:44.170589 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f1a9f077-7651-412f-9f21-c5324e471762 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:44.171381 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f1a9f077-7651-412f-9f21-c5324e471762 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:44.171822 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f1a9f077-7651-412f-9f21-c5324e471762 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:44.313990 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f1a9f077-7651-412f-9f21-c5324e471762 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:44.328712 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f1a9f077-7651-412f-9f21-c5324e471762 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.169433 Apr 08 11:21:44.329408 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 347/699] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:44 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:44.493013 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-1bac9208-0ddc-44ce-9919-1e569644398d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:44.493735 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-1bac9208-0ddc-44ce-9919-1e569644398d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:44.500599 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1bac9208-0ddc-44ce-9919-1e569644398d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:44.501046 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1bac9208-0ddc-44ce-9919-1e569644398d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:44.501864 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1bac9208-0ddc-44ce-9919-1e569644398d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:44.502311 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1bac9208-0ddc-44ce-9919-1e569644398d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:44.642063 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1bac9208-0ddc-44ce-9919-1e569644398d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:44.650912 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1bac9208-0ddc-44ce-9919-1e569644398d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:44.652402 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1bac9208-0ddc-44ce-9919-1e569644398d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:44.653557 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-1bac9208-0ddc-44ce-9919-1e569644398d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.165469 Apr 08 11:21:44.654146 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 353/700] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:44 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:45.020382 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a66570f3-ddd6-4174-b695-5fc56a4f7347 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:45.020988 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a66570f3-ddd6-4174-b695-5fc56a4f7347 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:45.027478 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a66570f3-ddd6-4174-b695-5fc56a4f7347 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:45.027918 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a66570f3-ddd6-4174-b695-5fc56a4f7347 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:45.028671 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a66570f3-ddd6-4174-b695-5fc56a4f7347 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:45.029107 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a66570f3-ddd6-4174-b695-5fc56a4f7347 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:45.091308 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a66570f3-ddd6-4174-b695-5fc56a4f7347 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:45.098755 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a66570f3-ddd6-4174-b695-5fc56a4f7347 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082171 Apr 08 11:21:45.099313 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 348/701] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:45 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:45.346386 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-55a6620d-ede8-47c8-8d9a-8dc886d3d94c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:45.346977 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-55a6620d-ede8-47c8-8d9a-8dc886d3d94c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:45.353316 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-55a6620d-ede8-47c8-8d9a-8dc886d3d94c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:45.353780 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-55a6620d-ede8-47c8-8d9a-8dc886d3d94c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:45.354572 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-55a6620d-ede8-47c8-8d9a-8dc886d3d94c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:45.355007 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-55a6620d-ede8-47c8-8d9a-8dc886d3d94c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:45.490621 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-55a6620d-ede8-47c8-8d9a-8dc886d3d94c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:45.500352 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-55a6620d-ede8-47c8-8d9a-8dc886d3d94c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.158107 Apr 08 11:21:45.500936 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 354/702] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:45 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:45.672857 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3a35fefd-c227-420f-ba11-813fc8d39992 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:45.673470 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3a35fefd-c227-420f-ba11-813fc8d39992 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:45.680098 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3a35fefd-c227-420f-ba11-813fc8d39992 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:45.680556 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3a35fefd-c227-420f-ba11-813fc8d39992 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:45.681334 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3a35fefd-c227-420f-ba11-813fc8d39992 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:45.681799 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3a35fefd-c227-420f-ba11-813fc8d39992 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:45.826463 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3a35fefd-c227-420f-ba11-813fc8d39992 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:45.838902 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3a35fefd-c227-420f-ba11-813fc8d39992 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:45.840496 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3a35fefd-c227-420f-ba11-813fc8d39992 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:45.841949 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3a35fefd-c227-420f-ba11-813fc8d39992 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.173447 Apr 08 11:21:45.842522 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 349/703] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:45 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:46.116951 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a29f927e-bb34-4896-9b67-72fe7e35b3c1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:46.117561 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a29f927e-bb34-4896-9b67-72fe7e35b3c1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:46.123937 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a29f927e-bb34-4896-9b67-72fe7e35b3c1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:46.124399 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a29f927e-bb34-4896-9b67-72fe7e35b3c1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:46.125176 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a29f927e-bb34-4896-9b67-72fe7e35b3c1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:46.125619 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a29f927e-bb34-4896-9b67-72fe7e35b3c1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:46.188236 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a29f927e-bb34-4896-9b67-72fe7e35b3c1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:46.195644 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a29f927e-bb34-4896-9b67-72fe7e35b3c1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.083164 Apr 08 11:21:46.196214 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 355/704] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:46 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:46.518057 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c1299a6e-4b82-4827-af18-8bc9109256be tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:46.518670 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c1299a6e-4b82-4827-af18-8bc9109256be tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:46.525102 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c1299a6e-4b82-4827-af18-8bc9109256be tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:46.525550 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c1299a6e-4b82-4827-af18-8bc9109256be tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:46.526423 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c1299a6e-4b82-4827-af18-8bc9109256be tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:46.526864 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c1299a6e-4b82-4827-af18-8bc9109256be tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:46.661741 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c1299a6e-4b82-4827-af18-8bc9109256be tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:46.669831 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c1299a6e-4b82-4827-af18-8bc9109256be tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.155622 Apr 08 11:21:46.670399 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 350/705] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:46 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:46.863051 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-1b5a9f82-67b9-43cb-8538-0f5a9a9484af tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:46.863598 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-1b5a9f82-67b9-43cb-8538-0f5a9a9484af tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:46.869808 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1b5a9f82-67b9-43cb-8538-0f5a9a9484af tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:46.870260 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1b5a9f82-67b9-43cb-8538-0f5a9a9484af tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:46.871027 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1b5a9f82-67b9-43cb-8538-0f5a9a9484af tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:46.871481 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1b5a9f82-67b9-43cb-8538-0f5a9a9484af tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:47.003527 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1b5a9f82-67b9-43cb-8538-0f5a9a9484af tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:47.012761 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1b5a9f82-67b9-43cb-8538-0f5a9a9484af tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:47.014308 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1b5a9f82-67b9-43cb-8538-0f5a9a9484af tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:47.015542 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-1b5a9f82-67b9-43cb-8538-0f5a9a9484af tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.156368 Apr 08 11:21:47.016044 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 356/706] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:46 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:47.212992 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0c04f56c-b4c2-4d2b-9794-9729afe02af5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:47.213529 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0c04f56c-b4c2-4d2b-9794-9729afe02af5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:47.219814 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0c04f56c-b4c2-4d2b-9794-9729afe02af5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:47.220268 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0c04f56c-b4c2-4d2b-9794-9729afe02af5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:47.221048 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0c04f56c-b4c2-4d2b-9794-9729afe02af5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:47.221487 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0c04f56c-b4c2-4d2b-9794-9729afe02af5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:47.285619 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0c04f56c-b4c2-4d2b-9794-9729afe02af5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:47.293335 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0c04f56c-b4c2-4d2b-9794-9729afe02af5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.084396 Apr 08 11:21:47.293952 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 351/707] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:47 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:47.686417 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a7a35fa2-ee8c-43ec-a137-be8d75f525c6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:47.687049 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a7a35fa2-ee8c-43ec-a137-be8d75f525c6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:47.693508 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a7a35fa2-ee8c-43ec-a137-be8d75f525c6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:47.693999 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a7a35fa2-ee8c-43ec-a137-be8d75f525c6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:47.694776 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a7a35fa2-ee8c-43ec-a137-be8d75f525c6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:47.695216 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a7a35fa2-ee8c-43ec-a137-be8d75f525c6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:47.830421 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a7a35fa2-ee8c-43ec-a137-be8d75f525c6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:47.838793 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a7a35fa2-ee8c-43ec-a137-be8d75f525c6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.156185 Apr 08 11:21:47.839380 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 357/708] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:47 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:21:48.035858 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9e745e02-3fba-4815-abaf-add8aef298e4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:48.036480 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9e745e02-3fba-4815-abaf-add8aef298e4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:48.043207 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9e745e02-3fba-4815-abaf-add8aef298e4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:48.046280 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9e745e02-3fba-4815-abaf-add8aef298e4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:48.046280 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9e745e02-3fba-4815-abaf-add8aef298e4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:48.046280 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9e745e02-3fba-4815-abaf-add8aef298e4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:48.196344 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9e745e02-3fba-4815-abaf-add8aef298e4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:48.205183 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9e745e02-3fba-4815-abaf-add8aef298e4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:48.206703 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9e745e02-3fba-4815-abaf-add8aef298e4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:48.207875 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9e745e02-3fba-4815-abaf-add8aef298e4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.176459 Apr 08 11:21:48.208431 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 352/709] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:48 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:48.309971 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a186dbdd-f6c7-495f-92c6-eab7592733a2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:48.310536 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a186dbdd-f6c7-495f-92c6-eab7592733a2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:48.316893 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a186dbdd-f6c7-495f-92c6-eab7592733a2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:48.317349 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a186dbdd-f6c7-495f-92c6-eab7592733a2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:48.318169 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a186dbdd-f6c7-495f-92c6-eab7592733a2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:48.318611 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a186dbdd-f6c7-495f-92c6-eab7592733a2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:48.383291 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a186dbdd-f6c7-495f-92c6-eab7592733a2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:48.390823 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a186dbdd-f6c7-495f-92c6-eab7592733a2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.084802 Apr 08 11:21:48.391442 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 358/710] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:48 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:48.862656 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-13adf9bd-d963-4311-9c89-13b47b58197b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:48.863263 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-13adf9bd-d963-4311-9c89-13b47b58197b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:48.870126 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-13adf9bd-d963-4311-9c89-13b47b58197b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:48.870580 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-13adf9bd-d963-4311-9c89-13b47b58197b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:48.871358 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-13adf9bd-d963-4311-9c89-13b47b58197b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:48.872058 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-13adf9bd-d963-4311-9c89-13b47b58197b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:49.007559 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-13adf9bd-d963-4311-9c89-13b47b58197b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:49.014966 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-13adf9bd-d963-4311-9c89-13b47b58197b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.156175 Apr 08 11:21:49.015538 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 353/711] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:48 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:49.227542 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-8c5734f7-e4b9-413d-abe4-03acb16bdc9f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:49.228068 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-8c5734f7-e4b9-413d-abe4-03acb16bdc9f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:49.234347 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8c5734f7-e4b9-413d-abe4-03acb16bdc9f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:49.234795 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8c5734f7-e4b9-413d-abe4-03acb16bdc9f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:49.235566 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8c5734f7-e4b9-413d-abe4-03acb16bdc9f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:49.235996 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8c5734f7-e4b9-413d-abe4-03acb16bdc9f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:49.373813 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-8c5734f7-e4b9-413d-abe4-03acb16bdc9f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:49.382237 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-8c5734f7-e4b9-413d-abe4-03acb16bdc9f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:49.383738 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-8c5734f7-e4b9-413d-abe4-03acb16bdc9f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:49.384953 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-8c5734f7-e4b9-413d-abe4-03acb16bdc9f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.161948 Apr 08 11:21:49.385450 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 359/712] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:49 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:21:49.408147 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-03d9aa25-ce91-47b6-a100-f443b8cf3373 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:49.408788 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-03d9aa25-ce91-47b6-a100-f443b8cf3373 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:49.415024 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-03d9aa25-ce91-47b6-a100-f443b8cf3373 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:49.415477 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-03d9aa25-ce91-47b6-a100-f443b8cf3373 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:49.416249 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-03d9aa25-ce91-47b6-a100-f443b8cf3373 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:49.416684 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-03d9aa25-ce91-47b6-a100-f443b8cf3373 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:49.479291 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-03d9aa25-ce91-47b6-a100-f443b8cf3373 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:49.486685 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-03d9aa25-ce91-47b6-a100-f443b8cf3373 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082538 Apr 08 11:21:49.487263 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 354/713] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:49 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:50.032476 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-308e7294-2cd4-49bf-af6f-c3e57d2d683d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:50.033042 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-308e7294-2cd4-49bf-af6f-c3e57d2d683d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:50.039027 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-308e7294-2cd4-49bf-af6f-c3e57d2d683d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:50.039498 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-308e7294-2cd4-49bf-af6f-c3e57d2d683d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:50.040996 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-308e7294-2cd4-49bf-af6f-c3e57d2d683d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:50.040996 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-308e7294-2cd4-49bf-af6f-c3e57d2d683d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:50.330104 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-308e7294-2cd4-49bf-af6f-c3e57d2d683d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:50.337388 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-308e7294-2cd4-49bf-af6f-c3e57d2d683d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.308877 Apr 08 11:21:50.338022 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 360/714] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:50 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:50.403173 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7e8e6403-6368-43dc-be39-09d41c8b1807 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:50.403788 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7e8e6403-6368-43dc-be39-09d41c8b1807 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:50.410102 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7e8e6403-6368-43dc-be39-09d41c8b1807 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:50.410562 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7e8e6403-6368-43dc-be39-09d41c8b1807 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:50.411336 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7e8e6403-6368-43dc-be39-09d41c8b1807 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:50.411777 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7e8e6403-6368-43dc-be39-09d41c8b1807 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:50.503988 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-6ceeff0e-2f5e-4b1e-a2fa-cf41089aa2a6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:50.504610 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-6ceeff0e-2f5e-4b1e-a2fa-cf41089aa2a6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:50.511464 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6ceeff0e-2f5e-4b1e-a2fa-cf41089aa2a6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:50.511909 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6ceeff0e-2f5e-4b1e-a2fa-cf41089aa2a6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:50.512716 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6ceeff0e-2f5e-4b1e-a2fa-cf41089aa2a6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:50.513138 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6ceeff0e-2f5e-4b1e-a2fa-cf41089aa2a6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:50.574641 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7e8e6403-6368-43dc-be39-09d41c8b1807 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:50.584007 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7e8e6403-6368-43dc-be39-09d41c8b1807 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:50.586882 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7e8e6403-6368-43dc-be39-09d41c8b1807 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:50.589346 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7e8e6403-6368-43dc-be39-09d41c8b1807 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.189642 Apr 08 11:21:50.589935 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 355/715] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:50 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:50.597649 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6ceeff0e-2f5e-4b1e-a2fa-cf41089aa2a6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:50.607814 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-6ceeff0e-2f5e-4b1e-a2fa-cf41089aa2a6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.107602 Apr 08 11:21:50.608390 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 361/716] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:50 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:51.359242 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-365eaf67-d445-4cca-addd-f6af13e37047 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:51.359868 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-365eaf67-d445-4cca-addd-f6af13e37047 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:51.366178 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-365eaf67-d445-4cca-addd-f6af13e37047 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:51.366687 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-365eaf67-d445-4cca-addd-f6af13e37047 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:51.367468 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-365eaf67-d445-4cca-addd-f6af13e37047 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:51.367904 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-365eaf67-d445-4cca-addd-f6af13e37047 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:51.515593 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-365eaf67-d445-4cca-addd-f6af13e37047 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:51.524437 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-365eaf67-d445-4cca-addd-f6af13e37047 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.173606 Apr 08 11:21:51.525001 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 356/717] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:51 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:51.607400 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-486be46d-a4d2-4725-8079-75a53ac426e1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:51.608011 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-486be46d-a4d2-4725-8079-75a53ac426e1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:51.614365 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-486be46d-a4d2-4725-8079-75a53ac426e1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:51.614763 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-486be46d-a4d2-4725-8079-75a53ac426e1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:51.615536 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-486be46d-a4d2-4725-8079-75a53ac426e1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:51.616043 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-486be46d-a4d2-4725-8079-75a53ac426e1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:51.624381 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7ac46aba-3585-46f9-b1fa-eb65d4cfb521 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:51.624980 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7ac46aba-3585-46f9-b1fa-eb65d4cfb521 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:51.630752 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7ac46aba-3585-46f9-b1fa-eb65d4cfb521 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:51.631196 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7ac46aba-3585-46f9-b1fa-eb65d4cfb521 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:51.632510 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7ac46aba-3585-46f9-b1fa-eb65d4cfb521 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:51.632941 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7ac46aba-3585-46f9-b1fa-eb65d4cfb521 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:51.710621 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7ac46aba-3585-46f9-b1fa-eb65d4cfb521 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:51.718071 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7ac46aba-3585-46f9-b1fa-eb65d4cfb521 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.097648 Apr 08 11:21:51.718647 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 357/718] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:51 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:21:51.780087 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-486be46d-a4d2-4725-8079-75a53ac426e1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:51.789028 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-486be46d-a4d2-4725-8079-75a53ac426e1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:51.790553 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-486be46d-a4d2-4725-8079-75a53ac426e1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:51.791710 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-486be46d-a4d2-4725-8079-75a53ac426e1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.188248 Apr 08 11:21:51.792441 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 362/719] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:51 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:52.540347 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d85e9782-ae03-4798-b8c7-82cd144f2cfc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:52.540956 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d85e9782-ae03-4798-b8c7-82cd144f2cfc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:52.547366 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d85e9782-ae03-4798-b8c7-82cd144f2cfc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:52.547817 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d85e9782-ae03-4798-b8c7-82cd144f2cfc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:52.548582 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d85e9782-ae03-4798-b8c7-82cd144f2cfc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:52.549020 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d85e9782-ae03-4798-b8c7-82cd144f2cfc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:52.681294 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d85e9782-ae03-4798-b8c7-82cd144f2cfc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:52.688660 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d85e9782-ae03-4798-b8c7-82cd144f2cfc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.152156 Apr 08 11:21:52.689222 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 358/720] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:52 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:52.735222 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-d5278549-2b73-48b8-8039-04ff5e049968 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:52.735827 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-d5278549-2b73-48b8-8039-04ff5e049968 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:52.742615 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d5278549-2b73-48b8-8039-04ff5e049968 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:52.743066 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d5278549-2b73-48b8-8039-04ff5e049968 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:52.743836 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d5278549-2b73-48b8-8039-04ff5e049968 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:52.744271 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d5278549-2b73-48b8-8039-04ff5e049968 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:52.802693 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d5278549-2b73-48b8-8039-04ff5e049968 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:52.810230 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-74349f5f-1de9-402c-b6b0-73c19d645a28 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:52.810880 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-74349f5f-1de9-402c-b6b0-73c19d645a28 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:52.811014 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-d5278549-2b73-48b8-8039-04ff5e049968 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079524 Apr 08 11:21:52.811501 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 363/721] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:52 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:52.816619 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-74349f5f-1de9-402c-b6b0-73c19d645a28 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:52.817067 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-74349f5f-1de9-402c-b6b0-73c19d645a28 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:52.817889 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-74349f5f-1de9-402c-b6b0-73c19d645a28 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:52.818319 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-74349f5f-1de9-402c-b6b0-73c19d645a28 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:52.951871 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-74349f5f-1de9-402c-b6b0-73c19d645a28 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:52.959982 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-74349f5f-1de9-402c-b6b0-73c19d645a28 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:52.961468 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-74349f5f-1de9-402c-b6b0-73c19d645a28 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:52.962638 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-74349f5f-1de9-402c-b6b0-73c19d645a28 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.156349 Apr 08 11:21:52.963197 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 359/722] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:52 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:21:53.706802 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-1ee311c2-d58f-45fa-a1b6-e39ad43fee71 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:53.707515 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-1ee311c2-d58f-45fa-a1b6-e39ad43fee71 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:53.714184 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1ee311c2-d58f-45fa-a1b6-e39ad43fee71 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:53.714645 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1ee311c2-d58f-45fa-a1b6-e39ad43fee71 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:53.715473 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1ee311c2-d58f-45fa-a1b6-e39ad43fee71 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:53.715944 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1ee311c2-d58f-45fa-a1b6-e39ad43fee71 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:53.828490 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-62b16859-3522-431f-a39a-c9fc63510481 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:53.829117 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-62b16859-3522-431f-a39a-c9fc63510481 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:53.835967 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-62b16859-3522-431f-a39a-c9fc63510481 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:53.836417 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-62b16859-3522-431f-a39a-c9fc63510481 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:53.837198 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-62b16859-3522-431f-a39a-c9fc63510481 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:53.837637 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-62b16859-3522-431f-a39a-c9fc63510481 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:53.860198 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1ee311c2-d58f-45fa-a1b6-e39ad43fee71 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:53.867821 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-1ee311c2-d58f-45fa-a1b6-e39ad43fee71 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.164932 Apr 08 11:21:53.868399 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 364/723] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:53 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:53.906925 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-62b16859-3522-431f-a39a-c9fc63510481 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:53.914720 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-62b16859-3522-431f-a39a-c9fc63510481 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.090164 Apr 08 11:21:53.915304 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 360/724] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:53 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:53.980404 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-5366b8c7-9570-44b4-bfe8-6299a89b3bb0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:53.981006 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-5366b8c7-9570-44b4-bfe8-6299a89b3bb0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:53.986959 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5366b8c7-9570-44b4-bfe8-6299a89b3bb0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:53.987402 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5366b8c7-9570-44b4-bfe8-6299a89b3bb0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:53.988156 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5366b8c7-9570-44b4-bfe8-6299a89b3bb0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:53.988585 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5366b8c7-9570-44b4-bfe8-6299a89b3bb0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:54.123515 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-5366b8c7-9570-44b4-bfe8-6299a89b3bb0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:54.132633 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-5366b8c7-9570-44b4-bfe8-6299a89b3bb0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:54.139444 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-5366b8c7-9570-44b4-bfe8-6299a89b3bb0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:54.139444 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-5366b8c7-9570-44b4-bfe8-6299a89b3bb0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.158771 Apr 08 11:21:54.139444 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 365/725] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:53 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:54.885524 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-03fd6ee4-e55b-403c-bdc7-92c480b7554e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:54.886164 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-03fd6ee4-e55b-403c-bdc7-92c480b7554e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:54.893065 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-03fd6ee4-e55b-403c-bdc7-92c480b7554e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:54.893514 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-03fd6ee4-e55b-403c-bdc7-92c480b7554e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:54.894327 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-03fd6ee4-e55b-403c-bdc7-92c480b7554e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:54.894768 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-03fd6ee4-e55b-403c-bdc7-92c480b7554e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:54.932262 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e54367b7-ea2b-4306-9eed-9e4ccdff9e23 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:54.932923 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e54367b7-ea2b-4306-9eed-9e4ccdff9e23 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:54.939812 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e54367b7-ea2b-4306-9eed-9e4ccdff9e23 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:54.940364 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e54367b7-ea2b-4306-9eed-9e4ccdff9e23 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:54.941267 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e54367b7-ea2b-4306-9eed-9e4ccdff9e23 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:54.941791 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e54367b7-ea2b-4306-9eed-9e4ccdff9e23 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:55.021970 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e54367b7-ea2b-4306-9eed-9e4ccdff9e23 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:55.030065 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e54367b7-ea2b-4306-9eed-9e4ccdff9e23 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.102174 Apr 08 11:21:55.030855 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 366/726] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:54 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:21:55.072657 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-03fd6ee4-e55b-403c-bdc7-92c480b7554e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:55.079677 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-03fd6ee4-e55b-403c-bdc7-92c480b7554e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.198497 Apr 08 11:21:55.080271 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 361/727] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:54 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:55.156718 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2fa458e1-b87f-43a3-8ac8-5c6b5cab44c2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:55.157246 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-2fa458e1-b87f-43a3-8ac8-5c6b5cab44c2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:55.163776 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2fa458e1-b87f-43a3-8ac8-5c6b5cab44c2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:55.164227 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2fa458e1-b87f-43a3-8ac8-5c6b5cab44c2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:55.165005 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2fa458e1-b87f-43a3-8ac8-5c6b5cab44c2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:55.165455 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2fa458e1-b87f-43a3-8ac8-5c6b5cab44c2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:55.315470 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2fa458e1-b87f-43a3-8ac8-5c6b5cab44c2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:55.324251 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2fa458e1-b87f-43a3-8ac8-5c6b5cab44c2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:55.325757 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2fa458e1-b87f-43a3-8ac8-5c6b5cab44c2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:55.326978 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-2fa458e1-b87f-43a3-8ac8-5c6b5cab44c2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.174294 Apr 08 11:21:55.327546 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 367/728] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:55 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:56.046972 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-28a12068-3b68-46bb-affb-7737af472d4d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:56.047624 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-28a12068-3b68-46bb-affb-7737af472d4d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:56.054366 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-28a12068-3b68-46bb-affb-7737af472d4d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:56.054819 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-28a12068-3b68-46bb-affb-7737af472d4d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:56.055611 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-28a12068-3b68-46bb-affb-7737af472d4d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:56.056053 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-28a12068-3b68-46bb-affb-7737af472d4d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:56.096630 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-11150ccd-0d2b-4ead-b910-aa91f102037d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:56.097483 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-11150ccd-0d2b-4ead-b910-aa91f102037d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:56.104215 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-11150ccd-0d2b-4ead-b910-aa91f102037d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:56.104666 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-11150ccd-0d2b-4ead-b910-aa91f102037d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:56.105469 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-11150ccd-0d2b-4ead-b910-aa91f102037d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:56.105959 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-11150ccd-0d2b-4ead-b910-aa91f102037d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:56.134048 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-28a12068-3b68-46bb-affb-7737af472d4d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:56.142925 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-28a12068-3b68-46bb-affb-7737af472d4d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.099781 Apr 08 11:21:56.143534 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 362/729] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:56 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:56.260638 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-11150ccd-0d2b-4ead-b910-aa91f102037d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:56.268611 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-11150ccd-0d2b-4ead-b910-aa91f102037d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.175843 Apr 08 11:21:56.269245 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 368/730] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:56 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:21:56.345243 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a04d0e7c-65d3-4c8d-ba99-74d219b49fd1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:56.345793 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a04d0e7c-65d3-4c8d-ba99-74d219b49fd1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:56.351919 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a04d0e7c-65d3-4c8d-ba99-74d219b49fd1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:56.352373 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a04d0e7c-65d3-4c8d-ba99-74d219b49fd1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:56.353162 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a04d0e7c-65d3-4c8d-ba99-74d219b49fd1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:56.353613 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a04d0e7c-65d3-4c8d-ba99-74d219b49fd1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:56.491139 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a04d0e7c-65d3-4c8d-ba99-74d219b49fd1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:56.500231 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a04d0e7c-65d3-4c8d-ba99-74d219b49fd1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:56.501746 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a04d0e7c-65d3-4c8d-ba99-74d219b49fd1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:56.502943 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a04d0e7c-65d3-4c8d-ba99-74d219b49fd1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.162236 Apr 08 11:21:56.504315 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 363/731] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:56 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:21:57.160545 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-6a95bff2-2af4-4812-affc-f025a175b7d8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:57.161196 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-6a95bff2-2af4-4812-affc-f025a175b7d8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:57.168296 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6a95bff2-2af4-4812-affc-f025a175b7d8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:57.168755 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6a95bff2-2af4-4812-affc-f025a175b7d8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:57.169551 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6a95bff2-2af4-4812-affc-f025a175b7d8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:57.170040 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6a95bff2-2af4-4812-affc-f025a175b7d8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:57.231007 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6a95bff2-2af4-4812-affc-f025a175b7d8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:57.238863 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-6a95bff2-2af4-4812-affc-f025a175b7d8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082272 Apr 08 11:21:57.239453 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 369/732] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:57 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:57.285852 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-96d5fa8e-94a6-49a4-b4a8-935482829b60 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:57.286466 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-96d5fa8e-94a6-49a4-b4a8-935482829b60 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:57.293015 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-96d5fa8e-94a6-49a4-b4a8-935482829b60 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:57.293471 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-96d5fa8e-94a6-49a4-b4a8-935482829b60 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:57.294307 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-96d5fa8e-94a6-49a4-b4a8-935482829b60 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:57.294752 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-96d5fa8e-94a6-49a4-b4a8-935482829b60 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:57.447826 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-96d5fa8e-94a6-49a4-b4a8-935482829b60 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:57.455586 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-96d5fa8e-94a6-49a4-b4a8-935482829b60 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.173524 Apr 08 11:21:57.456168 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 364/733] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:57 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:57.521194 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2608ab7c-60ce-4bbe-9583-c9b7b40e9c5e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:57.522424 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-2608ab7c-60ce-4bbe-9583-c9b7b40e9c5e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:57.528432 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2608ab7c-60ce-4bbe-9583-c9b7b40e9c5e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:57.528980 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2608ab7c-60ce-4bbe-9583-c9b7b40e9c5e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:57.529642 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2608ab7c-60ce-4bbe-9583-c9b7b40e9c5e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:57.530107 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2608ab7c-60ce-4bbe-9583-c9b7b40e9c5e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:57.665686 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2608ab7c-60ce-4bbe-9583-c9b7b40e9c5e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:57.674273 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2608ab7c-60ce-4bbe-9583-c9b7b40e9c5e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:57.675780 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2608ab7c-60ce-4bbe-9583-c9b7b40e9c5e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:57.676950 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-2608ab7c-60ce-4bbe-9583-c9b7b40e9c5e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.159670 Apr 08 11:21:57.677507 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 370/734] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:57 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:58.256208 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f98d6614-cdc2-4c5b-b7bc-49a8ec69b21b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:58.256795 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f98d6614-cdc2-4c5b-b7bc-49a8ec69b21b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:58.263179 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f98d6614-cdc2-4c5b-b7bc-49a8ec69b21b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:58.263634 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f98d6614-cdc2-4c5b-b7bc-49a8ec69b21b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:58.264434 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f98d6614-cdc2-4c5b-b7bc-49a8ec69b21b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:58.264876 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f98d6614-cdc2-4c5b-b7bc-49a8ec69b21b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:58.327825 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f98d6614-cdc2-4c5b-b7bc-49a8ec69b21b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:58.335669 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f98d6614-cdc2-4c5b-b7bc-49a8ec69b21b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.083363 Apr 08 11:21:58.336263 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 365/735] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:58 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:58.476054 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a016328b-1b81-4f2b-bbcc-12191bd32ead tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:58.476687 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a016328b-1b81-4f2b-bbcc-12191bd32ead tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:58.483073 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a016328b-1b81-4f2b-bbcc-12191bd32ead tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:58.483530 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a016328b-1b81-4f2b-bbcc-12191bd32ead tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:58.484316 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a016328b-1b81-4f2b-bbcc-12191bd32ead tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:58.484758 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a016328b-1b81-4f2b-bbcc-12191bd32ead tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:58.624534 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a016328b-1b81-4f2b-bbcc-12191bd32ead tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:58.632027 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a016328b-1b81-4f2b-bbcc-12191bd32ead tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.160418 Apr 08 11:21:58.632593 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 371/736] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:58 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:58.695639 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-761d1665-7fe7-4a66-84ce-dfa35903c275 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:58.696247 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-761d1665-7fe7-4a66-84ce-dfa35903c275 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:58.702843 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-761d1665-7fe7-4a66-84ce-dfa35903c275 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:58.703298 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-761d1665-7fe7-4a66-84ce-dfa35903c275 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:58.704118 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-761d1665-7fe7-4a66-84ce-dfa35903c275 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:58.704546 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-761d1665-7fe7-4a66-84ce-dfa35903c275 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:58.844005 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-761d1665-7fe7-4a66-84ce-dfa35903c275 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:58.852379 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-761d1665-7fe7-4a66-84ce-dfa35903c275 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:58.853925 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-761d1665-7fe7-4a66-84ce-dfa35903c275 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:58.855106 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-761d1665-7fe7-4a66-84ce-dfa35903c275 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.163432 Apr 08 11:21:58.855671 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 366/737] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:58 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:21:59.149647 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [req-9825ecbc-9ae7-4da7-b408-b6b1ebf8656c req-6c786110-dff5-4d70-86b7-a2453fff660d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6031de3c-c187-4e54-b340-ad53edbe9ee6", "name": "network-vif-unplugged", "status": "completed", "tag": "58170f46-0bda-4d91-90b4-61e81203f4f5"}]} {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:21:59.157644 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-9825ecbc-9ae7-4da7-b408-b6b1ebf8656c req-6c786110-dff5-4d70-86b7-a2453fff660d service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:59.158121 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [req-9825ecbc-9ae7-4da7-b408-b6b1ebf8656c req-6c786110-dff5-4d70-86b7-a2453fff660d service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:59.168809 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.compute.server_external_events [req-9825ecbc-9ae7-4da7-b408-b6b1ebf8656c req-6c786110-dff5-4d70-86b7-a2453fff660d service nova] Creating event network-vif-unplugged:58170f46-0bda-4d91-90b4-61e81203f4f5 for instance 6031de3c-c187-4e54-b340-ad53edbe9ee6 on hv-cinder-83607 Apr 08 11:21:59.173951 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [req-9825ecbc-9ae7-4da7-b408-b6b1ebf8656c req-6c786110-dff5-4d70-86b7-a2453fff660d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083385 Apr 08 11:21:59.174550 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 372/738] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:21:59.352315 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3bd6ea6a-3f1d-490a-84b4-c631076e79e6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:59.352916 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3bd6ea6a-3f1d-490a-84b4-c631076e79e6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:59.358825 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3bd6ea6a-3f1d-490a-84b4-c631076e79e6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:59.359243 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3bd6ea6a-3f1d-490a-84b4-c631076e79e6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:59.360007 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3bd6ea6a-3f1d-490a-84b4-c631076e79e6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:59.360442 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3bd6ea6a-3f1d-490a-84b4-c631076e79e6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:59.426852 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3bd6ea6a-3f1d-490a-84b4-c631076e79e6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:59.435838 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3bd6ea6a-3f1d-490a-84b4-c631076e79e6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.087263 Apr 08 11:21:59.436431 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 367/739] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:59 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:59.649034 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-46bb1e5b-818a-489e-a29e-4e63c82538bf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:59.649725 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-46bb1e5b-818a-489e-a29e-4e63c82538bf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:59.656459 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-46bb1e5b-818a-489e-a29e-4e63c82538bf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:59.656909 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-46bb1e5b-818a-489e-a29e-4e63c82538bf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:59.657680 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-46bb1e5b-818a-489e-a29e-4e63c82538bf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:59.658146 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-46bb1e5b-818a-489e-a29e-4e63c82538bf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:59.802103 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-46bb1e5b-818a-489e-a29e-4e63c82538bf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:21:59.810581 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-46bb1e5b-818a-489e-a29e-4e63c82538bf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.165654 Apr 08 11:21:59.811176 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 373/740] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:21:59 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:21:59.873711 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8dc77eb5-aad8-4751-b488-9aea58af71ee tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:21:59.874365 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8dc77eb5-aad8-4751-b488-9aea58af71ee tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:21:59.880834 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8dc77eb5-aad8-4751-b488-9aea58af71ee tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:59.881290 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8dc77eb5-aad8-4751-b488-9aea58af71ee tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:21:59.882155 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8dc77eb5-aad8-4751-b488-9aea58af71ee tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:21:59.882610 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8dc77eb5-aad8-4751-b488-9aea58af71ee tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:00.029545 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8dc77eb5-aad8-4751-b488-9aea58af71ee tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:00.042570 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8dc77eb5-aad8-4751-b488-9aea58af71ee tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:00.044116 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8dc77eb5-aad8-4751-b488-9aea58af71ee tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:00.045302 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8dc77eb5-aad8-4751-b488-9aea58af71ee tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.175845 Apr 08 11:22:00.045892 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 368/741] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:21:59 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:00.452651 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e2e54eb5-1f14-4f92-9feb-8675c36d67cd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:00.453260 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e2e54eb5-1f14-4f92-9feb-8675c36d67cd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:00.460015 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e2e54eb5-1f14-4f92-9feb-8675c36d67cd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:00.460466 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e2e54eb5-1f14-4f92-9feb-8675c36d67cd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:00.461255 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e2e54eb5-1f14-4f92-9feb-8675c36d67cd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:00.461695 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e2e54eb5-1f14-4f92-9feb-8675c36d67cd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:00.524407 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e2e54eb5-1f14-4f92-9feb-8675c36d67cd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:00.531954 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e2e54eb5-1f14-4f92-9feb-8675c36d67cd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.083184 Apr 08 11:22:00.532536 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 374/742] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:00 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:00.827701 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3880062c-e2c6-4822-91f2-e450229e8162 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:00.828532 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3880062c-e2c6-4822-91f2-e450229e8162 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:00.835874 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3880062c-e2c6-4822-91f2-e450229e8162 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:00.836330 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3880062c-e2c6-4822-91f2-e450229e8162 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:00.837128 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3880062c-e2c6-4822-91f2-e450229e8162 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:00.837567 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3880062c-e2c6-4822-91f2-e450229e8162 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:00.979545 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3880062c-e2c6-4822-91f2-e450229e8162 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:00.987220 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3880062c-e2c6-4822-91f2-e450229e8162 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.163367 Apr 08 11:22:00.987811 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 369/743] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:00 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:01.063102 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-40a7999e-c3cc-4394-99f7-6fd211dc4cb2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:01.063717 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-40a7999e-c3cc-4394-99f7-6fd211dc4cb2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:01.071000 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-40a7999e-c3cc-4394-99f7-6fd211dc4cb2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:01.071447 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-40a7999e-c3cc-4394-99f7-6fd211dc4cb2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:01.072234 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-40a7999e-c3cc-4394-99f7-6fd211dc4cb2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:01.072673 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-40a7999e-c3cc-4394-99f7-6fd211dc4cb2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:01.210588 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-40a7999e-c3cc-4394-99f7-6fd211dc4cb2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:01.219439 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-40a7999e-c3cc-4394-99f7-6fd211dc4cb2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:01.220922 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-40a7999e-c3cc-4394-99f7-6fd211dc4cb2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:01.222115 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-40a7999e-c3cc-4394-99f7-6fd211dc4cb2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.162981 Apr 08 11:22:01.222672 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 375/744] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:01 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:01.548773 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9d5b3524-7b59-464a-9040-0277e6cdf73e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:01.549575 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9d5b3524-7b59-464a-9040-0277e6cdf73e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:01.556744 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9d5b3524-7b59-464a-9040-0277e6cdf73e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:01.557245 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9d5b3524-7b59-464a-9040-0277e6cdf73e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:01.558054 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9d5b3524-7b59-464a-9040-0277e6cdf73e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:01.558506 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9d5b3524-7b59-464a-9040-0277e6cdf73e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:01.622689 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9d5b3524-7b59-464a-9040-0277e6cdf73e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:01.630358 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9d5b3524-7b59-464a-9040-0277e6cdf73e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.085386 Apr 08 11:22:01.631523 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 370/745] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:01 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:22:02.004790 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a9a4f1d3-70cd-46a8-9ee0-0f47ee5e8c51 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:02.005321 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a9a4f1d3-70cd-46a8-9ee0-0f47ee5e8c51 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:02.011422 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a9a4f1d3-70cd-46a8-9ee0-0f47ee5e8c51 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:02.011874 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a9a4f1d3-70cd-46a8-9ee0-0f47ee5e8c51 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:02.012647 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a9a4f1d3-70cd-46a8-9ee0-0f47ee5e8c51 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:02.013090 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a9a4f1d3-70cd-46a8-9ee0-0f47ee5e8c51 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:02.154402 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a9a4f1d3-70cd-46a8-9ee0-0f47ee5e8c51 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:02.162484 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a9a4f1d3-70cd-46a8-9ee0-0f47ee5e8c51 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.161104 Apr 08 11:22:02.163053 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 376/746] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:01 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:02.247502 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e911cb23-6b63-46c1-bc25-fb4f730e51be tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:02.248141 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e911cb23-6b63-46c1-bc25-fb4f730e51be tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:02.254929 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e911cb23-6b63-46c1-bc25-fb4f730e51be tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:02.255292 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e911cb23-6b63-46c1-bc25-fb4f730e51be tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:02.256084 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e911cb23-6b63-46c1-bc25-fb4f730e51be tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:02.256520 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e911cb23-6b63-46c1-bc25-fb4f730e51be tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:02.393475 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e911cb23-6b63-46c1-bc25-fb4f730e51be tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:02.402954 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e911cb23-6b63-46c1-bc25-fb4f730e51be tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:02.404444 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e911cb23-6b63-46c1-bc25-fb4f730e51be tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:02.405602 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e911cb23-6b63-46c1-bc25-fb4f730e51be tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.168915 Apr 08 11:22:02.406280 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 371/747] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:02 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:02.648817 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e84841a7-f902-434c-a7b3-f61d3b9d0e81 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:02.649429 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e84841a7-f902-434c-a7b3-f61d3b9d0e81 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:02.655933 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e84841a7-f902-434c-a7b3-f61d3b9d0e81 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:02.656430 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e84841a7-f902-434c-a7b3-f61d3b9d0e81 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:02.657241 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e84841a7-f902-434c-a7b3-f61d3b9d0e81 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:02.657691 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e84841a7-f902-434c-a7b3-f61d3b9d0e81 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:02.721852 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e84841a7-f902-434c-a7b3-f61d3b9d0e81 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:02.729410 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e84841a7-f902-434c-a7b3-f61d3b9d0e81 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.085100 Apr 08 11:22:02.730016 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 377/748] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:02 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:03.188561 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-58ceb0ef-3210-4600-b35f-24fc96fb55f3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:03.189181 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-58ceb0ef-3210-4600-b35f-24fc96fb55f3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:03.195830 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-58ceb0ef-3210-4600-b35f-24fc96fb55f3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:03.196287 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-58ceb0ef-3210-4600-b35f-24fc96fb55f3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:03.197075 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-58ceb0ef-3210-4600-b35f-24fc96fb55f3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:03.197519 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-58ceb0ef-3210-4600-b35f-24fc96fb55f3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:03.331714 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-58ceb0ef-3210-4600-b35f-24fc96fb55f3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:03.339104 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-58ceb0ef-3210-4600-b35f-24fc96fb55f3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.154434 Apr 08 11:22:03.339675 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 372/749] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:03 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:03.424541 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-694f4d17-8edc-4947-b888-3c0463eec1a2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:03.425177 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-694f4d17-8edc-4947-b888-3c0463eec1a2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:03.432399 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-694f4d17-8edc-4947-b888-3c0463eec1a2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:03.432854 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-694f4d17-8edc-4947-b888-3c0463eec1a2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:03.433625 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-694f4d17-8edc-4947-b888-3c0463eec1a2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:03.434098 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-694f4d17-8edc-4947-b888-3c0463eec1a2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:03.565362 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-694f4d17-8edc-4947-b888-3c0463eec1a2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:03.573968 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-694f4d17-8edc-4947-b888-3c0463eec1a2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:03.575477 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-694f4d17-8edc-4947-b888-3c0463eec1a2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:03.576658 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-694f4d17-8edc-4947-b888-3c0463eec1a2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.156258 Apr 08 11:22:03.577223 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 378/750] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:03 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:22:03.746638 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5d286b24-fa5b-42bf-945e-a8f43ca46d88 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:03.747256 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5d286b24-fa5b-42bf-945e-a8f43ca46d88 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:03.753225 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5d286b24-fa5b-42bf-945e-a8f43ca46d88 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:03.753684 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5d286b24-fa5b-42bf-945e-a8f43ca46d88 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:03.754494 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5d286b24-fa5b-42bf-945e-a8f43ca46d88 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:03.754939 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5d286b24-fa5b-42bf-945e-a8f43ca46d88 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:03.817905 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5d286b24-fa5b-42bf-945e-a8f43ca46d88 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:03.825529 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5d286b24-fa5b-42bf-945e-a8f43ca46d88 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082879 Apr 08 11:22:03.826140 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 373/751] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:03 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:04.356234 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-6a3248f2-c23f-4f31-b010-3e1958c29426 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:04.356840 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-6a3248f2-c23f-4f31-b010-3e1958c29426 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:04.362811 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6a3248f2-c23f-4f31-b010-3e1958c29426 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:04.363193 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6a3248f2-c23f-4f31-b010-3e1958c29426 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:04.363950 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6a3248f2-c23f-4f31-b010-3e1958c29426 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:04.364377 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6a3248f2-c23f-4f31-b010-3e1958c29426 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:04.523697 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6a3248f2-c23f-4f31-b010-3e1958c29426 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:04.531060 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-6a3248f2-c23f-4f31-b010-3e1958c29426 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.178847 Apr 08 11:22:04.531615 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 379/752] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:04 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:04.594966 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-054ae653-8bac-4e66-a9b1-ff09953e886d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:04.595578 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-054ae653-8bac-4e66-a9b1-ff09953e886d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:04.602020 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-054ae653-8bac-4e66-a9b1-ff09953e886d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:04.602481 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-054ae653-8bac-4e66-a9b1-ff09953e886d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:04.603269 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-054ae653-8bac-4e66-a9b1-ff09953e886d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:04.603711 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-054ae653-8bac-4e66-a9b1-ff09953e886d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:04.736918 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-054ae653-8bac-4e66-a9b1-ff09953e886d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:04.745564 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-054ae653-8bac-4e66-a9b1-ff09953e886d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:04.747333 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-054ae653-8bac-4e66-a9b1-ff09953e886d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:04.748475 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-054ae653-8bac-4e66-a9b1-ff09953e886d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.157494 Apr 08 11:22:04.749021 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 374/753] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:04 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:22:04.848029 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2e398404-aa85-4f00-956e-3d28a2a596c3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:04.848643 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-2e398404-aa85-4f00-956e-3d28a2a596c3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:04.855266 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2e398404-aa85-4f00-956e-3d28a2a596c3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:04.855717 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2e398404-aa85-4f00-956e-3d28a2a596c3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:04.856492 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2e398404-aa85-4f00-956e-3d28a2a596c3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:04.856923 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2e398404-aa85-4f00-956e-3d28a2a596c3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:04.919633 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2e398404-aa85-4f00-956e-3d28a2a596c3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:04.928384 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-2e398404-aa85-4f00-956e-3d28a2a596c3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.084248 Apr 08 11:22:04.928953 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 380/754] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:04 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:05.547861 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6dd0d55d-b7a6-4f17-9527-d47f12c1e33c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:05.548474 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6dd0d55d-b7a6-4f17-9527-d47f12c1e33c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:05.554441 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6dd0d55d-b7a6-4f17-9527-d47f12c1e33c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:05.554892 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6dd0d55d-b7a6-4f17-9527-d47f12c1e33c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:05.555666 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6dd0d55d-b7a6-4f17-9527-d47f12c1e33c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:05.556103 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6dd0d55d-b7a6-4f17-9527-d47f12c1e33c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:05.692058 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6dd0d55d-b7a6-4f17-9527-d47f12c1e33c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:05.701258 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6dd0d55d-b7a6-4f17-9527-d47f12c1e33c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.157245 Apr 08 11:22:05.702072 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 375/755] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:05 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:05.767228 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e6263a35-b997-430a-bb1d-38db4b7a00db tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:05.767841 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e6263a35-b997-430a-bb1d-38db4b7a00db tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:05.775181 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e6263a35-b997-430a-bb1d-38db4b7a00db tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:05.775642 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e6263a35-b997-430a-bb1d-38db4b7a00db tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:05.776427 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e6263a35-b997-430a-bb1d-38db4b7a00db tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:05.776866 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e6263a35-b997-430a-bb1d-38db4b7a00db tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:05.910823 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e6263a35-b997-430a-bb1d-38db4b7a00db tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:05.919170 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e6263a35-b997-430a-bb1d-38db4b7a00db tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:05.920665 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e6263a35-b997-430a-bb1d-38db4b7a00db tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:05.921842 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e6263a35-b997-430a-bb1d-38db4b7a00db tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.158576 Apr 08 11:22:05.922395 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 381/756] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:05 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:05.945055 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-76fa5b53-1642-4fac-b902-1a5cb9430467 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:05.945931 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-76fa5b53-1642-4fac-b902-1a5cb9430467 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:05.951836 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-76fa5b53-1642-4fac-b902-1a5cb9430467 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:05.952260 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-76fa5b53-1642-4fac-b902-1a5cb9430467 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:05.953025 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-76fa5b53-1642-4fac-b902-1a5cb9430467 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:05.953458 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-76fa5b53-1642-4fac-b902-1a5cb9430467 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:06.015754 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-76fa5b53-1642-4fac-b902-1a5cb9430467 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:06.023279 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-76fa5b53-1642-4fac-b902-1a5cb9430467 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082752 Apr 08 11:22:06.023838 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 376/757] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:05 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:06.719152 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-3ee1e63c-f752-41d2-81b4-4d846ca6bc4e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:06.719766 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-3ee1e63c-f752-41d2-81b4-4d846ca6bc4e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:06.726954 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3ee1e63c-f752-41d2-81b4-4d846ca6bc4e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:06.727412 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3ee1e63c-f752-41d2-81b4-4d846ca6bc4e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:06.728204 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3ee1e63c-f752-41d2-81b4-4d846ca6bc4e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:06.728647 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3ee1e63c-f752-41d2-81b4-4d846ca6bc4e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:06.866154 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-3ee1e63c-f752-41d2-81b4-4d846ca6bc4e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:06.873908 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-3ee1e63c-f752-41d2-81b4-4d846ca6bc4e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.158578 Apr 08 11:22:06.874485 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 382/758] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:06 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:06.939804 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-52ac94d9-89e7-4a5b-ba1f-8e7c81e66bad tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:06.940318 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-52ac94d9-89e7-4a5b-ba1f-8e7c81e66bad tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:06.947005 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-52ac94d9-89e7-4a5b-ba1f-8e7c81e66bad tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:06.947456 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-52ac94d9-89e7-4a5b-ba1f-8e7c81e66bad tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:06.948245 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-52ac94d9-89e7-4a5b-ba1f-8e7c81e66bad tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:06.948684 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-52ac94d9-89e7-4a5b-ba1f-8e7c81e66bad tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:07.040280 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-81916629-b47a-4918-935e-fb06f8ecdf99 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:07.040897 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-81916629-b47a-4918-935e-fb06f8ecdf99 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:07.047204 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-81916629-b47a-4918-935e-fb06f8ecdf99 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:07.047650 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-81916629-b47a-4918-935e-fb06f8ecdf99 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:07.048447 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-81916629-b47a-4918-935e-fb06f8ecdf99 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:07.048888 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-81916629-b47a-4918-935e-fb06f8ecdf99 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:07.095689 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-52ac94d9-89e7-4a5b-ba1f-8e7c81e66bad tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:07.103980 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-52ac94d9-89e7-4a5b-ba1f-8e7c81e66bad tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:07.105484 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-52ac94d9-89e7-4a5b-ba1f-8e7c81e66bad tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:07.106667 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-52ac94d9-89e7-4a5b-ba1f-8e7c81e66bad tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.170882 Apr 08 11:22:07.107233 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 377/759] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:06 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:07.114153 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-81916629-b47a-4918-935e-fb06f8ecdf99 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:07.121827 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-81916629-b47a-4918-935e-fb06f8ecdf99 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.085919 Apr 08 11:22:07.122386 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 383/760] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:07 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:22:07.891040 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-30b95242-27cf-4209-b2a7-b118eaafb7a8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:07.891572 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-30b95242-27cf-4209-b2a7-b118eaafb7a8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:07.897818 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-30b95242-27cf-4209-b2a7-b118eaafb7a8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:07.898281 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-30b95242-27cf-4209-b2a7-b118eaafb7a8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:07.899176 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-30b95242-27cf-4209-b2a7-b118eaafb7a8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:07.899619 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-30b95242-27cf-4209-b2a7-b118eaafb7a8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:08.034908 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-30b95242-27cf-4209-b2a7-b118eaafb7a8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:08.043014 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-30b95242-27cf-4209-b2a7-b118eaafb7a8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.155908 Apr 08 11:22:08.043611 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 378/761] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:07 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:08.125547 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-8ff404a7-99d1-4f6b-b83d-3eb6c480484f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:08.126233 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-8ff404a7-99d1-4f6b-b83d-3eb6c480484f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:08.132951 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8ff404a7-99d1-4f6b-b83d-3eb6c480484f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:08.136932 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8ff404a7-99d1-4f6b-b83d-3eb6c480484f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:08.136932 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8ff404a7-99d1-4f6b-b83d-3eb6c480484f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:08.136932 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8ff404a7-99d1-4f6b-b83d-3eb6c480484f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:08.138739 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6fbf4813-9051-4d53-89a4-6d12a7cf66c2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:08.139358 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6fbf4813-9051-4d53-89a4-6d12a7cf66c2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:08.145449 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6fbf4813-9051-4d53-89a4-6d12a7cf66c2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:08.145868 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6fbf4813-9051-4d53-89a4-6d12a7cf66c2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:08.146641 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6fbf4813-9051-4d53-89a4-6d12a7cf66c2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:08.147079 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6fbf4813-9051-4d53-89a4-6d12a7cf66c2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:08.220445 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6fbf4813-9051-4d53-89a4-6d12a7cf66c2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:08.233118 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6fbf4813-9051-4d53-89a4-6d12a7cf66c2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.098006 Apr 08 11:22:08.234220 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 379/762] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:08 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:22:08.309812 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-8ff404a7-99d1-4f6b-b83d-3eb6c480484f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:08.318760 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-8ff404a7-99d1-4f6b-b83d-3eb6c480484f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:08.320266 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-8ff404a7-99d1-4f6b-b83d-3eb6c480484f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:08.321436 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-8ff404a7-99d1-4f6b-b83d-3eb6c480484f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.200477 Apr 08 11:22:08.322114 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 384/763] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:08 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:09.061166 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8db4cb83-81a8-4fa5-ae35-5dc84ecb3d60 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:09.061756 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8db4cb83-81a8-4fa5-ae35-5dc84ecb3d60 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:09.068760 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8db4cb83-81a8-4fa5-ae35-5dc84ecb3d60 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:09.069205 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8db4cb83-81a8-4fa5-ae35-5dc84ecb3d60 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:09.069990 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8db4cb83-81a8-4fa5-ae35-5dc84ecb3d60 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:09.070429 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8db4cb83-81a8-4fa5-ae35-5dc84ecb3d60 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:09.208122 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8db4cb83-81a8-4fa5-ae35-5dc84ecb3d60 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:09.215604 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8db4cb83-81a8-4fa5-ae35-5dc84ecb3d60 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.158312 Apr 08 11:22:09.216178 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 380/764] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:09 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:09.250435 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-1a2a9679-fe12-4182-9fd8-1b4340c1a894 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:09.251047 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-1a2a9679-fe12-4182-9fd8-1b4340c1a894 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:09.258370 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1a2a9679-fe12-4182-9fd8-1b4340c1a894 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:09.258849 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1a2a9679-fe12-4182-9fd8-1b4340c1a894 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:09.259647 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1a2a9679-fe12-4182-9fd8-1b4340c1a894 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:09.260094 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1a2a9679-fe12-4182-9fd8-1b4340c1a894 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:09.320429 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1a2a9679-fe12-4182-9fd8-1b4340c1a894 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:09.327824 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-1a2a9679-fe12-4182-9fd8-1b4340c1a894 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081700 Apr 08 11:22:09.328402 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 385/765] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:09 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:09.340434 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7e78d046-5bad-4179-818d-61a39a2d3c93 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:09.341037 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7e78d046-5bad-4179-818d-61a39a2d3c93 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:09.346890 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7e78d046-5bad-4179-818d-61a39a2d3c93 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:09.347335 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7e78d046-5bad-4179-818d-61a39a2d3c93 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:09.348089 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7e78d046-5bad-4179-818d-61a39a2d3c93 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:09.348600 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7e78d046-5bad-4179-818d-61a39a2d3c93 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:09.727581 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7e78d046-5bad-4179-818d-61a39a2d3c93 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:09.735994 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7e78d046-5bad-4179-818d-61a39a2d3c93 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:09.737543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7e78d046-5bad-4179-818d-61a39a2d3c93 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:09.738746 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7e78d046-5bad-4179-818d-61a39a2d3c93 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.402279 Apr 08 11:22:09.739319 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 381/766] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:09 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:10.232541 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-8c50c0b3-992d-4d53-aa87-7e85a2f3da3b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:10.233151 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-8c50c0b3-992d-4d53-aa87-7e85a2f3da3b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:10.239076 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8c50c0b3-992d-4d53-aa87-7e85a2f3da3b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:10.239527 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8c50c0b3-992d-4d53-aa87-7e85a2f3da3b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:10.240300 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8c50c0b3-992d-4d53-aa87-7e85a2f3da3b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:10.240734 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8c50c0b3-992d-4d53-aa87-7e85a2f3da3b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:10.343360 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-cbb78a95-a92e-46b0-be21-ef417b547d82 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:10.344098 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-cbb78a95-a92e-46b0-be21-ef417b547d82 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:10.350477 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cbb78a95-a92e-46b0-be21-ef417b547d82 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:10.351788 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cbb78a95-a92e-46b0-be21-ef417b547d82 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:10.351788 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cbb78a95-a92e-46b0-be21-ef417b547d82 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:10.352138 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cbb78a95-a92e-46b0-be21-ef417b547d82 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:10.385941 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-8c50c0b3-992d-4d53-aa87-7e85a2f3da3b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:10.393522 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-8c50c0b3-992d-4d53-aa87-7e85a2f3da3b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.164771 Apr 08 11:22:10.394149 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 386/767] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:10 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:10.414423 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-cbb78a95-a92e-46b0-be21-ef417b547d82 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:10.422015 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-cbb78a95-a92e-46b0-be21-ef417b547d82 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082388 Apr 08 11:22:10.422611 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 382/768] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:10 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:22:10.757239 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e93e860d-3a50-4ea6-aa89-78b63c7c5680 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:10.757885 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e93e860d-3a50-4ea6-aa89-78b63c7c5680 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:10.763973 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e93e860d-3a50-4ea6-aa89-78b63c7c5680 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:10.764430 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e93e860d-3a50-4ea6-aa89-78b63c7c5680 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:10.765220 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e93e860d-3a50-4ea6-aa89-78b63c7c5680 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:10.765667 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e93e860d-3a50-4ea6-aa89-78b63c7c5680 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:10.913000 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e93e860d-3a50-4ea6-aa89-78b63c7c5680 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:10.921331 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e93e860d-3a50-4ea6-aa89-78b63c7c5680 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:10.922874 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e93e860d-3a50-4ea6-aa89-78b63c7c5680 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:10.924050 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e93e860d-3a50-4ea6-aa89-78b63c7c5680 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.171457 Apr 08 11:22:10.924625 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 387/769] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:10 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:11.412800 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7b9c5994-f461-4ca8-a770-521d59edda42 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:11.413437 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7b9c5994-f461-4ca8-a770-521d59edda42 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:11.420162 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7b9c5994-f461-4ca8-a770-521d59edda42 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:11.420614 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7b9c5994-f461-4ca8-a770-521d59edda42 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:11.421403 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7b9c5994-f461-4ca8-a770-521d59edda42 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:11.421887 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7b9c5994-f461-4ca8-a770-521d59edda42 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:11.438702 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-4b59d238-c933-407d-8497-024ecdc317a6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:11.439510 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-4b59d238-c933-407d-8497-024ecdc317a6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:11.446178 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4b59d238-c933-407d-8497-024ecdc317a6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:11.446634 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4b59d238-c933-407d-8497-024ecdc317a6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:11.447424 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4b59d238-c933-407d-8497-024ecdc317a6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:11.447863 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4b59d238-c933-407d-8497-024ecdc317a6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:11.515631 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-4b59d238-c933-407d-8497-024ecdc317a6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:11.524528 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-4b59d238-c933-407d-8497-024ecdc317a6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.089605 Apr 08 11:22:11.525123 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 388/770] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:11 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:22:11.592597 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7b9c5994-f461-4ca8-a770-521d59edda42 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:11.600301 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7b9c5994-f461-4ca8-a770-521d59edda42 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.191933 Apr 08 11:22:11.600896 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 383/771] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:11 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:11.944270 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-f6b47eed-9684-4aba-bcbf-91d77f02b99b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:11.945070 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-f6b47eed-9684-4aba-bcbf-91d77f02b99b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:11.950934 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f6b47eed-9684-4aba-bcbf-91d77f02b99b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:11.951385 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f6b47eed-9684-4aba-bcbf-91d77f02b99b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:11.952173 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f6b47eed-9684-4aba-bcbf-91d77f02b99b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:11.952611 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f6b47eed-9684-4aba-bcbf-91d77f02b99b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:12.093541 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f6b47eed-9684-4aba-bcbf-91d77f02b99b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:12.102351 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f6b47eed-9684-4aba-bcbf-91d77f02b99b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:12.103855 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f6b47eed-9684-4aba-bcbf-91d77f02b99b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:12.105059 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-f6b47eed-9684-4aba-bcbf-91d77f02b99b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.165628 Apr 08 11:22:12.105624 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 389/772] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:11 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:12.545373 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7d4d70a2-2596-4041-807c-c73d32a2d75a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:12.547390 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7d4d70a2-2596-4041-807c-c73d32a2d75a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:12.556425 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d4d70a2-2596-4041-807c-c73d32a2d75a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:12.557438 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d4d70a2-2596-4041-807c-c73d32a2d75a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:12.558941 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d4d70a2-2596-4041-807c-c73d32a2d75a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:12.559756 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d4d70a2-2596-4041-807c-c73d32a2d75a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:12.618547 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-d74c64f8-60a5-41fd-9cc2-db741217d4a0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:12.619403 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-d74c64f8-60a5-41fd-9cc2-db741217d4a0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:12.626015 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d74c64f8-60a5-41fd-9cc2-db741217d4a0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:12.626498 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d74c64f8-60a5-41fd-9cc2-db741217d4a0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:12.627268 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d74c64f8-60a5-41fd-9cc2-db741217d4a0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:12.627716 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d74c64f8-60a5-41fd-9cc2-db741217d4a0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:12.662102 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7d4d70a2-2596-4041-807c-c73d32a2d75a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:12.674371 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7d4d70a2-2596-4041-807c-c73d32a2d75a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.135090 Apr 08 11:22:12.675161 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 384/773] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:12 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:12.800934 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d74c64f8-60a5-41fd-9cc2-db741217d4a0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:12.812798 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-d74c64f8-60a5-41fd-9cc2-db741217d4a0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.198318 Apr 08 11:22:12.813682 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 390/774] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:12 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:22:13.124585 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4111b46e-5438-4763-8c3d-af4407cfd107 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:13.125091 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4111b46e-5438-4763-8c3d-af4407cfd107 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:13.132240 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4111b46e-5438-4763-8c3d-af4407cfd107 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:13.132687 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4111b46e-5438-4763-8c3d-af4407cfd107 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:13.133485 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4111b46e-5438-4763-8c3d-af4407cfd107 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:13.133951 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4111b46e-5438-4763-8c3d-af4407cfd107 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:13.304388 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4111b46e-5438-4763-8c3d-af4407cfd107 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:13.313697 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4111b46e-5438-4763-8c3d-af4407cfd107 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:13.315237 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4111b46e-5438-4763-8c3d-af4407cfd107 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:13.316422 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4111b46e-5438-4763-8c3d-af4407cfd107 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.196424 Apr 08 11:22:13.316990 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 385/775] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:13 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:13.692727 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-df56c5a4-5c18-46ad-8e47-3a72ca2fac4c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:13.693519 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-df56c5a4-5c18-46ad-8e47-3a72ca2fac4c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:13.700498 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-df56c5a4-5c18-46ad-8e47-3a72ca2fac4c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:13.700946 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-df56c5a4-5c18-46ad-8e47-3a72ca2fac4c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:13.701737 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-df56c5a4-5c18-46ad-8e47-3a72ca2fac4c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:13.702202 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-df56c5a4-5c18-46ad-8e47-3a72ca2fac4c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:13.766752 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-df56c5a4-5c18-46ad-8e47-3a72ca2fac4c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:13.774693 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-df56c5a4-5c18-46ad-8e47-3a72ca2fac4c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.086515 Apr 08 11:22:13.775284 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 391/776] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:13 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:13.835089 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-25daa4f1-086c-403f-80a3-707d49e3b67a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:13.835690 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-25daa4f1-086c-403f-80a3-707d49e3b67a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:13.842231 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-25daa4f1-086c-403f-80a3-707d49e3b67a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:13.842720 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-25daa4f1-086c-403f-80a3-707d49e3b67a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:13.843541 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-25daa4f1-086c-403f-80a3-707d49e3b67a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:13.843983 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-25daa4f1-086c-403f-80a3-707d49e3b67a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:13.987730 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-25daa4f1-086c-403f-80a3-707d49e3b67a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:13.995810 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-25daa4f1-086c-403f-80a3-707d49e3b67a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.164558 Apr 08 11:22:13.996647 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 386/777] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:13 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:14.336323 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-c599d3b1-ee31-4c14-96a5-758688f209c8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:14.336947 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-c599d3b1-ee31-4c14-96a5-758688f209c8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:14.343108 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c599d3b1-ee31-4c14-96a5-758688f209c8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:14.343564 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c599d3b1-ee31-4c14-96a5-758688f209c8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:14.344342 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c599d3b1-ee31-4c14-96a5-758688f209c8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:14.344778 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c599d3b1-ee31-4c14-96a5-758688f209c8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:14.483134 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-c599d3b1-ee31-4c14-96a5-758688f209c8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:14.491775 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-c599d3b1-ee31-4c14-96a5-758688f209c8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:14.493291 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-c599d3b1-ee31-4c14-96a5-758688f209c8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:14.494527 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-c599d3b1-ee31-4c14-96a5-758688f209c8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.163188 Apr 08 11:22:14.495103 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 392/778] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:14 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:14.791258 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4279925c-9042-466f-8c60-dbb75d689490 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:14.791870 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4279925c-9042-466f-8c60-dbb75d689490 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:14.798131 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4279925c-9042-466f-8c60-dbb75d689490 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:14.798582 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4279925c-9042-466f-8c60-dbb75d689490 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:14.799366 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4279925c-9042-466f-8c60-dbb75d689490 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:14.799806 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4279925c-9042-466f-8c60-dbb75d689490 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:14.861792 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4279925c-9042-466f-8c60-dbb75d689490 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:14.869974 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4279925c-9042-466f-8c60-dbb75d689490 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082501 Apr 08 11:22:14.870578 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 387/779] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:14 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:15.013281 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-43261af1-5765-4381-ac30-168833e8ad19 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:15.013934 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-43261af1-5765-4381-ac30-168833e8ad19 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:15.020668 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-43261af1-5765-4381-ac30-168833e8ad19 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:15.021122 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-43261af1-5765-4381-ac30-168833e8ad19 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:15.021941 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-43261af1-5765-4381-ac30-168833e8ad19 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:15.022382 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-43261af1-5765-4381-ac30-168833e8ad19 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:15.169281 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-43261af1-5765-4381-ac30-168833e8ad19 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:15.177875 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-43261af1-5765-4381-ac30-168833e8ad19 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.168377 Apr 08 11:22:15.178466 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 393/780] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:15 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:15.514419 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a87b5d7f-e089-44c8-bcac-c05d9ba92222 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:15.515031 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a87b5d7f-e089-44c8-bcac-c05d9ba92222 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:15.521196 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a87b5d7f-e089-44c8-bcac-c05d9ba92222 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:15.521644 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a87b5d7f-e089-44c8-bcac-c05d9ba92222 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:15.522462 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a87b5d7f-e089-44c8-bcac-c05d9ba92222 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:15.522897 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a87b5d7f-e089-44c8-bcac-c05d9ba92222 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:15.674077 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a87b5d7f-e089-44c8-bcac-c05d9ba92222 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:15.683895 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a87b5d7f-e089-44c8-bcac-c05d9ba92222 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:15.685416 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a87b5d7f-e089-44c8-bcac-c05d9ba92222 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:15.686639 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a87b5d7f-e089-44c8-bcac-c05d9ba92222 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.176208 Apr 08 11:22:15.687224 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 388/781] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:15 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:22:15.888132 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-0c139034-005c-4744-8d56-81a00508a49c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:15.888753 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-0c139034-005c-4744-8d56-81a00508a49c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:15.895913 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0c139034-005c-4744-8d56-81a00508a49c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:15.896369 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0c139034-005c-4744-8d56-81a00508a49c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:15.897161 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0c139034-005c-4744-8d56-81a00508a49c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:15.897629 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0c139034-005c-4744-8d56-81a00508a49c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:15.963416 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-0c139034-005c-4744-8d56-81a00508a49c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:15.971494 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-0c139034-005c-4744-8d56-81a00508a49c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.087258 Apr 08 11:22:15.972093 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 394/782] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:15 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:16.196071 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-25c27e37-2663-4e75-8bbc-3052bb462ff3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:16.196643 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-25c27e37-2663-4e75-8bbc-3052bb462ff3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:16.203808 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-25c27e37-2663-4e75-8bbc-3052bb462ff3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:16.204260 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-25c27e37-2663-4e75-8bbc-3052bb462ff3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:16.205064 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-25c27e37-2663-4e75-8bbc-3052bb462ff3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:16.205510 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-25c27e37-2663-4e75-8bbc-3052bb462ff3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:16.360072 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-25c27e37-2663-4e75-8bbc-3052bb462ff3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:16.373224 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-25c27e37-2663-4e75-8bbc-3052bb462ff3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.181293 Apr 08 11:22:16.374112 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 389/783] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:16 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:16.705345 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-500d533d-500e-4023-90da-c2bf31fa36ec tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:16.706094 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-500d533d-500e-4023-90da-c2bf31fa36ec tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:16.712846 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-500d533d-500e-4023-90da-c2bf31fa36ec tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:16.713301 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-500d533d-500e-4023-90da-c2bf31fa36ec tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:16.714134 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-500d533d-500e-4023-90da-c2bf31fa36ec tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:16.714579 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-500d533d-500e-4023-90da-c2bf31fa36ec tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:16.855490 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-500d533d-500e-4023-90da-c2bf31fa36ec tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:16.864771 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-500d533d-500e-4023-90da-c2bf31fa36ec tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:16.866313 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-500d533d-500e-4023-90da-c2bf31fa36ec tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:16.867483 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-500d533d-500e-4023-90da-c2bf31fa36ec tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.166187 Apr 08 11:22:16.868045 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 395/784] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:16 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:16.989911 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-484cdd3e-5606-4d14-a90b-7b07845cc1bd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:16.990452 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-484cdd3e-5606-4d14-a90b-7b07845cc1bd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:16.997250 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-484cdd3e-5606-4d14-a90b-7b07845cc1bd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:16.997825 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-484cdd3e-5606-4d14-a90b-7b07845cc1bd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:16.999004 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-484cdd3e-5606-4d14-a90b-7b07845cc1bd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:16.999777 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-484cdd3e-5606-4d14-a90b-7b07845cc1bd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:17.066320 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-484cdd3e-5606-4d14-a90b-7b07845cc1bd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:17.074249 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-484cdd3e-5606-4d14-a90b-7b07845cc1bd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.088973 Apr 08 11:22:17.074851 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 390/785] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:16 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:17.399774 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-7e67c67f-5bc4-45c1-95c8-fa1d98244b02 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:17.400450 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-7e67c67f-5bc4-45c1-95c8-fa1d98244b02 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:17.408723 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7e67c67f-5bc4-45c1-95c8-fa1d98244b02 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:17.409188 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7e67c67f-5bc4-45c1-95c8-fa1d98244b02 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:17.410023 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7e67c67f-5bc4-45c1-95c8-fa1d98244b02 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:17.410462 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7e67c67f-5bc4-45c1-95c8-fa1d98244b02 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:17.560656 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-7e67c67f-5bc4-45c1-95c8-fa1d98244b02 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:17.569407 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-7e67c67f-5bc4-45c1-95c8-fa1d98244b02 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.173443 Apr 08 11:22:17.570033 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 396/786] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:17 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:17.887857 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-909bba92-3746-4005-8068-0dcd3bafb48e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:17.888477 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-909bba92-3746-4005-8068-0dcd3bafb48e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:17.895554 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-909bba92-3746-4005-8068-0dcd3bafb48e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:17.896012 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-909bba92-3746-4005-8068-0dcd3bafb48e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:17.896829 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-909bba92-3746-4005-8068-0dcd3bafb48e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:17.897273 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-909bba92-3746-4005-8068-0dcd3bafb48e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:18.033366 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-909bba92-3746-4005-8068-0dcd3bafb48e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:18.041793 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-909bba92-3746-4005-8068-0dcd3bafb48e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:18.048126 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-909bba92-3746-4005-8068-0dcd3bafb48e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:18.048126 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-909bba92-3746-4005-8068-0dcd3bafb48e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.160704 Apr 08 11:22:18.048126 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 391/787] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:17 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:18.090622 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-9d85a68b-bfd0-4c90-996e-ee5974cc31c1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:18.091239 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-9d85a68b-bfd0-4c90-996e-ee5974cc31c1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:18.097912 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9d85a68b-bfd0-4c90-996e-ee5974cc31c1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:18.099431 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9d85a68b-bfd0-4c90-996e-ee5974cc31c1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:18.099431 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9d85a68b-bfd0-4c90-996e-ee5974cc31c1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:18.099732 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9d85a68b-bfd0-4c90-996e-ee5974cc31c1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:18.162606 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-9d85a68b-bfd0-4c90-996e-ee5974cc31c1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:18.170147 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-9d85a68b-bfd0-4c90-996e-ee5974cc31c1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.083328 Apr 08 11:22:18.170717 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 397/788] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:18 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:18.587290 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7fe37769-b05a-4136-a3cd-c05b5b79a18f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:18.587901 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7fe37769-b05a-4136-a3cd-c05b5b79a18f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:18.593830 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7fe37769-b05a-4136-a3cd-c05b5b79a18f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:18.594286 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7fe37769-b05a-4136-a3cd-c05b5b79a18f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:18.595054 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7fe37769-b05a-4136-a3cd-c05b5b79a18f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:18.595491 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7fe37769-b05a-4136-a3cd-c05b5b79a18f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:18.736884 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7fe37769-b05a-4136-a3cd-c05b5b79a18f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:18.745114 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7fe37769-b05a-4136-a3cd-c05b5b79a18f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.161594 Apr 08 11:22:18.745978 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 392/789] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:18 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:19.062436 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-f93c3cf0-a8c2-42f1-96f5-3072cd1782ca tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:19.063054 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-f93c3cf0-a8c2-42f1-96f5-3072cd1782ca tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:19.069628 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f93c3cf0-a8c2-42f1-96f5-3072cd1782ca tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:19.070108 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f93c3cf0-a8c2-42f1-96f5-3072cd1782ca tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:19.070880 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f93c3cf0-a8c2-42f1-96f5-3072cd1782ca tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:19.071315 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f93c3cf0-a8c2-42f1-96f5-3072cd1782ca tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:19.187096 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d3f475b4-07c5-4870-a21a-ed164515c714 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:19.187720 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d3f475b4-07c5-4870-a21a-ed164515c714 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:19.194137 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d3f475b4-07c5-4870-a21a-ed164515c714 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:19.194591 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d3f475b4-07c5-4870-a21a-ed164515c714 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:19.195368 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d3f475b4-07c5-4870-a21a-ed164515c714 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:19.195808 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d3f475b4-07c5-4870-a21a-ed164515c714 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:19.205541 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f93c3cf0-a8c2-42f1-96f5-3072cd1782ca tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:19.214026 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f93c3cf0-a8c2-42f1-96f5-3072cd1782ca tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:19.215529 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f93c3cf0-a8c2-42f1-96f5-3072cd1782ca tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:19.216687 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-f93c3cf0-a8c2-42f1-96f5-3072cd1782ca tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.158192 Apr 08 11:22:19.217497 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 398/790] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:19 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:19.260781 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d3f475b4-07c5-4870-a21a-ed164515c714 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:19.268275 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d3f475b4-07c5-4870-a21a-ed164515c714 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.085031 Apr 08 11:22:19.268841 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 393/791] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:19 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:22:19.763494 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-3e11aeca-2ca0-4a93-80f8-b74fde146f9e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:19.764113 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-3e11aeca-2ca0-4a93-80f8-b74fde146f9e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:19.770806 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3e11aeca-2ca0-4a93-80f8-b74fde146f9e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:19.771260 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3e11aeca-2ca0-4a93-80f8-b74fde146f9e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:19.772049 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3e11aeca-2ca0-4a93-80f8-b74fde146f9e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:19.772489 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3e11aeca-2ca0-4a93-80f8-b74fde146f9e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:19.907176 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-3e11aeca-2ca0-4a93-80f8-b74fde146f9e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:19.914763 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-3e11aeca-2ca0-4a93-80f8-b74fde146f9e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.155183 Apr 08 11:22:19.915337 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 399/792] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:19 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:20.235636 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-afdb4e08-39d6-48a9-8067-e1e5eb2cc0c7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:20.236166 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-afdb4e08-39d6-48a9-8067-e1e5eb2cc0c7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:20.243094 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-afdb4e08-39d6-48a9-8067-e1e5eb2cc0c7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:20.243547 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-afdb4e08-39d6-48a9-8067-e1e5eb2cc0c7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:20.244328 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-afdb4e08-39d6-48a9-8067-e1e5eb2cc0c7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:20.244796 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-afdb4e08-39d6-48a9-8067-e1e5eb2cc0c7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:20.285081 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-62a43ace-d406-444a-9bbc-f051eb2c7ebc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:20.285754 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-62a43ace-d406-444a-9bbc-f051eb2c7ebc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:20.292764 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-62a43ace-d406-444a-9bbc-f051eb2c7ebc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:20.293217 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-62a43ace-d406-444a-9bbc-f051eb2c7ebc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:20.294025 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-62a43ace-d406-444a-9bbc-f051eb2c7ebc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:20.294469 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-62a43ace-d406-444a-9bbc-f051eb2c7ebc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:20.366487 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-62a43ace-d406-444a-9bbc-f051eb2c7ebc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:20.374040 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-62a43ace-d406-444a-9bbc-f051eb2c7ebc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.092933 Apr 08 11:22:20.374607 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 400/793] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:20 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:22:20.416144 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-afdb4e08-39d6-48a9-8067-e1e5eb2cc0c7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:20.424532 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-afdb4e08-39d6-48a9-8067-e1e5eb2cc0c7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:20.426067 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-afdb4e08-39d6-48a9-8067-e1e5eb2cc0c7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:20.434859 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-afdb4e08-39d6-48a9-8067-e1e5eb2cc0c7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.196144 Apr 08 11:22:20.434859 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 394/794] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:20 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:20.931620 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2c3e1012-3e96-4b61-819b-b70f8f884b28 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:20.932182 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-2c3e1012-3e96-4b61-819b-b70f8f884b28 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:20.938182 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2c3e1012-3e96-4b61-819b-b70f8f884b28 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:20.938632 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2c3e1012-3e96-4b61-819b-b70f8f884b28 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:20.939406 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2c3e1012-3e96-4b61-819b-b70f8f884b28 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:20.939844 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2c3e1012-3e96-4b61-819b-b70f8f884b28 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:21.083379 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2c3e1012-3e96-4b61-819b-b70f8f884b28 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:21.090900 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-2c3e1012-3e96-4b61-819b-b70f8f884b28 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.163157 Apr 08 11:22:21.091473 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 401/795] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:20 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:21.390353 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b51c4a20-a430-4bde-9f30-3ab83b4e3e6a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:21.390979 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b51c4a20-a430-4bde-9f30-3ab83b4e3e6a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:21.397923 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b51c4a20-a430-4bde-9f30-3ab83b4e3e6a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:21.398366 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b51c4a20-a430-4bde-9f30-3ab83b4e3e6a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:21.399127 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b51c4a20-a430-4bde-9f30-3ab83b4e3e6a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:21.399562 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b51c4a20-a430-4bde-9f30-3ab83b4e3e6a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:21.446654 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-d2b75b7d-6b7e-4e3c-9cce-b8c4fb6db1b0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:21.447361 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-d2b75b7d-6b7e-4e3c-9cce-b8c4fb6db1b0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:21.453719 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d2b75b7d-6b7e-4e3c-9cce-b8c4fb6db1b0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:21.454271 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d2b75b7d-6b7e-4e3c-9cce-b8c4fb6db1b0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:21.455127 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d2b75b7d-6b7e-4e3c-9cce-b8c4fb6db1b0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:21.456020 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d2b75b7d-6b7e-4e3c-9cce-b8c4fb6db1b0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:21.458702 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b51c4a20-a430-4bde-9f30-3ab83b4e3e6a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:21.466115 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b51c4a20-a430-4bde-9f30-3ab83b4e3e6a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079570 Apr 08 11:22:21.466689 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 395/796] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:21 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:21.589898 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d2b75b7d-6b7e-4e3c-9cce-b8c4fb6db1b0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:21.598083 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d2b75b7d-6b7e-4e3c-9cce-b8c4fb6db1b0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:21.599575 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d2b75b7d-6b7e-4e3c-9cce-b8c4fb6db1b0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:21.600725 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-d2b75b7d-6b7e-4e3c-9cce-b8c4fb6db1b0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.158005 Apr 08 11:22:21.601286 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 402/797] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:21 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:22.108695 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2db250c4-337a-482c-94eb-447978a1be51 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:22.109304 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2db250c4-337a-482c-94eb-447978a1be51 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:22.116130 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2db250c4-337a-482c-94eb-447978a1be51 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:22.116578 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2db250c4-337a-482c-94eb-447978a1be51 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:22.117408 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2db250c4-337a-482c-94eb-447978a1be51 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:22.117880 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2db250c4-337a-482c-94eb-447978a1be51 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:22.254108 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2db250c4-337a-482c-94eb-447978a1be51 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:22.262728 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2db250c4-337a-482c-94eb-447978a1be51 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.157876 Apr 08 11:22:22.263311 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 396/798] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:22 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:22.482959 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-7885ec8a-e4e7-48d8-ace0-38d2cd1d72a5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:22.483522 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-7885ec8a-e4e7-48d8-ace0-38d2cd1d72a5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:22.489973 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7885ec8a-e4e7-48d8-ace0-38d2cd1d72a5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:22.490412 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7885ec8a-e4e7-48d8-ace0-38d2cd1d72a5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:22.491203 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7885ec8a-e4e7-48d8-ace0-38d2cd1d72a5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:22.491650 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7885ec8a-e4e7-48d8-ace0-38d2cd1d72a5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:22.551634 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-7885ec8a-e4e7-48d8-ace0-38d2cd1d72a5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:22.559193 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-7885ec8a-e4e7-48d8-ace0-38d2cd1d72a5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080209 Apr 08 11:22:22.559795 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 403/799] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:22 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:22.619018 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-70091eef-ad35-4e0c-8f41-4da0927044b2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:22.619631 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-70091eef-ad35-4e0c-8f41-4da0927044b2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:22.626441 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-70091eef-ad35-4e0c-8f41-4da0927044b2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:22.626894 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-70091eef-ad35-4e0c-8f41-4da0927044b2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:22.627672 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-70091eef-ad35-4e0c-8f41-4da0927044b2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:22.628115 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-70091eef-ad35-4e0c-8f41-4da0927044b2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:22.765486 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-70091eef-ad35-4e0c-8f41-4da0927044b2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:22.774461 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-70091eef-ad35-4e0c-8f41-4da0927044b2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:22.776026 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-70091eef-ad35-4e0c-8f41-4da0927044b2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:22.777195 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-70091eef-ad35-4e0c-8f41-4da0927044b2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.162411 Apr 08 11:22:22.778186 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 397/800] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:22 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:22:23.279482 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-9e479c7b-5ec1-4bc6-bc54-0ef26a507ea2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:23.280129 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-9e479c7b-5ec1-4bc6-bc54-0ef26a507ea2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:23.286217 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9e479c7b-5ec1-4bc6-bc54-0ef26a507ea2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:23.286672 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9e479c7b-5ec1-4bc6-bc54-0ef26a507ea2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:23.304399 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9e479c7b-5ec1-4bc6-bc54-0ef26a507ea2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:23.304399 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9e479c7b-5ec1-4bc6-bc54-0ef26a507ea2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:23.424642 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-9e479c7b-5ec1-4bc6-bc54-0ef26a507ea2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:23.432923 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-9e479c7b-5ec1-4bc6-bc54-0ef26a507ea2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.157265 Apr 08 11:22:23.433514 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 404/801] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:23 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:23.576140 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-eab0dfff-bb08-4706-8200-1804d41d3bd0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:23.576755 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-eab0dfff-bb08-4706-8200-1804d41d3bd0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:23.583200 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-eab0dfff-bb08-4706-8200-1804d41d3bd0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:23.583662 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-eab0dfff-bb08-4706-8200-1804d41d3bd0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:23.584450 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-eab0dfff-bb08-4706-8200-1804d41d3bd0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:23.584919 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-eab0dfff-bb08-4706-8200-1804d41d3bd0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:23.646801 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-eab0dfff-bb08-4706-8200-1804d41d3bd0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:23.655139 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-eab0dfff-bb08-4706-8200-1804d41d3bd0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082877 Apr 08 11:22:23.655726 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 398/802] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:23 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:23.796369 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-faf3fd5a-0e05-4c31-ade9-1fbad7045e70 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:23.796990 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-faf3fd5a-0e05-4c31-ade9-1fbad7045e70 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:23.804279 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-faf3fd5a-0e05-4c31-ade9-1fbad7045e70 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:23.804733 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-faf3fd5a-0e05-4c31-ade9-1fbad7045e70 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:23.805526 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-faf3fd5a-0e05-4c31-ade9-1fbad7045e70 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:23.805998 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-faf3fd5a-0e05-4c31-ade9-1fbad7045e70 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:23.956530 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-faf3fd5a-0e05-4c31-ade9-1fbad7045e70 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:23.966293 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-faf3fd5a-0e05-4c31-ade9-1fbad7045e70 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:23.967831 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-faf3fd5a-0e05-4c31-ade9-1fbad7045e70 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:23.969061 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-faf3fd5a-0e05-4c31-ade9-1fbad7045e70 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.176665 Apr 08 11:22:23.969648 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 405/803] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:23 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:24.451651 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-43bd7ad8-b774-407b-88c2-2998a026fde9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:24.452273 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-43bd7ad8-b774-407b-88c2-2998a026fde9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:24.458298 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-43bd7ad8-b774-407b-88c2-2998a026fde9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:24.458756 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-43bd7ad8-b774-407b-88c2-2998a026fde9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:24.459548 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-43bd7ad8-b774-407b-88c2-2998a026fde9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:24.460000 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-43bd7ad8-b774-407b-88c2-2998a026fde9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:24.596816 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-43bd7ad8-b774-407b-88c2-2998a026fde9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:24.604913 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-43bd7ad8-b774-407b-88c2-2998a026fde9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.157206 Apr 08 11:22:24.605501 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 399/804] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:24 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:24.672816 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-87da4310-11dd-43c0-a0d1-cf4bb909eaee tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:24.673427 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-87da4310-11dd-43c0-a0d1-cf4bb909eaee tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:24.680253 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-87da4310-11dd-43c0-a0d1-cf4bb909eaee tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:24.680706 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-87da4310-11dd-43c0-a0d1-cf4bb909eaee tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:24.681494 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-87da4310-11dd-43c0-a0d1-cf4bb909eaee tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:24.681987 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-87da4310-11dd-43c0-a0d1-cf4bb909eaee tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:24.746840 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-87da4310-11dd-43c0-a0d1-cf4bb909eaee tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:24.754223 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-87da4310-11dd-43c0-a0d1-cf4bb909eaee tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.085306 Apr 08 11:22:24.754847 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 406/805] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:24 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:24.988110 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b04dd0ee-d1e4-4dcc-b3ee-22c1073ebd10 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:24.988731 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b04dd0ee-d1e4-4dcc-b3ee-22c1073ebd10 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:24.996271 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b04dd0ee-d1e4-4dcc-b3ee-22c1073ebd10 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:24.996658 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b04dd0ee-d1e4-4dcc-b3ee-22c1073ebd10 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:24.997678 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b04dd0ee-d1e4-4dcc-b3ee-22c1073ebd10 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:24.998512 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b04dd0ee-d1e4-4dcc-b3ee-22c1073ebd10 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:25.140974 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b04dd0ee-d1e4-4dcc-b3ee-22c1073ebd10 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:25.152322 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b04dd0ee-d1e4-4dcc-b3ee-22c1073ebd10 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:25.153953 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b04dd0ee-d1e4-4dcc-b3ee-22c1073ebd10 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:25.155222 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b04dd0ee-d1e4-4dcc-b3ee-22c1073ebd10 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.171014 Apr 08 11:22:25.155809 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 400/806] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:24 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:25.622977 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-ab11f1ce-dc4c-480b-bfc2-3afb24b74497 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:25.624571 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-ab11f1ce-dc4c-480b-bfc2-3afb24b74497 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:25.630272 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ab11f1ce-dc4c-480b-bfc2-3afb24b74497 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:25.630725 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ab11f1ce-dc4c-480b-bfc2-3afb24b74497 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:25.631516 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ab11f1ce-dc4c-480b-bfc2-3afb24b74497 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:25.631956 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ab11f1ce-dc4c-480b-bfc2-3afb24b74497 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:25.771372 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0fb0c0d1-112f-4432-a4d9-f33dc86d8034 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:25.771997 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0fb0c0d1-112f-4432-a4d9-f33dc86d8034 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:25.778075 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-ab11f1ce-dc4c-480b-bfc2-3afb24b74497 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:25.778246 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0fb0c0d1-112f-4432-a4d9-f33dc86d8034 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:25.778554 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0fb0c0d1-112f-4432-a4d9-f33dc86d8034 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:25.779346 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0fb0c0d1-112f-4432-a4d9-f33dc86d8034 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:25.779792 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0fb0c0d1-112f-4432-a4d9-f33dc86d8034 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:25.788133 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-ab11f1ce-dc4c-480b-bfc2-3afb24b74497 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.169007 Apr 08 11:22:25.789052 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 407/807] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:25 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:25.846171 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0fb0c0d1-112f-4432-a4d9-f33dc86d8034 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:25.853708 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0fb0c0d1-112f-4432-a4d9-f33dc86d8034 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.086774 Apr 08 11:22:25.854304 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 401/808] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:25 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:22:26.174371 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-880d901c-a51b-4eb2-a493-4cc59e40ae0a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:26.174987 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-880d901c-a51b-4eb2-a493-4cc59e40ae0a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:26.181531 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-880d901c-a51b-4eb2-a493-4cc59e40ae0a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:26.182029 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-880d901c-a51b-4eb2-a493-4cc59e40ae0a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:26.182838 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-880d901c-a51b-4eb2-a493-4cc59e40ae0a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:26.183309 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-880d901c-a51b-4eb2-a493-4cc59e40ae0a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:26.315722 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-880d901c-a51b-4eb2-a493-4cc59e40ae0a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:26.325195 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-880d901c-a51b-4eb2-a493-4cc59e40ae0a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:26.326737 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-880d901c-a51b-4eb2-a493-4cc59e40ae0a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:26.327903 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-880d901c-a51b-4eb2-a493-4cc59e40ae0a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.157535 Apr 08 11:22:26.328464 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 408/809] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:26 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:26.807118 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-120a04a2-454e-4d1c-a50b-937d891c5dfb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:26.807845 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-120a04a2-454e-4d1c-a50b-937d891c5dfb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:26.813945 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-120a04a2-454e-4d1c-a50b-937d891c5dfb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:26.814401 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-120a04a2-454e-4d1c-a50b-937d891c5dfb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:26.815172 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-120a04a2-454e-4d1c-a50b-937d891c5dfb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:26.815613 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-120a04a2-454e-4d1c-a50b-937d891c5dfb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:26.871220 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-742fb360-cfdd-47cd-9f69-259eb395a264 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:26.871811 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-742fb360-cfdd-47cd-9f69-259eb395a264 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:26.878162 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-742fb360-cfdd-47cd-9f69-259eb395a264 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:26.878613 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-742fb360-cfdd-47cd-9f69-259eb395a264 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:26.879376 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-742fb360-cfdd-47cd-9f69-259eb395a264 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:26.879809 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-742fb360-cfdd-47cd-9f69-259eb395a264 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:26.950596 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-742fb360-cfdd-47cd-9f69-259eb395a264 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:26.958444 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-742fb360-cfdd-47cd-9f69-259eb395a264 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.090773 Apr 08 11:22:26.959023 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 409/810] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:26 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:22:26.976940 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-120a04a2-454e-4d1c-a50b-937d891c5dfb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:26.984319 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-120a04a2-454e-4d1c-a50b-937d891c5dfb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.181165 Apr 08 11:22:26.984882 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 402/811] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:26 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:27.345909 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-aacc8ef1-24ec-43f4-866e-c597fe7dedd7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:27.346523 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-aacc8ef1-24ec-43f4-866e-c597fe7dedd7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:27.352400 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-aacc8ef1-24ec-43f4-866e-c597fe7dedd7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:27.352858 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-aacc8ef1-24ec-43f4-866e-c597fe7dedd7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:27.353626 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-aacc8ef1-24ec-43f4-866e-c597fe7dedd7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:27.354094 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-aacc8ef1-24ec-43f4-866e-c597fe7dedd7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:27.486118 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-aacc8ef1-24ec-43f4-866e-c597fe7dedd7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:27.495965 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-aacc8ef1-24ec-43f4-866e-c597fe7dedd7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:27.497483 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-aacc8ef1-24ec-43f4-866e-c597fe7dedd7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:27.498687 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-aacc8ef1-24ec-43f4-866e-c597fe7dedd7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.156735 Apr 08 11:22:27.499243 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 410/812] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:27 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:27.975963 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-22e8aea8-7b60-49de-87b3-4a6b8349a3d6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:27.976499 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-22e8aea8-7b60-49de-87b3-4a6b8349a3d6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:27.983000 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-22e8aea8-7b60-49de-87b3-4a6b8349a3d6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:27.983792 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-22e8aea8-7b60-49de-87b3-4a6b8349a3d6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:27.984235 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-22e8aea8-7b60-49de-87b3-4a6b8349a3d6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:27.984937 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-22e8aea8-7b60-49de-87b3-4a6b8349a3d6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:28.001941 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-450665a1-9f73-42cf-accf-ef729df6af24 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:28.002584 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-450665a1-9f73-42cf-accf-ef729df6af24 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:28.009255 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-450665a1-9f73-42cf-accf-ef729df6af24 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:28.009704 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-450665a1-9f73-42cf-accf-ef729df6af24 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:28.010569 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-450665a1-9f73-42cf-accf-ef729df6af24 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:28.011011 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-450665a1-9f73-42cf-accf-ef729df6af24 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:28.046982 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-22e8aea8-7b60-49de-87b3-4a6b8349a3d6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:28.054796 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-22e8aea8-7b60-49de-87b3-4a6b8349a3d6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.083617 Apr 08 11:22:28.058275 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 403/813] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:27 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:28.154574 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-450665a1-9f73-42cf-accf-ef729df6af24 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:28.162150 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-450665a1-9f73-42cf-accf-ef729df6af24 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.164765 Apr 08 11:22:28.167755 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 411/814] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:27 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:22:28.517110 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-65fda332-3531-484c-a405-832a91102569 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:28.517717 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-65fda332-3531-484c-a405-832a91102569 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:28.523658 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-65fda332-3531-484c-a405-832a91102569 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:28.524104 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-65fda332-3531-484c-a405-832a91102569 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:28.524869 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-65fda332-3531-484c-a405-832a91102569 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:28.525304 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-65fda332-3531-484c-a405-832a91102569 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:28.657164 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-65fda332-3531-484c-a405-832a91102569 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:28.665360 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-65fda332-3531-484c-a405-832a91102569 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:28.666898 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-65fda332-3531-484c-a405-832a91102569 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:28.668040 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-65fda332-3531-484c-a405-832a91102569 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.154817 Apr 08 11:22:28.668598 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 404/815] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:28 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:29.071276 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a46d6b4a-b8da-41df-bb3b-a98d4f22b842 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:29.071865 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a46d6b4a-b8da-41df-bb3b-a98d4f22b842 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:29.078327 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a46d6b4a-b8da-41df-bb3b-a98d4f22b842 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:29.078777 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a46d6b4a-b8da-41df-bb3b-a98d4f22b842 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:29.079549 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a46d6b4a-b8da-41df-bb3b-a98d4f22b842 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:29.079996 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a46d6b4a-b8da-41df-bb3b-a98d4f22b842 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:29.139847 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a46d6b4a-b8da-41df-bb3b-a98d4f22b842 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:29.147889 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a46d6b4a-b8da-41df-bb3b-a98d4f22b842 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081047 Apr 08 11:22:29.148460 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 412/816] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:29 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:29.179746 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-57c65290-dca8-4a50-8e5f-fe3c05110177 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:29.192807 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-57c65290-dca8-4a50-8e5f-fe3c05110177 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:29.192807 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-57c65290-dca8-4a50-8e5f-fe3c05110177 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:29.192807 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-57c65290-dca8-4a50-8e5f-fe3c05110177 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:29.192807 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-57c65290-dca8-4a50-8e5f-fe3c05110177 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:29.193354 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-57c65290-dca8-4a50-8e5f-fe3c05110177 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:29.325989 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-57c65290-dca8-4a50-8e5f-fe3c05110177 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:29.333370 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-57c65290-dca8-4a50-8e5f-fe3c05110177 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.157918 Apr 08 11:22:29.333962 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 405/817] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:29 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:29.687446 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-dd721162-df76-493e-aecd-30e0a08e9031 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:29.688063 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-dd721162-df76-493e-aecd-30e0a08e9031 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:29.694155 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dd721162-df76-493e-aecd-30e0a08e9031 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:29.694613 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dd721162-df76-493e-aecd-30e0a08e9031 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:29.695397 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dd721162-df76-493e-aecd-30e0a08e9031 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:29.695841 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dd721162-df76-493e-aecd-30e0a08e9031 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:29.835075 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-dd721162-df76-493e-aecd-30e0a08e9031 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:29.844920 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-dd721162-df76-493e-aecd-30e0a08e9031 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:29.846485 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-dd721162-df76-493e-aecd-30e0a08e9031 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:29.847675 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-dd721162-df76-493e-aecd-30e0a08e9031 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.164175 Apr 08 11:22:29.848760 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 413/818] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:29 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:30.164826 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ced2e8fc-946c-4d72-bc27-09b760ef4fd7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:30.165437 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ced2e8fc-946c-4d72-bc27-09b760ef4fd7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:30.171939 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ced2e8fc-946c-4d72-bc27-09b760ef4fd7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:30.172381 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ced2e8fc-946c-4d72-bc27-09b760ef4fd7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:30.173166 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ced2e8fc-946c-4d72-bc27-09b760ef4fd7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:30.173600 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ced2e8fc-946c-4d72-bc27-09b760ef4fd7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:30.235871 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ced2e8fc-946c-4d72-bc27-09b760ef4fd7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:30.244000 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ced2e8fc-946c-4d72-bc27-09b760ef4fd7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.083724 Apr 08 11:22:30.244882 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 406/819] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:30 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:30.350401 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-684de2b3-0b56-4621-86ff-8b5bfc639e0c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:30.351030 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-684de2b3-0b56-4621-86ff-8b5bfc639e0c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:30.357653 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-684de2b3-0b56-4621-86ff-8b5bfc639e0c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:30.358135 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-684de2b3-0b56-4621-86ff-8b5bfc639e0c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:30.358928 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-684de2b3-0b56-4621-86ff-8b5bfc639e0c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:30.359373 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-684de2b3-0b56-4621-86ff-8b5bfc639e0c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:30.505105 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-684de2b3-0b56-4621-86ff-8b5bfc639e0c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:30.512689 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-684de2b3-0b56-4621-86ff-8b5bfc639e0c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.166224 Apr 08 11:22:30.513260 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 414/820] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:30 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:30.865809 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-41d24777-3c20-46a8-9096-58deed46abd7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:30.866423 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-41d24777-3c20-46a8-9096-58deed46abd7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:30.872693 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-41d24777-3c20-46a8-9096-58deed46abd7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:30.873148 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-41d24777-3c20-46a8-9096-58deed46abd7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:30.873948 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-41d24777-3c20-46a8-9096-58deed46abd7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:30.874389 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-41d24777-3c20-46a8-9096-58deed46abd7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:31.004769 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-41d24777-3c20-46a8-9096-58deed46abd7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:31.013002 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-41d24777-3c20-46a8-9096-58deed46abd7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:31.014524 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-41d24777-3c20-46a8-9096-58deed46abd7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:31.015654 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-41d24777-3c20-46a8-9096-58deed46abd7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.153793 Apr 08 11:22:31.016215 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 407/821] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:30 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:31.261024 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-245f0158-4642-41ed-8551-4c84f9cffab8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:31.261628 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-245f0158-4642-41ed-8551-4c84f9cffab8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:31.267951 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-245f0158-4642-41ed-8551-4c84f9cffab8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:31.268416 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-245f0158-4642-41ed-8551-4c84f9cffab8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:31.269191 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-245f0158-4642-41ed-8551-4c84f9cffab8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:31.269801 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-245f0158-4642-41ed-8551-4c84f9cffab8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:31.333063 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-245f0158-4642-41ed-8551-4c84f9cffab8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:31.341951 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-245f0158-4642-41ed-8551-4c84f9cffab8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.084678 Apr 08 11:22:31.342531 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 415/822] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:31 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:31.625882 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-18ec85f3-4937-4f0d-8b63-7d2e89bf3a75 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:31.626512 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-18ec85f3-4937-4f0d-8b63-7d2e89bf3a75 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:31.632923 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-18ec85f3-4937-4f0d-8b63-7d2e89bf3a75 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:31.633365 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-18ec85f3-4937-4f0d-8b63-7d2e89bf3a75 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:31.634152 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-18ec85f3-4937-4f0d-8b63-7d2e89bf3a75 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:31.634586 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-18ec85f3-4937-4f0d-8b63-7d2e89bf3a75 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:31.769075 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-18ec85f3-4937-4f0d-8b63-7d2e89bf3a75 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:31.776898 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-18ec85f3-4937-4f0d-8b63-7d2e89bf3a75 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.250125 Apr 08 11:22:31.781744 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 408/823] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:31 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:32.034455 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-3e30aea9-bdbb-4fa0-9a87-a66a83885f67 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:32.035067 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-3e30aea9-bdbb-4fa0-9a87-a66a83885f67 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:32.041562 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3e30aea9-bdbb-4fa0-9a87-a66a83885f67 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:32.041999 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3e30aea9-bdbb-4fa0-9a87-a66a83885f67 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:32.044766 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3e30aea9-bdbb-4fa0-9a87-a66a83885f67 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:32.044766 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3e30aea9-bdbb-4fa0-9a87-a66a83885f67 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:32.199192 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-3e30aea9-bdbb-4fa0-9a87-a66a83885f67 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:32.207571 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-3e30aea9-bdbb-4fa0-9a87-a66a83885f67 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:32.209096 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-3e30aea9-bdbb-4fa0-9a87-a66a83885f67 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:32.210323 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-3e30aea9-bdbb-4fa0-9a87-a66a83885f67 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.179852 Apr 08 11:22:32.210892 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 416/824] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:32 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:32.358792 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f151edfc-2c0b-4700-a8b7-0be0270c0a85 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:32.359351 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f151edfc-2c0b-4700-a8b7-0be0270c0a85 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:32.365842 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f151edfc-2c0b-4700-a8b7-0be0270c0a85 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:32.366293 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f151edfc-2c0b-4700-a8b7-0be0270c0a85 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:32.369624 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f151edfc-2c0b-4700-a8b7-0be0270c0a85 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:32.369624 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f151edfc-2c0b-4700-a8b7-0be0270c0a85 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:32.430935 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f151edfc-2c0b-4700-a8b7-0be0270c0a85 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:32.438534 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f151edfc-2c0b-4700-a8b7-0be0270c0a85 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.083740 Apr 08 11:22:32.439193 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 409/825] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:32 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:32.794613 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-77c1748b-7c66-4452-9115-cbbbb4cb9965 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:32.795234 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-77c1748b-7c66-4452-9115-cbbbb4cb9965 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:32.801649 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-77c1748b-7c66-4452-9115-cbbbb4cb9965 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:32.802131 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-77c1748b-7c66-4452-9115-cbbbb4cb9965 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:32.802905 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-77c1748b-7c66-4452-9115-cbbbb4cb9965 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:32.803350 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-77c1748b-7c66-4452-9115-cbbbb4cb9965 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:32.936098 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-77c1748b-7c66-4452-9115-cbbbb4cb9965 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:32.943677 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-77c1748b-7c66-4452-9115-cbbbb4cb9965 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.152977 Apr 08 11:22:32.944241 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 417/826] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:32 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:33.229590 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1119e2c8-f72e-4b62-a1a7-852ead8e4016 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:33.230204 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1119e2c8-f72e-4b62-a1a7-852ead8e4016 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:33.236298 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1119e2c8-f72e-4b62-a1a7-852ead8e4016 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:33.236747 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1119e2c8-f72e-4b62-a1a7-852ead8e4016 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:33.237519 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1119e2c8-f72e-4b62-a1a7-852ead8e4016 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:33.238003 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1119e2c8-f72e-4b62-a1a7-852ead8e4016 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:33.368273 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1119e2c8-f72e-4b62-a1a7-852ead8e4016 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:33.376741 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1119e2c8-f72e-4b62-a1a7-852ead8e4016 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:33.378258 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1119e2c8-f72e-4b62-a1a7-852ead8e4016 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:33.380068 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1119e2c8-f72e-4b62-a1a7-852ead8e4016 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.154979 Apr 08 11:22:33.380649 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 410/827] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:33 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:22:33.455871 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-577a5eaa-f8d1-4658-8b90-91991d9f2501 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:33.456484 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-577a5eaa-f8d1-4658-8b90-91991d9f2501 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:33.463474 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-577a5eaa-f8d1-4658-8b90-91991d9f2501 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:33.463924 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-577a5eaa-f8d1-4658-8b90-91991d9f2501 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:33.464692 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-577a5eaa-f8d1-4658-8b90-91991d9f2501 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:33.465130 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-577a5eaa-f8d1-4658-8b90-91991d9f2501 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:33.528751 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-577a5eaa-f8d1-4658-8b90-91991d9f2501 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:33.536734 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-577a5eaa-f8d1-4658-8b90-91991d9f2501 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.084709 Apr 08 11:22:33.537511 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 418/828] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:33 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:22:33.962075 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-98f99b91-ac2f-4d75-b44d-b4c0037e0f2a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:33.962697 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-98f99b91-ac2f-4d75-b44d-b4c0037e0f2a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:33.968724 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-98f99b91-ac2f-4d75-b44d-b4c0037e0f2a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:33.969178 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-98f99b91-ac2f-4d75-b44d-b4c0037e0f2a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:33.969982 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-98f99b91-ac2f-4d75-b44d-b4c0037e0f2a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:33.970426 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-98f99b91-ac2f-4d75-b44d-b4c0037e0f2a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:34.104987 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-98f99b91-ac2f-4d75-b44d-b4c0037e0f2a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:34.112329 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-98f99b91-ac2f-4d75-b44d-b4c0037e0f2a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.155471 Apr 08 11:22:34.112895 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 411/829] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:33 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:34.399243 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-7a312b03-1c86-44f8-af63-f9bf635f7c50 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:34.399774 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-7a312b03-1c86-44f8-af63-f9bf635f7c50 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:34.405961 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7a312b03-1c86-44f8-af63-f9bf635f7c50 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:34.406411 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7a312b03-1c86-44f8-af63-f9bf635f7c50 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:34.407184 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7a312b03-1c86-44f8-af63-f9bf635f7c50 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:34.407624 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7a312b03-1c86-44f8-af63-f9bf635f7c50 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:34.540561 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-7a312b03-1c86-44f8-af63-f9bf635f7c50 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:34.548884 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-7a312b03-1c86-44f8-af63-f9bf635f7c50 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:34.550441 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-7a312b03-1c86-44f8-af63-f9bf635f7c50 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:34.552129 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-7a312b03-1c86-44f8-af63-f9bf635f7c50 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.157509 Apr 08 11:22:34.552683 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 419/830] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:34 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:34.552806 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8d3f8c5d-bd29-4e55-bb41-79a8097c1da2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:34.553353 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8d3f8c5d-bd29-4e55-bb41-79a8097c1da2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:34.559624 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8d3f8c5d-bd29-4e55-bb41-79a8097c1da2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:34.560078 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8d3f8c5d-bd29-4e55-bb41-79a8097c1da2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:34.560846 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8d3f8c5d-bd29-4e55-bb41-79a8097c1da2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:34.561285 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8d3f8c5d-bd29-4e55-bb41-79a8097c1da2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:34.633839 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8d3f8c5d-bd29-4e55-bb41-79a8097c1da2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:34.641107 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8d3f8c5d-bd29-4e55-bb41-79a8097c1da2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.092665 Apr 08 11:22:34.641677 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 412/831] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:34 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:22:35.026848 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-7ff4190f-6abb-4bfa-87a8-a4247601c1fe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:35.027349 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-7ff4190f-6abb-4bfa-87a8-a4247601c1fe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:35.033336 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7ff4190f-6abb-4bfa-87a8-a4247601c1fe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:35.033847 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7ff4190f-6abb-4bfa-87a8-a4247601c1fe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:35.034884 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7ff4190f-6abb-4bfa-87a8-a4247601c1fe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:35.035717 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7ff4190f-6abb-4bfa-87a8-a4247601c1fe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:35.124432 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.objects.instance [None req-7ff4190f-6abb-4bfa-87a8-a4247601c1fe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lazy-loading 'services' on Instance uuid bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 {{(pid=117801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 11:22:35.130030 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e426ebb7-238c-4c98-be17-bcff072f8680 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:35.130639 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e426ebb7-238c-4c98-be17-bcff072f8680 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:35.136502 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e426ebb7-238c-4c98-be17-bcff072f8680 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:35.136961 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e426ebb7-238c-4c98-be17-bcff072f8680 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:35.137727 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e426ebb7-238c-4c98-be17-bcff072f8680 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:35.138179 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e426ebb7-238c-4c98-be17-bcff072f8680 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:35.288874 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e426ebb7-238c-4c98-be17-bcff072f8680 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:35.296453 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e426ebb7-238c-4c98-be17-bcff072f8680 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.170399 Apr 08 11:22:35.297056 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 413/832] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:35 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:22:35.424199 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-7ff4190f-6abb-4bfa-87a8-a4247601c1fe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "DELETE /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments/6945a5b2-ef63-469c-9b0d-2b0a67470855" status: 202 len: 0 microversion: 2.1 time: 0.401194 Apr 08 11:22:35.424798 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 420/833] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Apr 8 11:22:35 2022] DELETE /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments/6945a5b2-ef63-469c-9b0d-2b0a67470855 => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 11:22:35.433442 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d84d26be-7854-465e-9133-862e0ccccd89 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:35.434531 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d84d26be-7854-465e-9133-862e0ccccd89 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:35.440585 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d84d26be-7854-465e-9133-862e0ccccd89 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:35.441529 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d84d26be-7854-465e-9133-862e0ccccd89 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:35.441950 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d84d26be-7854-465e-9133-862e0ccccd89 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:35.442425 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d84d26be-7854-465e-9133-862e0ccccd89 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:35.475635 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d84d26be-7854-465e-9133-862e0ccccd89 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046204 Apr 08 11:22:35.476246 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 414/834] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:22:35 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:22:35.571794 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e5431558-3f36-47e2-8696-d558d81fa7f3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:35.572548 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e5431558-3f36-47e2-8696-d558d81fa7f3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:35.578894 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e5431558-3f36-47e2-8696-d558d81fa7f3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:35.579350 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e5431558-3f36-47e2-8696-d558d81fa7f3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:35.580142 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e5431558-3f36-47e2-8696-d558d81fa7f3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:35.580591 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e5431558-3f36-47e2-8696-d558d81fa7f3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:35.659644 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6b8088b4-c5a9-4bbc-bbc8-41ad2532874d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:35.660592 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6b8088b4-c5a9-4bbc-bbc8-41ad2532874d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:35.668056 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6b8088b4-c5a9-4bbc-bbc8-41ad2532874d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:35.668510 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6b8088b4-c5a9-4bbc-bbc8-41ad2532874d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:35.669293 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6b8088b4-c5a9-4bbc-bbc8-41ad2532874d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:35.669727 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6b8088b4-c5a9-4bbc-bbc8-41ad2532874d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:35.741341 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6b8088b4-c5a9-4bbc-bbc8-41ad2532874d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:35.750358 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6b8088b4-c5a9-4bbc-bbc8-41ad2532874d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.095378 Apr 08 11:22:35.751401 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 415/835] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:35 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:22:35.772528 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e5431558-3f36-47e2-8696-d558d81fa7f3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:35.781612 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e5431558-3f36-47e2-8696-d558d81fa7f3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:35.783267 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e5431558-3f36-47e2-8696-d558d81fa7f3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:35.787239 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e5431558-3f36-47e2-8696-d558d81fa7f3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1752 microversion: 2.20 time: 0.218034 Apr 08 11:22:35.787239 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 421/836] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:35 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1752 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:36.313842 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d3cb10a4-7248-4506-9f75-cc8f17d6baca tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:36.314485 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d3cb10a4-7248-4506-9f75-cc8f17d6baca tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:36.320474 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d3cb10a4-7248-4506-9f75-cc8f17d6baca tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:36.320920 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d3cb10a4-7248-4506-9f75-cc8f17d6baca tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:36.321690 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d3cb10a4-7248-4506-9f75-cc8f17d6baca tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:36.322153 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d3cb10a4-7248-4506-9f75-cc8f17d6baca tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:36.459071 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d3cb10a4-7248-4506-9f75-cc8f17d6baca tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:36.466915 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d3cb10a4-7248-4506-9f75-cc8f17d6baca tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.156891 Apr 08 11:22:36.467493 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 416/837] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:36 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:36.489661 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-92568223-87e7-4f04-b3d5-ef2e67268074 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:36.490715 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-92568223-87e7-4f04-b3d5-ef2e67268074 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:36.497069 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-92568223-87e7-4f04-b3d5-ef2e67268074 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:36.497523 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-92568223-87e7-4f04-b3d5-ef2e67268074 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:36.498334 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-92568223-87e7-4f04-b3d5-ef2e67268074 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:36.498773 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-92568223-87e7-4f04-b3d5-ef2e67268074 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:36.530236 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-92568223-87e7-4f04-b3d5-ef2e67268074 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044666 Apr 08 11:22:36.531129 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 422/838] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:22:36 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:22:36.768225 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-aaf67177-d90c-4cdf-98ed-c826aa75b1bf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:36.768840 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-aaf67177-d90c-4cdf-98ed-c826aa75b1bf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:36.775721 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aaf67177-d90c-4cdf-98ed-c826aa75b1bf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:36.776176 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aaf67177-d90c-4cdf-98ed-c826aa75b1bf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:36.776962 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aaf67177-d90c-4cdf-98ed-c826aa75b1bf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:36.777409 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aaf67177-d90c-4cdf-98ed-c826aa75b1bf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:36.809221 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-3744dfe8-46fd-4c43-bfae-7c4499e8b3f4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:36.809872 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-3744dfe8-46fd-4c43-bfae-7c4499e8b3f4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:36.818584 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3744dfe8-46fd-4c43-bfae-7c4499e8b3f4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:36.819046 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3744dfe8-46fd-4c43-bfae-7c4499e8b3f4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:36.819850 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3744dfe8-46fd-4c43-bfae-7c4499e8b3f4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:36.820283 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3744dfe8-46fd-4c43-bfae-7c4499e8b3f4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:36.843267 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-aaf67177-d90c-4cdf-98ed-c826aa75b1bf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:36.851669 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-aaf67177-d90c-4cdf-98ed-c826aa75b1bf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.087183 Apr 08 11:22:36.852258 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 417/839] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:36 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:36.971916 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-3744dfe8-46fd-4c43-bfae-7c4499e8b3f4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:36.981290 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-3744dfe8-46fd-4c43-bfae-7c4499e8b3f4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:36.982846 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-3744dfe8-46fd-4c43-bfae-7c4499e8b3f4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:36.984001 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-3744dfe8-46fd-4c43-bfae-7c4499e8b3f4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.183505 Apr 08 11:22:36.984574 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 423/840] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:36 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:22:37.485268 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-11cccd24-272b-46c6-a013-efe9ce8b2b90 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:37.486105 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-11cccd24-272b-46c6-a013-efe9ce8b2b90 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:37.492821 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-11cccd24-272b-46c6-a013-efe9ce8b2b90 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:37.493274 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-11cccd24-272b-46c6-a013-efe9ce8b2b90 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:37.494082 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-11cccd24-272b-46c6-a013-efe9ce8b2b90 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:37.494513 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-11cccd24-272b-46c6-a013-efe9ce8b2b90 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:37.542912 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-97d9d5ac-989b-43ad-bc67-751cb7825a3d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:37.543941 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-97d9d5ac-989b-43ad-bc67-751cb7825a3d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:37.551075 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-97d9d5ac-989b-43ad-bc67-751cb7825a3d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:37.551533 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-97d9d5ac-989b-43ad-bc67-751cb7825a3d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:37.552336 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-97d9d5ac-989b-43ad-bc67-751cb7825a3d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:37.552981 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-97d9d5ac-989b-43ad-bc67-751cb7825a3d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:37.590874 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-97d9d5ac-989b-43ad-bc67-751cb7825a3d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051913 Apr 08 11:22:37.591734 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 424/841] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:22:37 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:22:37.641016 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-11cccd24-272b-46c6-a013-efe9ce8b2b90 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:37.649254 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-11cccd24-272b-46c6-a013-efe9ce8b2b90 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.168111 Apr 08 11:22:37.649882 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 418/842] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:37 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:37.871939 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-4bbeb2aa-2b0a-40b7-8d52-1bafd908513e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:37.872597 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-4bbeb2aa-2b0a-40b7-8d52-1bafd908513e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:37.879226 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4bbeb2aa-2b0a-40b7-8d52-1bafd908513e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:37.879685 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4bbeb2aa-2b0a-40b7-8d52-1bafd908513e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:37.880474 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4bbeb2aa-2b0a-40b7-8d52-1bafd908513e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:37.880944 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4bbeb2aa-2b0a-40b7-8d52-1bafd908513e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:37.944161 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-4bbeb2aa-2b0a-40b7-8d52-1bafd908513e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:37.951833 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-4bbeb2aa-2b0a-40b7-8d52-1bafd908513e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.084176 Apr 08 11:22:37.952429 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 425/843] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:37 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:38.002727 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3484c830-728d-429a-ab4b-b643a9f10113 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:38.003342 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3484c830-728d-429a-ab4b-b643a9f10113 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:38.009903 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3484c830-728d-429a-ab4b-b643a9f10113 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:38.010354 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3484c830-728d-429a-ab4b-b643a9f10113 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:38.011140 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3484c830-728d-429a-ab4b-b643a9f10113 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:38.011580 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3484c830-728d-429a-ab4b-b643a9f10113 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:38.152453 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3484c830-728d-429a-ab4b-b643a9f10113 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:38.161975 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3484c830-728d-429a-ab4b-b643a9f10113 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:38.163487 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3484c830-728d-429a-ab4b-b643a9f10113 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:38.164676 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3484c830-728d-429a-ab4b-b643a9f10113 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.165937 Apr 08 11:22:38.165242 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 419/844] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:37 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:38.606586 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-edc4af72-7d3a-40e7-921a-6e84a5d7dd39 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:38.606586 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-edc4af72-7d3a-40e7-921a-6e84a5d7dd39 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:38.612708 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-edc4af72-7d3a-40e7-921a-6e84a5d7dd39 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:38.613164 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-edc4af72-7d3a-40e7-921a-6e84a5d7dd39 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:38.613979 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-edc4af72-7d3a-40e7-921a-6e84a5d7dd39 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:38.614440 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-edc4af72-7d3a-40e7-921a-6e84a5d7dd39 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:38.645261 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-edc4af72-7d3a-40e7-921a-6e84a5d7dd39 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046932 Apr 08 11:22:38.646237 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 426/845] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:22:38 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:22:38.673392 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f181fc01-7e43-4693-b430-00b578b53543 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:38.674023 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f181fc01-7e43-4693-b430-00b578b53543 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:38.679878 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f181fc01-7e43-4693-b430-00b578b53543 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:38.680323 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f181fc01-7e43-4693-b430-00b578b53543 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:38.681078 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f181fc01-7e43-4693-b430-00b578b53543 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:38.681533 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f181fc01-7e43-4693-b430-00b578b53543 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:38.812743 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f181fc01-7e43-4693-b430-00b578b53543 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:38.820972 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f181fc01-7e43-4693-b430-00b578b53543 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.151359 Apr 08 11:22:38.821544 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 420/846] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:38 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:38.968371 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-18091594-b2df-4044-850c-e74b760bd6d9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:38.968901 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-18091594-b2df-4044-850c-e74b760bd6d9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:38.975177 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-18091594-b2df-4044-850c-e74b760bd6d9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:38.975625 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-18091594-b2df-4044-850c-e74b760bd6d9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:38.976419 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-18091594-b2df-4044-850c-e74b760bd6d9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:38.976855 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-18091594-b2df-4044-850c-e74b760bd6d9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:39.035472 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-18091594-b2df-4044-850c-e74b760bd6d9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:39.042868 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-18091594-b2df-4044-850c-e74b760bd6d9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078406 Apr 08 11:22:39.043436 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 427/847] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:38 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:39.182974 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bbae96bc-2020-4cce-a040-e7500fe6dd9e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:39.183590 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-bbae96bc-2020-4cce-a040-e7500fe6dd9e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:39.189972 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bbae96bc-2020-4cce-a040-e7500fe6dd9e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:39.190430 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bbae96bc-2020-4cce-a040-e7500fe6dd9e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:39.191535 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bbae96bc-2020-4cce-a040-e7500fe6dd9e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:39.191987 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bbae96bc-2020-4cce-a040-e7500fe6dd9e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:39.328505 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-bbae96bc-2020-4cce-a040-e7500fe6dd9e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:39.337559 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-bbae96bc-2020-4cce-a040-e7500fe6dd9e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:39.339094 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-bbae96bc-2020-4cce-a040-e7500fe6dd9e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:39.340258 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-bbae96bc-2020-4cce-a040-e7500fe6dd9e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.161198 Apr 08 11:22:39.340878 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 421/848] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:39 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:39.656554 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-ede182d2-adfb-4c0e-b15c-4d637e3dc86c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:39.657494 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-ede182d2-adfb-4c0e-b15c-4d637e3dc86c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:39.663576 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ede182d2-adfb-4c0e-b15c-4d637e3dc86c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:39.664114 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ede182d2-adfb-4c0e-b15c-4d637e3dc86c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:39.664908 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ede182d2-adfb-4c0e-b15c-4d637e3dc86c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:39.665367 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ede182d2-adfb-4c0e-b15c-4d637e3dc86c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:39.694163 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-ede182d2-adfb-4c0e-b15c-4d637e3dc86c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041488 Apr 08 11:22:39.694719 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 428/849] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:22:39 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:22:39.838156 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4349704d-cdec-4419-9f9a-00f023548bc4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:39.838772 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4349704d-cdec-4419-9f9a-00f023548bc4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:39.845103 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4349704d-cdec-4419-9f9a-00f023548bc4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:39.845557 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4349704d-cdec-4419-9f9a-00f023548bc4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:39.846361 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4349704d-cdec-4419-9f9a-00f023548bc4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:39.846785 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4349704d-cdec-4419-9f9a-00f023548bc4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:39.978192 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4349704d-cdec-4419-9f9a-00f023548bc4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:39.985541 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4349704d-cdec-4419-9f9a-00f023548bc4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.151212 Apr 08 11:22:39.986141 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 422/850] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:39 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:40.059835 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-acead060-883e-4894-bc88-64ee9fdf4f59 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:40.060451 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-acead060-883e-4894-bc88-64ee9fdf4f59 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:40.067288 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-acead060-883e-4894-bc88-64ee9fdf4f59 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:40.067727 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-acead060-883e-4894-bc88-64ee9fdf4f59 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:40.068502 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-acead060-883e-4894-bc88-64ee9fdf4f59 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:40.068952 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-acead060-883e-4894-bc88-64ee9fdf4f59 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:40.126821 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-acead060-883e-4894-bc88-64ee9fdf4f59 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:40.134713 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-acead060-883e-4894-bc88-64ee9fdf4f59 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078791 Apr 08 11:22:40.135279 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 429/851] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:40 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:40.358489 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0663d7bc-70b0-4aef-a8fb-29de699b0bd0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:40.359106 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0663d7bc-70b0-4aef-a8fb-29de699b0bd0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:40.365344 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0663d7bc-70b0-4aef-a8fb-29de699b0bd0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:40.365828 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0663d7bc-70b0-4aef-a8fb-29de699b0bd0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:40.366603 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0663d7bc-70b0-4aef-a8fb-29de699b0bd0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:40.367205 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0663d7bc-70b0-4aef-a8fb-29de699b0bd0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:40.505353 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0663d7bc-70b0-4aef-a8fb-29de699b0bd0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:40.513532 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0663d7bc-70b0-4aef-a8fb-29de699b0bd0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:40.515081 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0663d7bc-70b0-4aef-a8fb-29de699b0bd0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:40.516232 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0663d7bc-70b0-4aef-a8fb-29de699b0bd0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.161678 Apr 08 11:22:40.516796 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 423/852] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:40 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:40.705938 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-324993d0-a4a1-459c-b264-6050930f78a4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:40.707367 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-324993d0-a4a1-459c-b264-6050930f78a4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:40.713534 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-324993d0-a4a1-459c-b264-6050930f78a4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:40.714023 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-324993d0-a4a1-459c-b264-6050930f78a4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:40.714803 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-324993d0-a4a1-459c-b264-6050930f78a4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:40.715243 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-324993d0-a4a1-459c-b264-6050930f78a4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:40.744315 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-324993d0-a4a1-459c-b264-6050930f78a4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042499 Apr 08 11:22:40.744868 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 430/853] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:22:40 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:22:41.002559 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c3407935-8a18-47d1-ae7e-def26fe21bf6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:41.003093 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c3407935-8a18-47d1-ae7e-def26fe21bf6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:41.009696 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c3407935-8a18-47d1-ae7e-def26fe21bf6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:41.010208 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c3407935-8a18-47d1-ae7e-def26fe21bf6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:41.011007 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c3407935-8a18-47d1-ae7e-def26fe21bf6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:41.011444 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c3407935-8a18-47d1-ae7e-def26fe21bf6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:41.144695 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c3407935-8a18-47d1-ae7e-def26fe21bf6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:41.151572 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-f13c38fb-4040-4ed0-9a9c-80e7f34c4a45 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:41.152221 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-f13c38fb-4040-4ed0-9a9c-80e7f34c4a45 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:41.152406 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c3407935-8a18-47d1-ae7e-def26fe21bf6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.153720 Apr 08 11:22:41.152996 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 424/854] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:40 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:41.158666 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f13c38fb-4040-4ed0-9a9c-80e7f34c4a45 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:41.159124 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f13c38fb-4040-4ed0-9a9c-80e7f34c4a45 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:41.159922 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f13c38fb-4040-4ed0-9a9c-80e7f34c4a45 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:41.160360 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f13c38fb-4040-4ed0-9a9c-80e7f34c4a45 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:41.224746 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f13c38fb-4040-4ed0-9a9c-80e7f34c4a45 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:41.239066 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-f13c38fb-4040-4ed0-9a9c-80e7f34c4a45 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.091230 Apr 08 11:22:41.239786 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 431/855] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:41 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:22:41.535739 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b639a460-90bd-42f7-acfd-1a894fae43b7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:41.536351 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b639a460-90bd-42f7-acfd-1a894fae43b7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:41.542685 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b639a460-90bd-42f7-acfd-1a894fae43b7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:41.543144 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b639a460-90bd-42f7-acfd-1a894fae43b7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:41.543917 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b639a460-90bd-42f7-acfd-1a894fae43b7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:41.544357 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b639a460-90bd-42f7-acfd-1a894fae43b7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:41.692833 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b639a460-90bd-42f7-acfd-1a894fae43b7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:41.701696 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b639a460-90bd-42f7-acfd-1a894fae43b7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:41.703250 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b639a460-90bd-42f7-acfd-1a894fae43b7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:41.704442 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b639a460-90bd-42f7-acfd-1a894fae43b7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.173109 Apr 08 11:22:41.705013 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 425/856] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:41 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:41.755522 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2a04184e-24f7-49a0-bdef-76d9d91ba921 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:41.756446 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-2a04184e-24f7-49a0-bdef-76d9d91ba921 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:41.762657 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2a04184e-24f7-49a0-bdef-76d9d91ba921 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:41.763110 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2a04184e-24f7-49a0-bdef-76d9d91ba921 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:41.763875 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2a04184e-24f7-49a0-bdef-76d9d91ba921 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:41.764309 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2a04184e-24f7-49a0-bdef-76d9d91ba921 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:41.793365 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-2a04184e-24f7-49a0-bdef-76d9d91ba921 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041793 Apr 08 11:22:41.794186 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 432/857] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:22:41 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:22:42.169884 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3c728a71-931a-4e06-97de-9513851b87dd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:42.170427 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3c728a71-931a-4e06-97de-9513851b87dd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:42.176477 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3c728a71-931a-4e06-97de-9513851b87dd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:42.177024 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3c728a71-931a-4e06-97de-9513851b87dd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:42.177818 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3c728a71-931a-4e06-97de-9513851b87dd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:42.178266 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3c728a71-931a-4e06-97de-9513851b87dd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:42.256365 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-d7571e89-c3c5-4760-b59c-e6c6b3535611 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:42.257078 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-d7571e89-c3c5-4760-b59c-e6c6b3535611 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:42.263497 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d7571e89-c3c5-4760-b59c-e6c6b3535611 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:42.263950 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d7571e89-c3c5-4760-b59c-e6c6b3535611 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:42.264740 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d7571e89-c3c5-4760-b59c-e6c6b3535611 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:42.265393 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d7571e89-c3c5-4760-b59c-e6c6b3535611 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:42.349984 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d7571e89-c3c5-4760-b59c-e6c6b3535611 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:42.355114 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3c728a71-931a-4e06-97de-9513851b87dd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:42.358274 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-d7571e89-c3c5-4760-b59c-e6c6b3535611 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.105446 Apr 08 11:22:42.358628 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 433/858] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:42 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:22:42.363055 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3c728a71-931a-4e06-97de-9513851b87dd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.196953 Apr 08 11:22:42.363626 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 426/859] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:42 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:42.722214 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-b488cdb8-5ff4-4705-911e-b3c82eabe7ee tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:42.722830 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-b488cdb8-5ff4-4705-911e-b3c82eabe7ee tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:42.729278 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b488cdb8-5ff4-4705-911e-b3c82eabe7ee tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:42.729703 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b488cdb8-5ff4-4705-911e-b3c82eabe7ee tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:42.730629 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b488cdb8-5ff4-4705-911e-b3c82eabe7ee tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:42.730969 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b488cdb8-5ff4-4705-911e-b3c82eabe7ee tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:42.806058 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c82fc8d7-6c03-4c29-a760-42dda7f96685 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:42.807113 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c82fc8d7-6c03-4c29-a760-42dda7f96685 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:42.813635 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c82fc8d7-6c03-4c29-a760-42dda7f96685 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:42.814142 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c82fc8d7-6c03-4c29-a760-42dda7f96685 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:42.814926 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c82fc8d7-6c03-4c29-a760-42dda7f96685 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:42.815360 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c82fc8d7-6c03-4c29-a760-42dda7f96685 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:42.847425 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c82fc8d7-6c03-4c29-a760-42dda7f96685 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045515 Apr 08 11:22:42.848315 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 427/860] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:22:42 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:22:42.872028 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b488cdb8-5ff4-4705-911e-b3c82eabe7ee tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:42.880779 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b488cdb8-5ff4-4705-911e-b3c82eabe7ee tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:42.882318 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b488cdb8-5ff4-4705-911e-b3c82eabe7ee tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:42.883473 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-b488cdb8-5ff4-4705-911e-b3c82eabe7ee tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.165320 Apr 08 11:22:42.884039 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 434/861] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:42 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:43.375661 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-83ec29d4-deb1-4aba-841f-5e66ad8122b2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:43.376280 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-83ec29d4-deb1-4aba-841f-5e66ad8122b2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:43.380396 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-9be18fed-67af-4bde-be5e-f3f8a5901749 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:43.381021 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-9be18fed-67af-4bde-be5e-f3f8a5901749 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:43.382336 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-83ec29d4-deb1-4aba-841f-5e66ad8122b2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:43.382787 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-83ec29d4-deb1-4aba-841f-5e66ad8122b2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:43.383795 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-83ec29d4-deb1-4aba-841f-5e66ad8122b2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:43.384003 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-83ec29d4-deb1-4aba-841f-5e66ad8122b2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:43.387108 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9be18fed-67af-4bde-be5e-f3f8a5901749 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:43.387564 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9be18fed-67af-4bde-be5e-f3f8a5901749 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:43.388342 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9be18fed-67af-4bde-be5e-f3f8a5901749 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:43.388786 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9be18fed-67af-4bde-be5e-f3f8a5901749 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:43.449201 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-83ec29d4-deb1-4aba-841f-5e66ad8122b2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:43.456908 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-83ec29d4-deb1-4aba-841f-5e66ad8122b2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.084722 Apr 08 11:22:43.457469 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 428/862] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:43 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:43.542087 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-9be18fed-67af-4bde-be5e-f3f8a5901749 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:43.549438 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-9be18fed-67af-4bde-be5e-f3f8a5901749 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.173103 Apr 08 11:22:43.550066 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 435/863] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:43 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:22:43.858843 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d54d9c53-81a1-41cc-a7c3-32b298d5cf79 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:43.859778 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d54d9c53-81a1-41cc-a7c3-32b298d5cf79 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:43.866116 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d54d9c53-81a1-41cc-a7c3-32b298d5cf79 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:43.866570 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d54d9c53-81a1-41cc-a7c3-32b298d5cf79 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:43.867349 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d54d9c53-81a1-41cc-a7c3-32b298d5cf79 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:43.867792 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d54d9c53-81a1-41cc-a7c3-32b298d5cf79 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:43.897049 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d54d9c53-81a1-41cc-a7c3-32b298d5cf79 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041981 Apr 08 11:22:43.897511 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 429/864] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:22:43 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:22:43.901587 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-616c3b68-47a7-4df8-8a50-90fdef153592 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:43.902230 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-616c3b68-47a7-4df8-8a50-90fdef153592 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:43.908237 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-616c3b68-47a7-4df8-8a50-90fdef153592 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:43.908681 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-616c3b68-47a7-4df8-8a50-90fdef153592 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:43.909455 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-616c3b68-47a7-4df8-8a50-90fdef153592 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:43.909919 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-616c3b68-47a7-4df8-8a50-90fdef153592 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:44.038270 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-616c3b68-47a7-4df8-8a50-90fdef153592 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:44.046492 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-616c3b68-47a7-4df8-8a50-90fdef153592 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:44.048013 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-616c3b68-47a7-4df8-8a50-90fdef153592 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:44.049173 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-616c3b68-47a7-4df8-8a50-90fdef153592 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.151442 Apr 08 11:22:44.049729 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 436/865] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:43 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:22:44.472501 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-97021a3d-96db-4de0-a826-ff31cb81550e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:44.473114 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-97021a3d-96db-4de0-a826-ff31cb81550e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:44.479118 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-97021a3d-96db-4de0-a826-ff31cb81550e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:44.479578 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-97021a3d-96db-4de0-a826-ff31cb81550e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:44.480348 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-97021a3d-96db-4de0-a826-ff31cb81550e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:44.480792 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-97021a3d-96db-4de0-a826-ff31cb81550e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:44.547801 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-97021a3d-96db-4de0-a826-ff31cb81550e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:44.555930 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-97021a3d-96db-4de0-a826-ff31cb81550e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.087371 Apr 08 11:22:44.556502 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 430/866] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:44 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:22:44.566833 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-d7cc8661-b8ed-4941-ba03-5685c7a54d8e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:44.567480 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-d7cc8661-b8ed-4941-ba03-5685c7a54d8e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:44.573811 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d7cc8661-b8ed-4941-ba03-5685c7a54d8e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:44.574274 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d7cc8661-b8ed-4941-ba03-5685c7a54d8e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:44.575046 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d7cc8661-b8ed-4941-ba03-5685c7a54d8e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:44.575490 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d7cc8661-b8ed-4941-ba03-5685c7a54d8e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:44.715518 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d7cc8661-b8ed-4941-ba03-5685c7a54d8e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:44.723768 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-d7cc8661-b8ed-4941-ba03-5685c7a54d8e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.160673 Apr 08 11:22:44.724274 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 437/867] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:44 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:44.908584 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-912bac58-8323-4ee0-8417-ffab91fbfa01 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:44.910075 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-912bac58-8323-4ee0-8417-ffab91fbfa01 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:44.916402 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-912bac58-8323-4ee0-8417-ffab91fbfa01 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:44.916854 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-912bac58-8323-4ee0-8417-ffab91fbfa01 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:44.917631 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-912bac58-8323-4ee0-8417-ffab91fbfa01 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:44.918102 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-912bac58-8323-4ee0-8417-ffab91fbfa01 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:44.946264 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-912bac58-8323-4ee0-8417-ffab91fbfa01 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041592 Apr 08 11:22:44.946825 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 431/868] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:22:44 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:22:45.066618 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-74589d20-9e62-48db-a232-1a7328605f89 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:45.067234 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-74589d20-9e62-48db-a232-1a7328605f89 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:45.073119 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-74589d20-9e62-48db-a232-1a7328605f89 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:45.073572 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-74589d20-9e62-48db-a232-1a7328605f89 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:45.074374 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-74589d20-9e62-48db-a232-1a7328605f89 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:45.074821 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-74589d20-9e62-48db-a232-1a7328605f89 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:45.204918 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-74589d20-9e62-48db-a232-1a7328605f89 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:45.213661 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-74589d20-9e62-48db-a232-1a7328605f89 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:45.215191 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-74589d20-9e62-48db-a232-1a7328605f89 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:45.216348 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-74589d20-9e62-48db-a232-1a7328605f89 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.153633 Apr 08 11:22:45.216932 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 438/869] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:45 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:45.573040 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b232dfdb-47af-41b2-94d0-777d17bd8983 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:45.573653 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b232dfdb-47af-41b2-94d0-777d17bd8983 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:45.579547 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b232dfdb-47af-41b2-94d0-777d17bd8983 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:45.580002 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b232dfdb-47af-41b2-94d0-777d17bd8983 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:45.580830 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b232dfdb-47af-41b2-94d0-777d17bd8983 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:45.581276 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b232dfdb-47af-41b2-94d0-777d17bd8983 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:45.641273 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b232dfdb-47af-41b2-94d0-777d17bd8983 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:45.650868 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b232dfdb-47af-41b2-94d0-777d17bd8983 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081643 Apr 08 11:22:45.651509 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 432/870] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:45 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:45.741453 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-fe0bc7f4-687a-49ef-8df8-c3889cfcfd47 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:45.742105 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-fe0bc7f4-687a-49ef-8df8-c3889cfcfd47 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:45.748686 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fe0bc7f4-687a-49ef-8df8-c3889cfcfd47 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:45.749132 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fe0bc7f4-687a-49ef-8df8-c3889cfcfd47 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:45.749974 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fe0bc7f4-687a-49ef-8df8-c3889cfcfd47 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:45.750415 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fe0bc7f4-687a-49ef-8df8-c3889cfcfd47 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:45.886793 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-fe0bc7f4-687a-49ef-8df8-c3889cfcfd47 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:45.894157 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-fe0bc7f4-687a-49ef-8df8-c3889cfcfd47 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.157183 Apr 08 11:22:45.894731 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 439/871] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:45 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:45.957807 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a34fbb24-9f01-4ef3-b1b1-6f7c3ae975a8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:45.958744 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a34fbb24-9f01-4ef3-b1b1-6f7c3ae975a8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:45.965961 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a34fbb24-9f01-4ef3-b1b1-6f7c3ae975a8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:45.966436 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a34fbb24-9f01-4ef3-b1b1-6f7c3ae975a8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:45.967210 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a34fbb24-9f01-4ef3-b1b1-6f7c3ae975a8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:45.968150 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a34fbb24-9f01-4ef3-b1b1-6f7c3ae975a8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:45.997457 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a34fbb24-9f01-4ef3-b1b1-6f7c3ae975a8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043638 Apr 08 11:22:45.998050 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 433/872] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:22:45 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:22:46.235296 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-c346a1f8-7787-4540-8063-2943db6456a9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:46.235822 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-c346a1f8-7787-4540-8063-2943db6456a9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:46.242921 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c346a1f8-7787-4540-8063-2943db6456a9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:46.243409 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c346a1f8-7787-4540-8063-2943db6456a9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:46.244191 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c346a1f8-7787-4540-8063-2943db6456a9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:46.244637 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c346a1f8-7787-4540-8063-2943db6456a9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:46.387818 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-c346a1f8-7787-4540-8063-2943db6456a9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:46.396064 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-c346a1f8-7787-4540-8063-2943db6456a9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:46.397636 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-c346a1f8-7787-4540-8063-2943db6456a9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:46.398947 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-c346a1f8-7787-4540-8063-2943db6456a9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.167750 Apr 08 11:22:46.399582 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 440/873] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:46 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:46.667137 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-da7e3fd4-f707-46e6-916b-aefa539e9611 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:46.667781 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-da7e3fd4-f707-46e6-916b-aefa539e9611 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:46.673823 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-da7e3fd4-f707-46e6-916b-aefa539e9611 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:46.674280 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-da7e3fd4-f707-46e6-916b-aefa539e9611 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:46.675059 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-da7e3fd4-f707-46e6-916b-aefa539e9611 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:46.676010 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-da7e3fd4-f707-46e6-916b-aefa539e9611 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:46.739525 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-da7e3fd4-f707-46e6-916b-aefa539e9611 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:46.747163 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-da7e3fd4-f707-46e6-916b-aefa539e9611 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.083952 Apr 08 11:22:46.747739 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 434/874] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:46 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:46.911616 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-ed0dd0f6-2716-43c6-9b44-7a9d66daf88a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:46.912172 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-ed0dd0f6-2716-43c6-9b44-7a9d66daf88a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:46.918806 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ed0dd0f6-2716-43c6-9b44-7a9d66daf88a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:46.919295 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ed0dd0f6-2716-43c6-9b44-7a9d66daf88a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:46.920059 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ed0dd0f6-2716-43c6-9b44-7a9d66daf88a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:46.920498 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ed0dd0f6-2716-43c6-9b44-7a9d66daf88a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:47.008981 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e7658f2d-892d-4e1a-b785-cbbce0660261 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:47.009957 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e7658f2d-892d-4e1a-b785-cbbce0660261 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:47.016227 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e7658f2d-892d-4e1a-b785-cbbce0660261 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:47.016703 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e7658f2d-892d-4e1a-b785-cbbce0660261 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:47.017469 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e7658f2d-892d-4e1a-b785-cbbce0660261 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:47.017938 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e7658f2d-892d-4e1a-b785-cbbce0660261 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:47.046819 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e7658f2d-892d-4e1a-b785-cbbce0660261 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041675 Apr 08 11:22:47.047386 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 435/875] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:22:47 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:22:47.056675 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-ed0dd0f6-2716-43c6-9b44-7a9d66daf88a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:47.063962 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-ed0dd0f6-2716-43c6-9b44-7a9d66daf88a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.156803 Apr 08 11:22:47.064527 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 441/876] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:46 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:47.417742 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-29b7da3e-5cc3-4d43-9f7d-f1aae0422279 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:47.418402 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-29b7da3e-5cc3-4d43-9f7d-f1aae0422279 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:47.424563 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-29b7da3e-5cc3-4d43-9f7d-f1aae0422279 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:47.425011 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-29b7da3e-5cc3-4d43-9f7d-f1aae0422279 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:47.425815 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-29b7da3e-5cc3-4d43-9f7d-f1aae0422279 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:47.426255 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-29b7da3e-5cc3-4d43-9f7d-f1aae0422279 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:47.558217 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-29b7da3e-5cc3-4d43-9f7d-f1aae0422279 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:47.567232 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-29b7da3e-5cc3-4d43-9f7d-f1aae0422279 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:47.576727 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-29b7da3e-5cc3-4d43-9f7d-f1aae0422279 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:47.576727 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-29b7da3e-5cc3-4d43-9f7d-f1aae0422279 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.156063 Apr 08 11:22:47.576727 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 436/877] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:47 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:47.764584 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-b31f8864-c58d-4166-9a3e-207cca738685 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:47.765176 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-b31f8864-c58d-4166-9a3e-207cca738685 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:47.771884 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b31f8864-c58d-4166-9a3e-207cca738685 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:47.772334 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b31f8864-c58d-4166-9a3e-207cca738685 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:47.773092 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b31f8864-c58d-4166-9a3e-207cca738685 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:47.773534 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b31f8864-c58d-4166-9a3e-207cca738685 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:47.835699 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b31f8864-c58d-4166-9a3e-207cca738685 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:47.844405 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-b31f8864-c58d-4166-9a3e-207cca738685 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.083736 Apr 08 11:22:47.844987 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 442/878] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:47 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:48.059313 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-22050f95-d388-41fe-a616-7d1e072af147 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:48.060195 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-22050f95-d388-41fe-a616-7d1e072af147 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:48.067775 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-22050f95-d388-41fe-a616-7d1e072af147 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:48.068232 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-22050f95-d388-41fe-a616-7d1e072af147 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:48.069034 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-22050f95-d388-41fe-a616-7d1e072af147 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:48.069476 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-22050f95-d388-41fe-a616-7d1e072af147 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:48.080565 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e4693bfa-6e97-486a-9a78-fe04ebd16aba tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:48.081303 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e4693bfa-6e97-486a-9a78-fe04ebd16aba tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:48.088194 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e4693bfa-6e97-486a-9a78-fe04ebd16aba tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:48.088813 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e4693bfa-6e97-486a-9a78-fe04ebd16aba tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:48.089650 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e4693bfa-6e97-486a-9a78-fe04ebd16aba tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:48.090265 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e4693bfa-6e97-486a-9a78-fe04ebd16aba tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:48.100796 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-22050f95-d388-41fe-a616-7d1e072af147 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045399 Apr 08 11:22:48.101377 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 437/879] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:22:48 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:22:48.229636 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e4693bfa-6e97-486a-9a78-fe04ebd16aba tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:48.237353 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e4693bfa-6e97-486a-9a78-fe04ebd16aba tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.160663 Apr 08 11:22:48.237964 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 443/880] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:48 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:48.588493 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d7b4886f-2451-45b1-ba99-23e7ef1b4ad8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:48.589111 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d7b4886f-2451-45b1-ba99-23e7ef1b4ad8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:48.595066 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d7b4886f-2451-45b1-ba99-23e7ef1b4ad8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:48.595577 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d7b4886f-2451-45b1-ba99-23e7ef1b4ad8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:48.596379 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d7b4886f-2451-45b1-ba99-23e7ef1b4ad8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:48.596767 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d7b4886f-2451-45b1-ba99-23e7ef1b4ad8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:48.736016 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d7b4886f-2451-45b1-ba99-23e7ef1b4ad8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:48.745535 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d7b4886f-2451-45b1-ba99-23e7ef1b4ad8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:48.747047 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d7b4886f-2451-45b1-ba99-23e7ef1b4ad8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:48.748190 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d7b4886f-2451-45b1-ba99-23e7ef1b4ad8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.163958 Apr 08 11:22:48.748747 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 438/881] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:48 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:48.861193 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-d43e2ea9-3ca3-4028-baa5-556880977428 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:48.861725 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-d43e2ea9-3ca3-4028-baa5-556880977428 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:48.867733 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d43e2ea9-3ca3-4028-baa5-556880977428 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:48.868191 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d43e2ea9-3ca3-4028-baa5-556880977428 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:48.868971 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d43e2ea9-3ca3-4028-baa5-556880977428 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:48.869410 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d43e2ea9-3ca3-4028-baa5-556880977428 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:48.930936 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d43e2ea9-3ca3-4028-baa5-556880977428 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:48.938345 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-d43e2ea9-3ca3-4028-baa5-556880977428 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081114 Apr 08 11:22:48.938913 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 444/882] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:48 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:49.112450 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b8ce1a64-9e03-41f3-b2d0-8388ff85ff06 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:49.113347 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b8ce1a64-9e03-41f3-b2d0-8388ff85ff06 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:49.119665 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b8ce1a64-9e03-41f3-b2d0-8388ff85ff06 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:49.120397 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b8ce1a64-9e03-41f3-b2d0-8388ff85ff06 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:49.121154 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b8ce1a64-9e03-41f3-b2d0-8388ff85ff06 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:49.121598 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b8ce1a64-9e03-41f3-b2d0-8388ff85ff06 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:49.150123 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b8ce1a64-9e03-41f3-b2d0-8388ff85ff06 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041600 Apr 08 11:22:49.150678 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 439/883] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:22:49 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:22:49.256230 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-9963c901-0ca6-42fe-9525-b783922ce20b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:49.256885 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-9963c901-0ca6-42fe-9525-b783922ce20b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:49.263264 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9963c901-0ca6-42fe-9525-b783922ce20b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:49.263714 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9963c901-0ca6-42fe-9525-b783922ce20b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:49.264482 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9963c901-0ca6-42fe-9525-b783922ce20b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:49.264922 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9963c901-0ca6-42fe-9525-b783922ce20b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:49.398234 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-9963c901-0ca6-42fe-9525-b783922ce20b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:49.405841 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-9963c901-0ca6-42fe-9525-b783922ce20b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.153890 Apr 08 11:22:49.409143 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 445/884] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:49 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:49.766437 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a722131f-1921-4d0c-b02c-af9f4d617ceb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:49.767039 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a722131f-1921-4d0c-b02c-af9f4d617ceb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:49.772982 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a722131f-1921-4d0c-b02c-af9f4d617ceb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:49.773424 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a722131f-1921-4d0c-b02c-af9f4d617ceb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:49.774206 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a722131f-1921-4d0c-b02c-af9f4d617ceb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:49.774634 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a722131f-1921-4d0c-b02c-af9f4d617ceb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:49.903537 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a722131f-1921-4d0c-b02c-af9f4d617ceb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:49.912569 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a722131f-1921-4d0c-b02c-af9f4d617ceb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:49.914143 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a722131f-1921-4d0c-b02c-af9f4d617ceb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:49.915298 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a722131f-1921-4d0c-b02c-af9f4d617ceb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.152733 Apr 08 11:22:49.915863 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 440/885] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:49 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:49.954834 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-3fe8fdaf-57f7-4c28-9faa-98dec3c1852b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:49.955454 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-3fe8fdaf-57f7-4c28-9faa-98dec3c1852b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:49.961396 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3fe8fdaf-57f7-4c28-9faa-98dec3c1852b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:49.961883 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3fe8fdaf-57f7-4c28-9faa-98dec3c1852b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:49.962659 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3fe8fdaf-57f7-4c28-9faa-98dec3c1852b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:49.963103 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3fe8fdaf-57f7-4c28-9faa-98dec3c1852b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:50.024380 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-3fe8fdaf-57f7-4c28-9faa-98dec3c1852b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:50.031808 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-3fe8fdaf-57f7-4c28-9faa-98dec3c1852b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080776 Apr 08 11:22:50.032383 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 446/886] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:49 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:50.162429 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0ed93b0c-1d92-4ab4-a6c0-0c1bb1390f21 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:50.163353 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0ed93b0c-1d92-4ab4-a6c0-0c1bb1390f21 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:50.169568 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0ed93b0c-1d92-4ab4-a6c0-0c1bb1390f21 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:50.170046 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0ed93b0c-1d92-4ab4-a6c0-0c1bb1390f21 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:50.170821 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0ed93b0c-1d92-4ab4-a6c0-0c1bb1390f21 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:50.171257 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0ed93b0c-1d92-4ab4-a6c0-0c1bb1390f21 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:50.199204 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0ed93b0c-1d92-4ab4-a6c0-0c1bb1390f21 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041333 Apr 08 11:22:50.199760 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 441/887] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:22:50 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:22:50.422689 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-8a2ed499-c980-4650-b483-621871bcdfca tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:50.423244 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-8a2ed499-c980-4650-b483-621871bcdfca tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:50.429359 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8a2ed499-c980-4650-b483-621871bcdfca tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:50.429834 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8a2ed499-c980-4650-b483-621871bcdfca tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:50.430596 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8a2ed499-c980-4650-b483-621871bcdfca tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:50.431030 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8a2ed499-c980-4650-b483-621871bcdfca tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:50.573287 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-8a2ed499-c980-4650-b483-621871bcdfca tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:50.581183 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-8a2ed499-c980-4650-b483-621871bcdfca tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.162414 Apr 08 11:22:50.581804 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 447/888] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:50 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:50.934397 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4a096015-e202-49aa-b4ec-7ec30cc18c04 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:50.935014 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4a096015-e202-49aa-b4ec-7ec30cc18c04 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:50.941110 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4a096015-e202-49aa-b4ec-7ec30cc18c04 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:50.942166 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4a096015-e202-49aa-b4ec-7ec30cc18c04 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:50.942932 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4a096015-e202-49aa-b4ec-7ec30cc18c04 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:50.943373 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4a096015-e202-49aa-b4ec-7ec30cc18c04 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:51.048829 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-1fc46f85-0b89-4a6a-b1b0-2b8b1a06da68 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:51.049402 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-1fc46f85-0b89-4a6a-b1b0-2b8b1a06da68 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:51.056238 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1fc46f85-0b89-4a6a-b1b0-2b8b1a06da68 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:51.056697 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1fc46f85-0b89-4a6a-b1b0-2b8b1a06da68 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:51.057483 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1fc46f85-0b89-4a6a-b1b0-2b8b1a06da68 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:51.057958 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1fc46f85-0b89-4a6a-b1b0-2b8b1a06da68 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:51.090615 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4a096015-e202-49aa-b4ec-7ec30cc18c04 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:51.101629 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4a096015-e202-49aa-b4ec-7ec30cc18c04 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:51.103144 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4a096015-e202-49aa-b4ec-7ec30cc18c04 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:51.104322 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4a096015-e202-49aa-b4ec-7ec30cc18c04 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.173904 Apr 08 11:22:51.105071 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 442/889] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:50 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:51.126805 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1fc46f85-0b89-4a6a-b1b0-2b8b1a06da68 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:51.137018 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-1fc46f85-0b89-4a6a-b1b0-2b8b1a06da68 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.091868 Apr 08 11:22:51.137937 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 448/890] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:51 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:22:51.210875 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-abdd802a-8e67-4962-98cb-078033e572e2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:51.211725 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-abdd802a-8e67-4962-98cb-078033e572e2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:51.219902 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-abdd802a-8e67-4962-98cb-078033e572e2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:51.220353 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-abdd802a-8e67-4962-98cb-078033e572e2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:51.221137 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-abdd802a-8e67-4962-98cb-078033e572e2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:51.221581 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-abdd802a-8e67-4962-98cb-078033e572e2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:51.251247 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-abdd802a-8e67-4962-98cb-078033e572e2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044318 Apr 08 11:22:51.251825 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 443/891] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:22:51 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:22:51.598831 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-61d07cd0-dfa0-4d4f-a3da-790908435829 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:51.599434 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-61d07cd0-dfa0-4d4f-a3da-790908435829 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:51.605280 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-61d07cd0-dfa0-4d4f-a3da-790908435829 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:51.605748 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-61d07cd0-dfa0-4d4f-a3da-790908435829 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:51.606533 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-61d07cd0-dfa0-4d4f-a3da-790908435829 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:51.606964 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-61d07cd0-dfa0-4d4f-a3da-790908435829 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:51.740802 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-61d07cd0-dfa0-4d4f-a3da-790908435829 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:51.748526 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-61d07cd0-dfa0-4d4f-a3da-790908435829 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.154185 Apr 08 11:22:51.749098 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 449/892] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:51 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:51.875481 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 11:22:51.875665 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:22:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 11:22:52.122384 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5eb859d4-caf3-42b7-b358-120e348a00a8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:52.123002 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5eb859d4-caf3-42b7-b358-120e348a00a8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:52.129426 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5eb859d4-caf3-42b7-b358-120e348a00a8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:52.129844 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5eb859d4-caf3-42b7-b358-120e348a00a8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:52.130610 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5eb859d4-caf3-42b7-b358-120e348a00a8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:52.131048 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5eb859d4-caf3-42b7-b358-120e348a00a8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:52.157723 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-ffe75d8d-ade1-4e9f-b684-8299053977d7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:52.158375 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-ffe75d8d-ade1-4e9f-b684-8299053977d7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:52.164765 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ffe75d8d-ade1-4e9f-b684-8299053977d7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:52.165227 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ffe75d8d-ade1-4e9f-b684-8299053977d7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:52.166032 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ffe75d8d-ade1-4e9f-b684-8299053977d7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:52.166473 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ffe75d8d-ade1-4e9f-b684-8299053977d7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:52.231992 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-ffe75d8d-ade1-4e9f-b684-8299053977d7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:52.240044 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-ffe75d8d-ade1-4e9f-b684-8299053977d7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.086209 Apr 08 11:22:52.240647 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 450/893] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:52 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:22:52.263467 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-fcb11f57-e998-47c9-879d-8a9abf043b34 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:52.264390 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-fcb11f57-e998-47c9-879d-8a9abf043b34 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:52.271112 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fcb11f57-e998-47c9-879d-8a9abf043b34 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:52.271565 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fcb11f57-e998-47c9-879d-8a9abf043b34 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:52.272339 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fcb11f57-e998-47c9-879d-8a9abf043b34 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:52.272852 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fcb11f57-e998-47c9-879d-8a9abf043b34 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:52.289147 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5eb859d4-caf3-42b7-b358-120e348a00a8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:52.297398 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5eb859d4-caf3-42b7-b358-120e348a00a8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:52.298927 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5eb859d4-caf3-42b7-b358-120e348a00a8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:52.300092 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5eb859d4-caf3-42b7-b358-120e348a00a8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.182015 Apr 08 11:22:52.300662 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 444/894] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:52 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:52.302150 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-fcb11f57-e998-47c9-879d-8a9abf043b34 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042564 Apr 08 11:22:52.302706 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 451/895] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:22:52 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:22:52.766170 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-86396468-f011-4c47-9103-0539aacd8bee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:52.766787 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-86396468-f011-4c47-9103-0539aacd8bee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:52.776112 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-86396468-f011-4c47-9103-0539aacd8bee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:52.776570 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-86396468-f011-4c47-9103-0539aacd8bee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:52.777446 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-86396468-f011-4c47-9103-0539aacd8bee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:52.779852 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-86396468-f011-4c47-9103-0539aacd8bee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:52.913565 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-86396468-f011-4c47-9103-0539aacd8bee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:52.921059 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-86396468-f011-4c47-9103-0539aacd8bee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.159150 Apr 08 11:22:52.921631 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 445/896] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:52 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:53.256591 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-8c2a383e-54fa-4cc7-b996-78bf93aecc2a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:53.260648 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-8c2a383e-54fa-4cc7-b996-78bf93aecc2a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:53.263704 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8c2a383e-54fa-4cc7-b996-78bf93aecc2a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:53.264162 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8c2a383e-54fa-4cc7-b996-78bf93aecc2a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:53.264939 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8c2a383e-54fa-4cc7-b996-78bf93aecc2a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:53.265381 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8c2a383e-54fa-4cc7-b996-78bf93aecc2a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:53.313981 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ec4322a0-7e22-469e-9218-c8f3b0dc81af tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:53.314927 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ec4322a0-7e22-469e-9218-c8f3b0dc81af tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:53.321471 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ec4322a0-7e22-469e-9218-c8f3b0dc81af tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:53.322573 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ec4322a0-7e22-469e-9218-c8f3b0dc81af tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:53.322791 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ec4322a0-7e22-469e-9218-c8f3b0dc81af tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:53.323235 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ec4322a0-7e22-469e-9218-c8f3b0dc81af tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:53.324709 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-8c2a383e-54fa-4cc7-b996-78bf93aecc2a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:53.332929 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-8c2a383e-54fa-4cc7-b996-78bf93aecc2a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080174 Apr 08 11:22:53.333517 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 452/897] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:53 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:53.338108 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-6740adde-9deb-4e36-886b-b69d3075dd82 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:53.338721 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-6740adde-9deb-4e36-886b-b69d3075dd82 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:53.344525 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6740adde-9deb-4e36-886b-b69d3075dd82 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:53.346305 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6740adde-9deb-4e36-886b-b69d3075dd82 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:53.346305 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6740adde-9deb-4e36-886b-b69d3075dd82 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:53.346305 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6740adde-9deb-4e36-886b-b69d3075dd82 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:53.354758 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ec4322a0-7e22-469e-9218-c8f3b0dc81af tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044926 Apr 08 11:22:53.358686 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 446/898] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:22:53 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:22:53.481247 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6740adde-9deb-4e36-886b-b69d3075dd82 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:53.489484 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6740adde-9deb-4e36-886b-b69d3075dd82 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:53.491020 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6740adde-9deb-4e36-886b-b69d3075dd82 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:53.492180 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-6740adde-9deb-4e36-886b-b69d3075dd82 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.157709 Apr 08 11:22:53.492746 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 453/899] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:53 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:53.938670 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ec1b2122-1b6d-4f75-aa43-16be5dfd8b5a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:53.939311 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ec1b2122-1b6d-4f75-aa43-16be5dfd8b5a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:53.946093 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ec1b2122-1b6d-4f75-aa43-16be5dfd8b5a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:53.946540 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ec1b2122-1b6d-4f75-aa43-16be5dfd8b5a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:53.947304 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ec1b2122-1b6d-4f75-aa43-16be5dfd8b5a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:53.947741 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ec1b2122-1b6d-4f75-aa43-16be5dfd8b5a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:54.078488 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ec1b2122-1b6d-4f75-aa43-16be5dfd8b5a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:54.085921 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ec1b2122-1b6d-4f75-aa43-16be5dfd8b5a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.151050 Apr 08 11:22:54.086526 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 447/900] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:53 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:54.350530 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-de3f6911-27d2-4d08-a9b6-c9003b737b15 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:54.351076 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-de3f6911-27d2-4d08-a9b6-c9003b737b15 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:54.357699 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-de3f6911-27d2-4d08-a9b6-c9003b737b15 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:54.358182 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-de3f6911-27d2-4d08-a9b6-c9003b737b15 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:54.358955 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-de3f6911-27d2-4d08-a9b6-c9003b737b15 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:54.359394 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-de3f6911-27d2-4d08-a9b6-c9003b737b15 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:54.366724 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-54a1313d-5dd9-4530-98bf-72c60c7b8549 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:54.367658 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-54a1313d-5dd9-4530-98bf-72c60c7b8549 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:54.374873 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-54a1313d-5dd9-4530-98bf-72c60c7b8549 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:54.374873 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-54a1313d-5dd9-4530-98bf-72c60c7b8549 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:54.381483 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-54a1313d-5dd9-4530-98bf-72c60c7b8549 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:54.381483 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-54a1313d-5dd9-4530-98bf-72c60c7b8549 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:54.405791 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-54a1313d-5dd9-4530-98bf-72c60c7b8549 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043708 Apr 08 11:22:54.406383 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 448/901] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:22:54 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:22:54.427442 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-de3f6911-27d2-4d08-a9b6-c9003b737b15 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:54.427807 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-de3f6911-27d2-4d08-a9b6-c9003b737b15 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081747 Apr 08 11:22:54.428380 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 454/902] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:54 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:54.510844 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-36dce847-d00b-4499-bdb0-2764f616667a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:54.511452 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-36dce847-d00b-4499-bdb0-2764f616667a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:54.517375 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-36dce847-d00b-4499-bdb0-2764f616667a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:54.517857 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-36dce847-d00b-4499-bdb0-2764f616667a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:54.518626 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-36dce847-d00b-4499-bdb0-2764f616667a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:54.519065 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-36dce847-d00b-4499-bdb0-2764f616667a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:54.803026 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-36dce847-d00b-4499-bdb0-2764f616667a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:54.811977 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-36dce847-d00b-4499-bdb0-2764f616667a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:54.813467 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-36dce847-d00b-4499-bdb0-2764f616667a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:54.814677 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-36dce847-d00b-4499-bdb0-2764f616667a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.307738 Apr 08 11:22:54.815258 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 449/903] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:54 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:55.103196 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a11f53f7-8288-4284-9ca8-66f9956bcfc4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:55.103812 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a11f53f7-8288-4284-9ca8-66f9956bcfc4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:55.109738 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a11f53f7-8288-4284-9ca8-66f9956bcfc4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:55.110227 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a11f53f7-8288-4284-9ca8-66f9956bcfc4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:55.111003 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a11f53f7-8288-4284-9ca8-66f9956bcfc4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:55.111454 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a11f53f7-8288-4284-9ca8-66f9956bcfc4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:55.246022 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a11f53f7-8288-4284-9ca8-66f9956bcfc4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:55.254109 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a11f53f7-8288-4284-9ca8-66f9956bcfc4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.154457 Apr 08 11:22:55.254683 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 455/904] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:55 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:55.418366 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0b208265-b763-492d-b95a-bda82a35a88e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:55.419219 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0b208265-b763-492d-b95a-bda82a35a88e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:55.426064 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0b208265-b763-492d-b95a-bda82a35a88e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:55.426514 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0b208265-b763-492d-b95a-bda82a35a88e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:55.427287 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0b208265-b763-492d-b95a-bda82a35a88e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:55.427720 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0b208265-b763-492d-b95a-bda82a35a88e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:55.444843 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-402cc44f-961b-4b87-871f-09e1eaecbdc3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:55.445624 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-402cc44f-961b-4b87-871f-09e1eaecbdc3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:55.452159 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-402cc44f-961b-4b87-871f-09e1eaecbdc3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:55.452613 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-402cc44f-961b-4b87-871f-09e1eaecbdc3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:55.453383 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-402cc44f-961b-4b87-871f-09e1eaecbdc3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:55.453915 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-402cc44f-961b-4b87-871f-09e1eaecbdc3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:55.456781 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0b208265-b763-492d-b95a-bda82a35a88e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042466 Apr 08 11:22:55.457341 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 450/905] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:22:55 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:22:55.517717 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-402cc44f-961b-4b87-871f-09e1eaecbdc3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:55.525160 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-402cc44f-961b-4b87-871f-09e1eaecbdc3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.084775 Apr 08 11:22:55.525742 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 456/906] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:55 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:22:55.832411 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c08ed982-29c3-47cb-9d6c-c0205e68f714 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:55.833023 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c08ed982-29c3-47cb-9d6c-c0205e68f714 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:55.838885 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c08ed982-29c3-47cb-9d6c-c0205e68f714 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:55.839335 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c08ed982-29c3-47cb-9d6c-c0205e68f714 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:55.840100 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c08ed982-29c3-47cb-9d6c-c0205e68f714 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:55.840537 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c08ed982-29c3-47cb-9d6c-c0205e68f714 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:56.205820 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c08ed982-29c3-47cb-9d6c-c0205e68f714 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:56.214522 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c08ed982-29c3-47cb-9d6c-c0205e68f714 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:56.216017 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c08ed982-29c3-47cb-9d6c-c0205e68f714 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:56.217164 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c08ed982-29c3-47cb-9d6c-c0205e68f714 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.388637 Apr 08 11:22:56.217708 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 451/907] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:55 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:56.271682 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-f93961ad-5b42-4049-8d81-d02e1612c32a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:56.272296 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-f93961ad-5b42-4049-8d81-d02e1612c32a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:56.278174 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f93961ad-5b42-4049-8d81-d02e1612c32a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:56.278629 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f93961ad-5b42-4049-8d81-d02e1612c32a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:56.279399 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f93961ad-5b42-4049-8d81-d02e1612c32a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:56.279852 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f93961ad-5b42-4049-8d81-d02e1612c32a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:56.412793 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f93961ad-5b42-4049-8d81-d02e1612c32a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:56.420206 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-f93961ad-5b42-4049-8d81-d02e1612c32a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.152911 Apr 08 11:22:56.420771 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 457/908] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:56 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:56.467599 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ec5e1ae0-e72b-4f01-b621-e9100c6a8894 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:56.468535 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ec5e1ae0-e72b-4f01-b621-e9100c6a8894 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:56.475131 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ec5e1ae0-e72b-4f01-b621-e9100c6a8894 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:56.475587 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ec5e1ae0-e72b-4f01-b621-e9100c6a8894 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:56.476357 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ec5e1ae0-e72b-4f01-b621-e9100c6a8894 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:56.476802 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ec5e1ae0-e72b-4f01-b621-e9100c6a8894 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:56.506335 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ec5e1ae0-e72b-4f01-b621-e9100c6a8894 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042712 Apr 08 11:22:56.506882 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 452/909] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:22:56 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:22:56.541712 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-d1c2daf6-bd94-47f1-9edd-529573dce54c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:56.542369 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-d1c2daf6-bd94-47f1-9edd-529573dce54c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:56.548804 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d1c2daf6-bd94-47f1-9edd-529573dce54c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:56.549257 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d1c2daf6-bd94-47f1-9edd-529573dce54c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:56.550067 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d1c2daf6-bd94-47f1-9edd-529573dce54c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:56.550517 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d1c2daf6-bd94-47f1-9edd-529573dce54c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:56.611536 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d1c2daf6-bd94-47f1-9edd-529573dce54c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:56.619015 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-d1c2daf6-bd94-47f1-9edd-529573dce54c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081110 Apr 08 11:22:56.619884 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 458/910] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:56 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:57.235764 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1d31e91d-d6a0-4b36-84a6-503649bdcd5f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:57.236405 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1d31e91d-d6a0-4b36-84a6-503649bdcd5f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:57.243259 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1d31e91d-d6a0-4b36-84a6-503649bdcd5f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:57.243713 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1d31e91d-d6a0-4b36-84a6-503649bdcd5f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:57.244497 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1d31e91d-d6a0-4b36-84a6-503649bdcd5f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:57.245192 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1d31e91d-d6a0-4b36-84a6-503649bdcd5f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:57.380121 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1d31e91d-d6a0-4b36-84a6-503649bdcd5f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:57.385965 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1d31e91d-d6a0-4b36-84a6-503649bdcd5f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:57.387474 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1d31e91d-d6a0-4b36-84a6-503649bdcd5f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:57.388635 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1d31e91d-d6a0-4b36-84a6-503649bdcd5f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.156754 Apr 08 11:22:57.389180 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 453/911] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:57 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:57.437283 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-61a1a865-2e91-4332-baec-49f653601292 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:57.437928 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-61a1a865-2e91-4332-baec-49f653601292 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:57.444799 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-61a1a865-2e91-4332-baec-49f653601292 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:57.445357 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-61a1a865-2e91-4332-baec-49f653601292 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:57.446329 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-61a1a865-2e91-4332-baec-49f653601292 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:57.446868 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-61a1a865-2e91-4332-baec-49f653601292 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:57.517534 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-944463d3-30c1-4144-8d69-fd4f626d35cb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:57.519817 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-944463d3-30c1-4144-8d69-fd4f626d35cb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:57.526658 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-944463d3-30c1-4144-8d69-fd4f626d35cb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:57.527333 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-944463d3-30c1-4144-8d69-fd4f626d35cb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:57.528295 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-944463d3-30c1-4144-8d69-fd4f626d35cb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:57.528841 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-944463d3-30c1-4144-8d69-fd4f626d35cb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:57.559175 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-944463d3-30c1-4144-8d69-fd4f626d35cb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045498 Apr 08 11:22:57.559743 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 454/912] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:22:57 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:22:57.600137 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-61a1a865-2e91-4332-baec-49f653601292 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:57.607571 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-61a1a865-2e91-4332-baec-49f653601292 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.174346 Apr 08 11:22:57.608141 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 459/913] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:57 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:57.636180 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b1fdf56d-3f38-4cb0-9836-d3e16849dd1e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:57.636797 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b1fdf56d-3f38-4cb0-9836-d3e16849dd1e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:57.643172 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b1fdf56d-3f38-4cb0-9836-d3e16849dd1e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:57.643637 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b1fdf56d-3f38-4cb0-9836-d3e16849dd1e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:57.645012 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b1fdf56d-3f38-4cb0-9836-d3e16849dd1e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:57.645461 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b1fdf56d-3f38-4cb0-9836-d3e16849dd1e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:57.708766 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b1fdf56d-3f38-4cb0-9836-d3e16849dd1e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:57.716283 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b1fdf56d-3f38-4cb0-9836-d3e16849dd1e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.083935 Apr 08 11:22:57.716827 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 455/914] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:57 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:58.407611 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-d182d9ff-13b3-470f-81ec-fc78338dc875 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:58.408215 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-d182d9ff-13b3-470f-81ec-fc78338dc875 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:58.414666 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d182d9ff-13b3-470f-81ec-fc78338dc875 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:58.428296 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d182d9ff-13b3-470f-81ec-fc78338dc875 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:58.428296 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d182d9ff-13b3-470f-81ec-fc78338dc875 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:58.428296 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d182d9ff-13b3-470f-81ec-fc78338dc875 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:58.550065 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d182d9ff-13b3-470f-81ec-fc78338dc875 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:58.559429 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d182d9ff-13b3-470f-81ec-fc78338dc875 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:58.560932 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d182d9ff-13b3-470f-81ec-fc78338dc875 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:58.562149 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-d182d9ff-13b3-470f-81ec-fc78338dc875 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.158430 Apr 08 11:22:58.562717 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 460/915] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:58 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:58.571225 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e148445f-63a3-4007-accc-221f2c779aa5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:58.572176 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e148445f-63a3-4007-accc-221f2c779aa5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:58.578614 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e148445f-63a3-4007-accc-221f2c779aa5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:58.605710 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e148445f-63a3-4007-accc-221f2c779aa5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:58.605710 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e148445f-63a3-4007-accc-221f2c779aa5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:58.605710 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e148445f-63a3-4007-accc-221f2c779aa5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:58.610043 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e148445f-63a3-4007-accc-221f2c779aa5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042923 Apr 08 11:22:58.610612 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 456/916] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:22:58 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:22:58.627803 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-0c3f7270-ea7e-45a7-85d6-d23ea1846287 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:58.628425 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-0c3f7270-ea7e-45a7-85d6-d23ea1846287 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:58.634329 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0c3f7270-ea7e-45a7-85d6-d23ea1846287 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:58.634779 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0c3f7270-ea7e-45a7-85d6-d23ea1846287 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:58.635554 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0c3f7270-ea7e-45a7-85d6-d23ea1846287 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:58.635994 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0c3f7270-ea7e-45a7-85d6-d23ea1846287 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:58.732968 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7acae1bd-08d3-463d-971a-18c4aae6b2e8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:58.733599 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7acae1bd-08d3-463d-971a-18c4aae6b2e8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:58.739754 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7acae1bd-08d3-463d-971a-18c4aae6b2e8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:58.740222 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7acae1bd-08d3-463d-971a-18c4aae6b2e8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:58.740990 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7acae1bd-08d3-463d-971a-18c4aae6b2e8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:58.741441 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7acae1bd-08d3-463d-971a-18c4aae6b2e8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:58.791710 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-0c3f7270-ea7e-45a7-85d6-d23ea1846287 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:58.799192 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-0c3f7270-ea7e-45a7-85d6-d23ea1846287 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.175262 Apr 08 11:22:58.799782 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 461/917] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:58 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:22:58.809931 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7acae1bd-08d3-463d-971a-18c4aae6b2e8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:58.817999 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7acae1bd-08d3-463d-971a-18c4aae6b2e8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.088932 Apr 08 11:22:58.818591 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 457/918] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:58 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:22:59.582797 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-df9f0599-726a-4013-a7de-4e8cfa8f9ab7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:59.583414 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-df9f0599-726a-4013-a7de-4e8cfa8f9ab7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:59.590544 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-df9f0599-726a-4013-a7de-4e8cfa8f9ab7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:59.591009 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-df9f0599-726a-4013-a7de-4e8cfa8f9ab7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:59.591782 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-df9f0599-726a-4013-a7de-4e8cfa8f9ab7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:59.592219 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-df9f0599-726a-4013-a7de-4e8cfa8f9ab7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:59.621494 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-abf57319-abd2-4b30-a2ed-7c337bb74849 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:59.622468 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-abf57319-abd2-4b30-a2ed-7c337bb74849 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:59.628999 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-abf57319-abd2-4b30-a2ed-7c337bb74849 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:59.640693 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-abf57319-abd2-4b30-a2ed-7c337bb74849 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:59.640693 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-abf57319-abd2-4b30-a2ed-7c337bb74849 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:59.640693 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-abf57319-abd2-4b30-a2ed-7c337bb74849 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:59.661258 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-abf57319-abd2-4b30-a2ed-7c337bb74849 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043846 Apr 08 11:22:59.661850 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 458/919] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:22:59 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:22:59.726471 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-df9f0599-726a-4013-a7de-4e8cfa8f9ab7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:59.734796 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-df9f0599-726a-4013-a7de-4e8cfa8f9ab7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:59.736307 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-df9f0599-726a-4013-a7de-4e8cfa8f9ab7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:59.738189 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-df9f0599-726a-4013-a7de-4e8cfa8f9ab7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.160828 Apr 08 11:22:59.799226 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 462/920] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:22:59 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:22:59.816059 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4684adf9-1587-4190-bd08-3df15c624db4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:59.816679 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4684adf9-1587-4190-bd08-3df15c624db4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:59.822627 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4684adf9-1587-4190-bd08-3df15c624db4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:59.823080 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4684adf9-1587-4190-bd08-3df15c624db4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:59.823858 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4684adf9-1587-4190-bd08-3df15c624db4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:59.824296 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4684adf9-1587-4190-bd08-3df15c624db4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:59.834550 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-33f81064-3e46-49d2-862d-017eaa412ff2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:22:59.835099 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-33f81064-3e46-49d2-862d-017eaa412ff2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:22:59.840878 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-33f81064-3e46-49d2-862d-017eaa412ff2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:59.841333 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-33f81064-3e46-49d2-862d-017eaa412ff2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:59.842131 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-33f81064-3e46-49d2-862d-017eaa412ff2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:22:59.842614 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-33f81064-3e46-49d2-862d-017eaa412ff2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:22:59.924065 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-33f81064-3e46-49d2-862d-017eaa412ff2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:59.931919 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-33f81064-3e46-49d2-862d-017eaa412ff2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.101200 Apr 08 11:22:59.932544 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 463/921] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:59 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:22:59.992365 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4684adf9-1587-4190-bd08-3df15c624db4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:22:59.999940 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4684adf9-1587-4190-bd08-3df15c624db4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.187751 Apr 08 11:23:00.000500 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 459/922] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:22:59 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:00.673093 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-ecafaa12-6e83-4b86-8a06-5090276bbc31 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:00.674066 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-ecafaa12-6e83-4b86-8a06-5090276bbc31 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:00.680922 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ecafaa12-6e83-4b86-8a06-5090276bbc31 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:00.681379 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ecafaa12-6e83-4b86-8a06-5090276bbc31 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:00.682178 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ecafaa12-6e83-4b86-8a06-5090276bbc31 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:00.682621 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ecafaa12-6e83-4b86-8a06-5090276bbc31 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:00.718856 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-ecafaa12-6e83-4b86-8a06-5090276bbc31 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049840 Apr 08 11:23:00.719432 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 464/923] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:00 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:00.759046 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-666feef1-1a64-4002-904f-94bffb79a19e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:00.759650 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-666feef1-1a64-4002-904f-94bffb79a19e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:00.765927 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-666feef1-1a64-4002-904f-94bffb79a19e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:00.766373 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-666feef1-1a64-4002-904f-94bffb79a19e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:00.767134 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-666feef1-1a64-4002-904f-94bffb79a19e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:00.767564 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-666feef1-1a64-4002-904f-94bffb79a19e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:00.898862 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-666feef1-1a64-4002-904f-94bffb79a19e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:00.906945 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-666feef1-1a64-4002-904f-94bffb79a19e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:00.908449 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-666feef1-1a64-4002-904f-94bffb79a19e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:00.909645 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-666feef1-1a64-4002-904f-94bffb79a19e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.154528 Apr 08 11:23:00.910236 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 460/924] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:00 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:23:00.948207 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-f5dd877b-660a-47d7-ac1a-620c7ea7ca31 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:00.948833 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-f5dd877b-660a-47d7-ac1a-620c7ea7ca31 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:00.954704 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f5dd877b-660a-47d7-ac1a-620c7ea7ca31 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:00.955169 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f5dd877b-660a-47d7-ac1a-620c7ea7ca31 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:00.955943 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f5dd877b-660a-47d7-ac1a-620c7ea7ca31 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:00.956387 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f5dd877b-660a-47d7-ac1a-620c7ea7ca31 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:01.014844 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f5dd877b-660a-47d7-ac1a-620c7ea7ca31 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:01.016438 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2d03de46-5b18-4173-a324-4d20708a5b7f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:01.017299 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2d03de46-5b18-4173-a324-4d20708a5b7f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:01.022274 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-f5dd877b-660a-47d7-ac1a-620c7ea7ca31 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077839 Apr 08 11:23:01.022844 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 465/925] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:00 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:01.023621 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2d03de46-5b18-4173-a324-4d20708a5b7f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:01.024102 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2d03de46-5b18-4173-a324-4d20708a5b7f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:01.024914 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2d03de46-5b18-4173-a324-4d20708a5b7f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:01.025352 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2d03de46-5b18-4173-a324-4d20708a5b7f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:01.160925 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2d03de46-5b18-4173-a324-4d20708a5b7f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:01.168253 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2d03de46-5b18-4173-a324-4d20708a5b7f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.155701 Apr 08 11:23:01.168810 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 461/926] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:01 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:23:01.184960 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 11:23:01.185115 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: Fri Apr 8 11:23:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 11:23:01.730708 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-5d9ba2ea-2701-4060-a884-1cb77155450c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:01.731682 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-5d9ba2ea-2701-4060-a884-1cb77155450c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:01.738320 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5d9ba2ea-2701-4060-a884-1cb77155450c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:01.738777 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5d9ba2ea-2701-4060-a884-1cb77155450c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:01.739556 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5d9ba2ea-2701-4060-a884-1cb77155450c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:01.740007 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5d9ba2ea-2701-4060-a884-1cb77155450c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:01.770986 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-5d9ba2ea-2701-4060-a884-1cb77155450c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044249 Apr 08 11:23:01.771549 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 466/927] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:01 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:01.927923 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e1dad723-ec80-457a-be66-71b590cee9f1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:01.928471 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e1dad723-ec80-457a-be66-71b590cee9f1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:01.935090 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e1dad723-ec80-457a-be66-71b590cee9f1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:01.935549 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e1dad723-ec80-457a-be66-71b590cee9f1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:01.936329 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e1dad723-ec80-457a-be66-71b590cee9f1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:01.936771 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e1dad723-ec80-457a-be66-71b590cee9f1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:02.038935 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-10a722af-234a-4f4d-85bb-6f5645e5e83f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:02.039550 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-10a722af-234a-4f4d-85bb-6f5645e5e83f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:02.045659 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-10a722af-234a-4f4d-85bb-6f5645e5e83f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:02.046140 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-10a722af-234a-4f4d-85bb-6f5645e5e83f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:02.046884 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-10a722af-234a-4f4d-85bb-6f5645e5e83f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:02.047323 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-10a722af-234a-4f4d-85bb-6f5645e5e83f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:02.069513 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e1dad723-ec80-457a-be66-71b590cee9f1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:02.077837 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e1dad723-ec80-457a-be66-71b590cee9f1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:02.079338 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e1dad723-ec80-457a-be66-71b590cee9f1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:02.080490 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e1dad723-ec80-457a-be66-71b590cee9f1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.156603 Apr 08 11:23:02.081104 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 462/928] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:01 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:23:02.106877 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-10a722af-234a-4f4d-85bb-6f5645e5e83f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:02.114877 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-10a722af-234a-4f4d-85bb-6f5645e5e83f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079796 Apr 08 11:23:02.115457 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 467/929] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:02 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:23:02.186513 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b442a364-2087-443f-b387-f151a6feebdb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:02.187041 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b442a364-2087-443f-b387-f151a6feebdb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:02.193187 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b442a364-2087-443f-b387-f151a6feebdb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:02.193628 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b442a364-2087-443f-b387-f151a6feebdb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:02.194426 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b442a364-2087-443f-b387-f151a6feebdb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:02.194858 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b442a364-2087-443f-b387-f151a6feebdb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:02.331964 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b442a364-2087-443f-b387-f151a6feebdb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:02.339290 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b442a364-2087-443f-b387-f151a6feebdb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.156764 Apr 08 11:23:02.339857 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 463/930] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:02 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:02.782345 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-24814c12-1fd6-4b8c-8f92-624e3298b1c6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:02.783286 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-24814c12-1fd6-4b8c-8f92-624e3298b1c6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:02.789638 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-24814c12-1fd6-4b8c-8f92-624e3298b1c6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:02.790122 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-24814c12-1fd6-4b8c-8f92-624e3298b1c6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:02.790899 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-24814c12-1fd6-4b8c-8f92-624e3298b1c6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:02.791341 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-24814c12-1fd6-4b8c-8f92-624e3298b1c6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:02.821009 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-24814c12-1fd6-4b8c-8f92-624e3298b1c6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042734 Apr 08 11:23:02.821653 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 468/931] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:02 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:03.098320 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-317ebcfb-da07-4e3b-bae3-60329f05c774 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:03.098953 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-317ebcfb-da07-4e3b-bae3-60329f05c774 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:03.105194 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-317ebcfb-da07-4e3b-bae3-60329f05c774 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:03.105638 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-317ebcfb-da07-4e3b-bae3-60329f05c774 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:03.106441 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-317ebcfb-da07-4e3b-bae3-60329f05c774 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:03.106875 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-317ebcfb-da07-4e3b-bae3-60329f05c774 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:03.132227 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2a6a81a1-2bd6-4ac9-9a5c-c37c78b713d1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:03.132956 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-2a6a81a1-2bd6-4ac9-9a5c-c37c78b713d1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:03.139286 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2a6a81a1-2bd6-4ac9-9a5c-c37c78b713d1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:03.139775 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2a6a81a1-2bd6-4ac9-9a5c-c37c78b713d1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:03.140563 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2a6a81a1-2bd6-4ac9-9a5c-c37c78b713d1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:03.141006 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2a6a81a1-2bd6-4ac9-9a5c-c37c78b713d1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:03.206657 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2a6a81a1-2bd6-4ac9-9a5c-c37c78b713d1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:03.215393 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-2a6a81a1-2bd6-4ac9-9a5c-c37c78b713d1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.087503 Apr 08 11:23:03.216025 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 469/932] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:03 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:23:03.282498 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-317ebcfb-da07-4e3b-bae3-60329f05c774 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:03.291321 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-317ebcfb-da07-4e3b-bae3-60329f05c774 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:03.292808 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-317ebcfb-da07-4e3b-bae3-60329f05c774 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:03.293996 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-317ebcfb-da07-4e3b-bae3-60329f05c774 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.199533 Apr 08 11:23:03.294587 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 464/933] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:03 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:23:03.364263 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-39aba0da-4051-46b2-9bfa-58fe0899f6f8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:03.364795 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-39aba0da-4051-46b2-9bfa-58fe0899f6f8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:03.371157 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-39aba0da-4051-46b2-9bfa-58fe0899f6f8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:03.371612 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-39aba0da-4051-46b2-9bfa-58fe0899f6f8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:03.372386 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-39aba0da-4051-46b2-9bfa-58fe0899f6f8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:03.372831 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-39aba0da-4051-46b2-9bfa-58fe0899f6f8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:03.504429 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-39aba0da-4051-46b2-9bfa-58fe0899f6f8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:03.511902 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-39aba0da-4051-46b2-9bfa-58fe0899f6f8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.152295 Apr 08 11:23:03.512463 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 470/934] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:03 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:03.833303 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-74048bb6-ccb7-4e24-a241-c4ab28b0b6bb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:03.834267 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-74048bb6-ccb7-4e24-a241-c4ab28b0b6bb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:03.840340 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-74048bb6-ccb7-4e24-a241-c4ab28b0b6bb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:03.840793 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-74048bb6-ccb7-4e24-a241-c4ab28b0b6bb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:03.841570 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-74048bb6-ccb7-4e24-a241-c4ab28b0b6bb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:03.842051 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-74048bb6-ccb7-4e24-a241-c4ab28b0b6bb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:03.870259 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-74048bb6-ccb7-4e24-a241-c4ab28b0b6bb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041446 Apr 08 11:23:03.870808 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 465/935] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:03 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:04.232048 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-3a941d0a-0304-4081-af4c-baf232cb5708 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:04.232676 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-3a941d0a-0304-4081-af4c-baf232cb5708 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:04.239134 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3a941d0a-0304-4081-af4c-baf232cb5708 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:04.239655 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3a941d0a-0304-4081-af4c-baf232cb5708 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:04.240370 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3a941d0a-0304-4081-af4c-baf232cb5708 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:04.240813 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3a941d0a-0304-4081-af4c-baf232cb5708 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:04.300964 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-3a941d0a-0304-4081-af4c-baf232cb5708 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:04.308308 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-3a941d0a-0304-4081-af4c-baf232cb5708 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080190 Apr 08 11:23:04.308888 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 471/936] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:04 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:04.312770 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5fe566fe-b63c-4f24-923b-139276416415 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:04.313389 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5fe566fe-b63c-4f24-923b-139276416415 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:04.320127 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5fe566fe-b63c-4f24-923b-139276416415 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:04.320581 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5fe566fe-b63c-4f24-923b-139276416415 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:04.321356 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5fe566fe-b63c-4f24-923b-139276416415 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:04.321818 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5fe566fe-b63c-4f24-923b-139276416415 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:04.456419 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5fe566fe-b63c-4f24-923b-139276416415 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:04.464716 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5fe566fe-b63c-4f24-923b-139276416415 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:04.466326 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5fe566fe-b63c-4f24-923b-139276416415 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:04.467486 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5fe566fe-b63c-4f24-923b-139276416415 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.158853 Apr 08 11:23:04.468036 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 466/937] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:04 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:23:04.528321 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-f7a038d9-d9f2-4ddd-a3aa-cee36e79c811 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:04.528948 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-f7a038d9-d9f2-4ddd-a3aa-cee36e79c811 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:04.534815 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f7a038d9-d9f2-4ddd-a3aa-cee36e79c811 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:04.535269 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f7a038d9-d9f2-4ddd-a3aa-cee36e79c811 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:04.536048 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f7a038d9-d9f2-4ddd-a3aa-cee36e79c811 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:04.536487 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f7a038d9-d9f2-4ddd-a3aa-cee36e79c811 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:04.669020 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f7a038d9-d9f2-4ddd-a3aa-cee36e79c811 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:04.677025 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-f7a038d9-d9f2-4ddd-a3aa-cee36e79c811 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.152532 Apr 08 11:23:04.678569 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 472/938] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:04 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:04.882379 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0eddcac7-f837-4597-ab27-c08030bdd589 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:04.883217 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0eddcac7-f837-4597-ab27-c08030bdd589 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:04.889171 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0eddcac7-f837-4597-ab27-c08030bdd589 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:04.889618 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0eddcac7-f837-4597-ab27-c08030bdd589 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:04.890411 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0eddcac7-f837-4597-ab27-c08030bdd589 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:04.890844 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0eddcac7-f837-4597-ab27-c08030bdd589 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:04.920197 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0eddcac7-f837-4597-ab27-c08030bdd589 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042234 Apr 08 11:23:04.920753 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 467/939] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:04 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:05.325049 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-c846f152-2351-4815-8f49-74b309888bd1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:05.325664 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-c846f152-2351-4815-8f49-74b309888bd1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:05.332011 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c846f152-2351-4815-8f49-74b309888bd1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:05.332465 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c846f152-2351-4815-8f49-74b309888bd1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:05.333236 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c846f152-2351-4815-8f49-74b309888bd1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:05.333675 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c846f152-2351-4815-8f49-74b309888bd1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:05.393295 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-c846f152-2351-4815-8f49-74b309888bd1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:05.400711 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-c846f152-2351-4815-8f49-74b309888bd1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079531 Apr 08 11:23:05.401278 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 473/940] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:05 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:05.486007 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f9556a73-58f3-47cd-9e78-4f1f7192e4d0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:05.486634 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f9556a73-58f3-47cd-9e78-4f1f7192e4d0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:05.493583 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f9556a73-58f3-47cd-9e78-4f1f7192e4d0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:05.494073 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f9556a73-58f3-47cd-9e78-4f1f7192e4d0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:05.495103 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f9556a73-58f3-47cd-9e78-4f1f7192e4d0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:05.495540 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f9556a73-58f3-47cd-9e78-4f1f7192e4d0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:05.630825 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f9556a73-58f3-47cd-9e78-4f1f7192e4d0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:05.640594 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f9556a73-58f3-47cd-9e78-4f1f7192e4d0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:05.642133 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f9556a73-58f3-47cd-9e78-4f1f7192e4d0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:05.643328 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f9556a73-58f3-47cd-9e78-4f1f7192e4d0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.161242 Apr 08 11:23:05.644088 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 468/941] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:05 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:23:05.694571 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-4f97e92b-a8d0-4789-95bb-7d1c5e1709ab tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:05.695181 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-4f97e92b-a8d0-4789-95bb-7d1c5e1709ab tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:05.701201 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4f97e92b-a8d0-4789-95bb-7d1c5e1709ab tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:05.701650 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4f97e92b-a8d0-4789-95bb-7d1c5e1709ab tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:05.702439 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4f97e92b-a8d0-4789-95bb-7d1c5e1709ab tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:05.702880 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4f97e92b-a8d0-4789-95bb-7d1c5e1709ab tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:05.835898 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-4f97e92b-a8d0-4789-95bb-7d1c5e1709ab tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:05.843231 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-4f97e92b-a8d0-4789-95bb-7d1c5e1709ab tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.152601 Apr 08 11:23:05.843797 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 474/942] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:05 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:05.931604 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ff4e8be0-6878-41a6-ad12-3f85cd34d274 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:05.932547 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ff4e8be0-6878-41a6-ad12-3f85cd34d274 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:05.938422 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ff4e8be0-6878-41a6-ad12-3f85cd34d274 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:05.938875 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ff4e8be0-6878-41a6-ad12-3f85cd34d274 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:05.939636 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ff4e8be0-6878-41a6-ad12-3f85cd34d274 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:05.940067 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ff4e8be0-6878-41a6-ad12-3f85cd34d274 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:05.967902 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ff4e8be0-6878-41a6-ad12-3f85cd34d274 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040196 Apr 08 11:23:05.968441 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 469/943] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:05 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:06.417263 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-6c40beba-efa5-4a42-b75a-7c076d1543ba tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:06.417901 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-6c40beba-efa5-4a42-b75a-7c076d1543ba tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:06.424190 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6c40beba-efa5-4a42-b75a-7c076d1543ba tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:06.425297 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6c40beba-efa5-4a42-b75a-7c076d1543ba tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:06.426130 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6c40beba-efa5-4a42-b75a-7c076d1543ba tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:06.426569 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6c40beba-efa5-4a42-b75a-7c076d1543ba tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:06.485794 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6c40beba-efa5-4a42-b75a-7c076d1543ba tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:06.493806 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-6c40beba-efa5-4a42-b75a-7c076d1543ba tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080428 Apr 08 11:23:06.494619 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 475/944] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:06 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:06.661104 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6ee596d7-f761-4841-a053-e1e2ffeae815 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:06.661725 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6ee596d7-f761-4841-a053-e1e2ffeae815 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:06.668217 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6ee596d7-f761-4841-a053-e1e2ffeae815 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:06.668720 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6ee596d7-f761-4841-a053-e1e2ffeae815 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:06.669500 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6ee596d7-f761-4841-a053-e1e2ffeae815 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:06.669981 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6ee596d7-f761-4841-a053-e1e2ffeae815 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:06.804834 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6ee596d7-f761-4841-a053-e1e2ffeae815 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:06.813198 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6ee596d7-f761-4841-a053-e1e2ffeae815 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:06.814933 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6ee596d7-f761-4841-a053-e1e2ffeae815 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:06.815967 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6ee596d7-f761-4841-a053-e1e2ffeae815 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.159417 Apr 08 11:23:06.816526 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 470/945] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:06 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:23:06.860285 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-6a6e5ab4-90df-4bd6-b00e-84cd7fa69480 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:06.860898 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-6a6e5ab4-90df-4bd6-b00e-84cd7fa69480 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:06.866820 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6a6e5ab4-90df-4bd6-b00e-84cd7fa69480 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:06.867267 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6a6e5ab4-90df-4bd6-b00e-84cd7fa69480 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:06.868033 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6a6e5ab4-90df-4bd6-b00e-84cd7fa69480 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:06.868469 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6a6e5ab4-90df-4bd6-b00e-84cd7fa69480 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:06.979908 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-238c140e-c411-4fcb-a5fe-126a0c6ff742 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:06.980844 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-238c140e-c411-4fcb-a5fe-126a0c6ff742 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:06.986634 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-238c140e-c411-4fcb-a5fe-126a0c6ff742 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:06.987094 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-238c140e-c411-4fcb-a5fe-126a0c6ff742 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:06.987878 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-238c140e-c411-4fcb-a5fe-126a0c6ff742 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:06.988371 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-238c140e-c411-4fcb-a5fe-126a0c6ff742 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:07.008893 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6a6e5ab4-90df-4bd6-b00e-84cd7fa69480 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:07.016226 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-6a6e5ab4-90df-4bd6-b00e-84cd7fa69480 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.159815 Apr 08 11:23:07.016806 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 476/946] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:06 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:07.017046 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-238c140e-c411-4fcb-a5fe-126a0c6ff742 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041003 Apr 08 11:23:07.017600 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 471/947] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:06 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:07.510599 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-7689f2f1-1161-44d6-a127-266a0d2647a0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:07.511249 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-7689f2f1-1161-44d6-a127-266a0d2647a0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:07.517541 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7689f2f1-1161-44d6-a127-266a0d2647a0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:07.518024 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7689f2f1-1161-44d6-a127-266a0d2647a0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:07.518797 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7689f2f1-1161-44d6-a127-266a0d2647a0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:07.519236 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7689f2f1-1161-44d6-a127-266a0d2647a0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:07.582452 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-7689f2f1-1161-44d6-a127-266a0d2647a0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:07.589804 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-7689f2f1-1161-44d6-a127-266a0d2647a0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.083089 Apr 08 11:23:07.590370 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 477/948] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:07 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:07.834100 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-14199dd1-38a1-4773-b95e-3b959ef0cdb1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:07.834704 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-14199dd1-38a1-4773-b95e-3b959ef0cdb1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:07.841089 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-14199dd1-38a1-4773-b95e-3b959ef0cdb1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:07.841536 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-14199dd1-38a1-4773-b95e-3b959ef0cdb1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:07.842339 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-14199dd1-38a1-4773-b95e-3b959ef0cdb1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:07.842771 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-14199dd1-38a1-4773-b95e-3b959ef0cdb1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:07.979135 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-14199dd1-38a1-4773-b95e-3b959ef0cdb1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:07.988095 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-14199dd1-38a1-4773-b95e-3b959ef0cdb1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:07.989654 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-14199dd1-38a1-4773-b95e-3b959ef0cdb1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:07.990847 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-14199dd1-38a1-4773-b95e-3b959ef0cdb1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.160671 Apr 08 11:23:07.991407 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 472/949] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:07 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:23:08.029076 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-aad55385-a2ec-4a6a-a21e-66f95c50be42 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:08.030062 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-aad55385-a2ec-4a6a-a21e-66f95c50be42 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:08.034775 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-452c9e2f-8ca2-4d64-a541-8da23dac10de tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:08.035430 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-452c9e2f-8ca2-4d64-a541-8da23dac10de tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:08.036718 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-aad55385-a2ec-4a6a-a21e-66f95c50be42 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:08.037179 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-aad55385-a2ec-4a6a-a21e-66f95c50be42 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:08.038008 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-aad55385-a2ec-4a6a-a21e-66f95c50be42 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:08.038457 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-aad55385-a2ec-4a6a-a21e-66f95c50be42 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:08.041256 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-452c9e2f-8ca2-4d64-a541-8da23dac10de tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:08.041720 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-452c9e2f-8ca2-4d64-a541-8da23dac10de tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:08.050118 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-452c9e2f-8ca2-4d64-a541-8da23dac10de tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:08.050118 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-452c9e2f-8ca2-4d64-a541-8da23dac10de tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:08.067651 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-aad55385-a2ec-4a6a-a21e-66f95c50be42 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042385 Apr 08 11:23:08.068456 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 478/950] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:08 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:08.177306 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-452c9e2f-8ca2-4d64-a541-8da23dac10de tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:08.184876 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-452c9e2f-8ca2-4d64-a541-8da23dac10de tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.154741 Apr 08 11:23:08.185447 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 473/951] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:08 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:23:08.606627 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-df1e4e89-c9cc-4b9c-b156-d6afbbb63f9d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:08.607273 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-df1e4e89-c9cc-4b9c-b156-d6afbbb63f9d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:08.614311 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-df1e4e89-c9cc-4b9c-b156-d6afbbb63f9d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:08.614767 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-df1e4e89-c9cc-4b9c-b156-d6afbbb63f9d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:08.615541 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-df1e4e89-c9cc-4b9c-b156-d6afbbb63f9d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:08.615981 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-df1e4e89-c9cc-4b9c-b156-d6afbbb63f9d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:08.679034 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-df1e4e89-c9cc-4b9c-b156-d6afbbb63f9d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:08.686545 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-df1e4e89-c9cc-4b9c-b156-d6afbbb63f9d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.083787 Apr 08 11:23:08.687114 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 479/952] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:08 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:09.008451 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-452d8523-6529-4809-aff5-6f3c9c77c1ac tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:09.009065 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-452d8523-6529-4809-aff5-6f3c9c77c1ac tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:09.015397 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-452d8523-6529-4809-aff5-6f3c9c77c1ac tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:09.015851 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-452d8523-6529-4809-aff5-6f3c9c77c1ac tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:09.016627 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-452d8523-6529-4809-aff5-6f3c9c77c1ac tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:09.017070 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-452d8523-6529-4809-aff5-6f3c9c77c1ac tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:09.079385 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-af5aca9b-a361-40dc-8ba9-7779a765284f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:09.080309 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-af5aca9b-a361-40dc-8ba9-7779a765284f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:09.086794 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-af5aca9b-a361-40dc-8ba9-7779a765284f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:09.087235 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-af5aca9b-a361-40dc-8ba9-7779a765284f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:09.088016 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-af5aca9b-a361-40dc-8ba9-7779a765284f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:09.088450 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-af5aca9b-a361-40dc-8ba9-7779a765284f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:09.117837 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-af5aca9b-a361-40dc-8ba9-7779a765284f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042369 Apr 08 11:23:09.118663 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 480/953] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:09 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:23:09.149886 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-452d8523-6529-4809-aff5-6f3c9c77c1ac tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:09.158096 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-452d8523-6529-4809-aff5-6f3c9c77c1ac tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:09.160262 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-452d8523-6529-4809-aff5-6f3c9c77c1ac tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:09.161429 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-452d8523-6529-4809-aff5-6f3c9c77c1ac tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.156901 Apr 08 11:23:09.162006 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 474/954] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:09 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:23:09.201413 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-c60d4080-b8c1-4964-9d3a-965b6564a3d2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:09.202040 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-c60d4080-b8c1-4964-9d3a-965b6564a3d2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:09.208452 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c60d4080-b8c1-4964-9d3a-965b6564a3d2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:09.208909 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c60d4080-b8c1-4964-9d3a-965b6564a3d2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:09.209676 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c60d4080-b8c1-4964-9d3a-965b6564a3d2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:09.210162 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c60d4080-b8c1-4964-9d3a-965b6564a3d2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:09.342360 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-c60d4080-b8c1-4964-9d3a-965b6564a3d2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:09.349715 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-c60d4080-b8c1-4964-9d3a-965b6564a3d2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.152057 Apr 08 11:23:09.350316 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 481/955] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:09 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:09.703172 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-049e25e3-7a28-4186-a5d5-cd7fa2964d9e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:09.703780 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-049e25e3-7a28-4186-a5d5-cd7fa2964d9e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:09.710240 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-049e25e3-7a28-4186-a5d5-cd7fa2964d9e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:09.710697 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-049e25e3-7a28-4186-a5d5-cd7fa2964d9e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:09.711470 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-049e25e3-7a28-4186-a5d5-cd7fa2964d9e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:09.711909 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-049e25e3-7a28-4186-a5d5-cd7fa2964d9e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:09.774151 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-049e25e3-7a28-4186-a5d5-cd7fa2964d9e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:09.781568 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-049e25e3-7a28-4186-a5d5-cd7fa2964d9e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082267 Apr 08 11:23:09.782179 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 475/956] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:09 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:10.130401 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-4d83bfc8-88ce-4354-8212-49cb52ee20ac tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:10.131336 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-4d83bfc8-88ce-4354-8212-49cb52ee20ac tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:10.137591 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4d83bfc8-88ce-4354-8212-49cb52ee20ac tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:10.138080 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4d83bfc8-88ce-4354-8212-49cb52ee20ac tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:10.138858 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4d83bfc8-88ce-4354-8212-49cb52ee20ac tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:10.139306 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4d83bfc8-88ce-4354-8212-49cb52ee20ac tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:10.168163 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-4d83bfc8-88ce-4354-8212-49cb52ee20ac tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042246 Apr 08 11:23:10.168715 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 482/957] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:10 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:10.179343 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1506cd26-48e6-463d-97e1-70f269ce483c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:10.179954 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1506cd26-48e6-463d-97e1-70f269ce483c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:10.186218 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1506cd26-48e6-463d-97e1-70f269ce483c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:10.186672 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1506cd26-48e6-463d-97e1-70f269ce483c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:10.187431 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1506cd26-48e6-463d-97e1-70f269ce483c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:10.187865 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1506cd26-48e6-463d-97e1-70f269ce483c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:10.318391 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1506cd26-48e6-463d-97e1-70f269ce483c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:10.326515 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1506cd26-48e6-463d-97e1-70f269ce483c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:10.328011 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1506cd26-48e6-463d-97e1-70f269ce483c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:10.329158 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1506cd26-48e6-463d-97e1-70f269ce483c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.153680 Apr 08 11:23:10.329709 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 476/958] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:10 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:23:10.366594 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-26c9f294-4fa4-4714-b1ac-9221ec27890d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:10.367217 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-26c9f294-4fa4-4714-b1ac-9221ec27890d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:10.373368 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-26c9f294-4fa4-4714-b1ac-9221ec27890d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:10.386655 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-26c9f294-4fa4-4714-b1ac-9221ec27890d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:10.386655 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-26c9f294-4fa4-4714-b1ac-9221ec27890d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:10.386655 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-26c9f294-4fa4-4714-b1ac-9221ec27890d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:10.507696 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-26c9f294-4fa4-4714-b1ac-9221ec27890d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:10.515067 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-26c9f294-4fa4-4714-b1ac-9221ec27890d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.152342 Apr 08 11:23:10.515639 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 483/959] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:10 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:10.798913 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bb199c92-f0d0-445c-be88-689994f5e0aa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:10.800117 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-bb199c92-f0d0-445c-be88-689994f5e0aa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:10.806143 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bb199c92-f0d0-445c-be88-689994f5e0aa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:10.806602 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bb199c92-f0d0-445c-be88-689994f5e0aa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:10.807429 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bb199c92-f0d0-445c-be88-689994f5e0aa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:10.807900 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bb199c92-f0d0-445c-be88-689994f5e0aa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:10.871513 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-bb199c92-f0d0-445c-be88-689994f5e0aa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:10.879074 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-bb199c92-f0d0-445c-be88-689994f5e0aa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.084008 Apr 08 11:23:10.879641 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 477/960] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:10 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:11.179092 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-f2e8a74c-486d-495b-bddc-02f60ae41532 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:11.180011 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-f2e8a74c-486d-495b-bddc-02f60ae41532 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:11.186246 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f2e8a74c-486d-495b-bddc-02f60ae41532 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:11.186692 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f2e8a74c-486d-495b-bddc-02f60ae41532 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:11.187468 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f2e8a74c-486d-495b-bddc-02f60ae41532 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:11.187888 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f2e8a74c-486d-495b-bddc-02f60ae41532 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:11.215810 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-f2e8a74c-486d-495b-bddc-02f60ae41532 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040650 Apr 08 11:23:11.216353 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 484/961] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:11 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:11.348574 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c19e9199-4e44-4ad1-965c-09c7b3c6d141 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:11.349179 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c19e9199-4e44-4ad1-965c-09c7b3c6d141 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:11.355475 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c19e9199-4e44-4ad1-965c-09c7b3c6d141 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:11.355925 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c19e9199-4e44-4ad1-965c-09c7b3c6d141 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:11.356669 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c19e9199-4e44-4ad1-965c-09c7b3c6d141 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:11.357107 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c19e9199-4e44-4ad1-965c-09c7b3c6d141 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:11.486975 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c19e9199-4e44-4ad1-965c-09c7b3c6d141 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:11.495372 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c19e9199-4e44-4ad1-965c-09c7b3c6d141 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:11.496875 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c19e9199-4e44-4ad1-965c-09c7b3c6d141 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:11.498056 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c19e9199-4e44-4ad1-965c-09c7b3c6d141 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.153959 Apr 08 11:23:11.498638 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 478/962] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:11 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:23:11.531728 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-1902ec50-66b0-4996-a9c9-e5a8db18f5ee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:11.532344 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-1902ec50-66b0-4996-a9c9-e5a8db18f5ee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:11.538234 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1902ec50-66b0-4996-a9c9-e5a8db18f5ee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:11.538703 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1902ec50-66b0-4996-a9c9-e5a8db18f5ee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:11.539452 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1902ec50-66b0-4996-a9c9-e5a8db18f5ee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:11.539891 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1902ec50-66b0-4996-a9c9-e5a8db18f5ee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:11.672468 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1902ec50-66b0-4996-a9c9-e5a8db18f5ee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:11.679744 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-1902ec50-66b0-4996-a9c9-e5a8db18f5ee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.151812 Apr 08 11:23:11.680374 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 485/963] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:11 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:11.896482 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bbcf80e8-4bb8-49e7-b74c-cb96a0dfa92f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:11.897094 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-bbcf80e8-4bb8-49e7-b74c-cb96a0dfa92f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:11.903327 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bbcf80e8-4bb8-49e7-b74c-cb96a0dfa92f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:11.903779 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bbcf80e8-4bb8-49e7-b74c-cb96a0dfa92f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:11.904566 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bbcf80e8-4bb8-49e7-b74c-cb96a0dfa92f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:11.905053 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bbcf80e8-4bb8-49e7-b74c-cb96a0dfa92f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:11.970103 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-bbcf80e8-4bb8-49e7-b74c-cb96a0dfa92f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:11.978026 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-bbcf80e8-4bb8-49e7-b74c-cb96a0dfa92f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.085925 Apr 08 11:23:11.978611 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 479/964] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:11 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:12.234568 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-86e6f6d8-114b-4dd8-951e-51a797871b42 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:12.235559 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-86e6f6d8-114b-4dd8-951e-51a797871b42 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:12.242647 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-86e6f6d8-114b-4dd8-951e-51a797871b42 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:12.243106 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-86e6f6d8-114b-4dd8-951e-51a797871b42 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:12.243897 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-86e6f6d8-114b-4dd8-951e-51a797871b42 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:12.244609 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-86e6f6d8-114b-4dd8-951e-51a797871b42 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:12.277754 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-86e6f6d8-114b-4dd8-951e-51a797871b42 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053738 Apr 08 11:23:12.278666 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 486/965] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:12 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:12.515490 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-aec9cf3f-6b48-4c2e-a380-041677cec106 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:12.516163 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-aec9cf3f-6b48-4c2e-a380-041677cec106 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:12.522484 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aec9cf3f-6b48-4c2e-a380-041677cec106 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:12.522965 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aec9cf3f-6b48-4c2e-a380-041677cec106 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:12.523742 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aec9cf3f-6b48-4c2e-a380-041677cec106 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:12.524186 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aec9cf3f-6b48-4c2e-a380-041677cec106 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:12.661359 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-aec9cf3f-6b48-4c2e-a380-041677cec106 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:12.669712 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-aec9cf3f-6b48-4c2e-a380-041677cec106 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:12.671253 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-aec9cf3f-6b48-4c2e-a380-041677cec106 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:12.672444 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-aec9cf3f-6b48-4c2e-a380-041677cec106 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.160887 Apr 08 11:23:12.672997 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 480/966] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:12 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:23:12.696447 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e600d725-ef68-424e-ac3a-a5b3db6f8b93 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:12.697071 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e600d725-ef68-424e-ac3a-a5b3db6f8b93 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:12.703173 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e600d725-ef68-424e-ac3a-a5b3db6f8b93 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:12.703627 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e600d725-ef68-424e-ac3a-a5b3db6f8b93 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:12.704401 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e600d725-ef68-424e-ac3a-a5b3db6f8b93 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:12.704848 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e600d725-ef68-424e-ac3a-a5b3db6f8b93 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:12.844547 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e600d725-ef68-424e-ac3a-a5b3db6f8b93 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:12.853461 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e600d725-ef68-424e-ac3a-a5b3db6f8b93 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.160989 Apr 08 11:23:12.854078 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 487/967] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:12 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:12.995090 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c1f49574-d3b9-432c-8fc9-e73dbadc6de6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:12.995741 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c1f49574-d3b9-432c-8fc9-e73dbadc6de6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:13.003849 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c1f49574-d3b9-432c-8fc9-e73dbadc6de6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:13.004307 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c1f49574-d3b9-432c-8fc9-e73dbadc6de6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:13.005095 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c1f49574-d3b9-432c-8fc9-e73dbadc6de6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:13.005533 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c1f49574-d3b9-432c-8fc9-e73dbadc6de6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:13.072066 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c1f49574-d3b9-432c-8fc9-e73dbadc6de6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:13.075269 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c1f49574-d3b9-432c-8fc9-e73dbadc6de6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.084345 Apr 08 11:23:13.075847 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 481/968] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:12 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:13.291431 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-7692ea5e-6901-4d2e-b6c8-585d2e3d81c4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:13.292386 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-7692ea5e-6901-4d2e-b6c8-585d2e3d81c4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:13.299060 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7692ea5e-6901-4d2e-b6c8-585d2e3d81c4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:13.299510 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7692ea5e-6901-4d2e-b6c8-585d2e3d81c4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:13.300292 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7692ea5e-6901-4d2e-b6c8-585d2e3d81c4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:13.300737 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7692ea5e-6901-4d2e-b6c8-585d2e3d81c4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:13.330846 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-7692ea5e-6901-4d2e-b6c8-585d2e3d81c4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042812 Apr 08 11:23:13.331305 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 488/969] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:13 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:13.691231 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-97a0b24f-72e3-40c7-862a-19a190a67638 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:13.691822 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-97a0b24f-72e3-40c7-862a-19a190a67638 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:13.698108 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-97a0b24f-72e3-40c7-862a-19a190a67638 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:13.698559 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-97a0b24f-72e3-40c7-862a-19a190a67638 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:13.699543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-97a0b24f-72e3-40c7-862a-19a190a67638 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:13.700335 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-97a0b24f-72e3-40c7-862a-19a190a67638 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:13.833792 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-97a0b24f-72e3-40c7-862a-19a190a67638 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:13.842065 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-97a0b24f-72e3-40c7-862a-19a190a67638 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:13.843578 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-97a0b24f-72e3-40c7-862a-19a190a67638 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:13.844763 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-97a0b24f-72e3-40c7-862a-19a190a67638 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.158118 Apr 08 11:23:13.845314 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 482/970] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:13 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:23:13.870744 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-3ec51f58-af1c-42f1-b1e2-d576b2ebdea0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:13.871364 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-3ec51f58-af1c-42f1-b1e2-d576b2ebdea0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:13.877350 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3ec51f58-af1c-42f1-b1e2-d576b2ebdea0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:13.877832 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3ec51f58-af1c-42f1-b1e2-d576b2ebdea0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:13.878606 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3ec51f58-af1c-42f1-b1e2-d576b2ebdea0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:13.879048 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3ec51f58-af1c-42f1-b1e2-d576b2ebdea0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:14.018115 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-3ec51f58-af1c-42f1-b1e2-d576b2ebdea0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:14.025468 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-3ec51f58-af1c-42f1-b1e2-d576b2ebdea0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.158843 Apr 08 11:23:14.026074 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 489/971] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:13 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:14.092336 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-89ed5675-89e3-4eb4-8fbb-5327dfd5dc85 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:14.092972 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-89ed5675-89e3-4eb4-8fbb-5327dfd5dc85 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:14.099340 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-89ed5675-89e3-4eb4-8fbb-5327dfd5dc85 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:14.099787 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-89ed5675-89e3-4eb4-8fbb-5327dfd5dc85 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:14.100545 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-89ed5675-89e3-4eb4-8fbb-5327dfd5dc85 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:14.100978 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-89ed5675-89e3-4eb4-8fbb-5327dfd5dc85 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:14.164804 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-89ed5675-89e3-4eb4-8fbb-5327dfd5dc85 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:14.172401 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-89ed5675-89e3-4eb4-8fbb-5327dfd5dc85 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.083899 Apr 08 11:23:14.172972 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 483/972] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:14 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:14.342351 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-3be1c225-508d-4360-bfe9-c8f7cb2ba7e1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:14.343305 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-3be1c225-508d-4360-bfe9-c8f7cb2ba7e1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:14.350228 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3be1c225-508d-4360-bfe9-c8f7cb2ba7e1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:14.350683 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3be1c225-508d-4360-bfe9-c8f7cb2ba7e1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:14.351457 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3be1c225-508d-4360-bfe9-c8f7cb2ba7e1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:14.351894 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3be1c225-508d-4360-bfe9-c8f7cb2ba7e1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:14.380564 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-3be1c225-508d-4360-bfe9-c8f7cb2ba7e1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042157 Apr 08 11:23:14.381125 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 490/973] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:14 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:14.863430 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a7aedf30-d09e-4aed-ba8b-a025a36dfde6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:14.864053 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a7aedf30-d09e-4aed-ba8b-a025a36dfde6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:14.870608 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a7aedf30-d09e-4aed-ba8b-a025a36dfde6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:14.871062 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a7aedf30-d09e-4aed-ba8b-a025a36dfde6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:14.871836 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a7aedf30-d09e-4aed-ba8b-a025a36dfde6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:14.872279 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a7aedf30-d09e-4aed-ba8b-a025a36dfde6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:15.004814 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a7aedf30-d09e-4aed-ba8b-a025a36dfde6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:15.015139 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a7aedf30-d09e-4aed-ba8b-a025a36dfde6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:15.016650 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a7aedf30-d09e-4aed-ba8b-a025a36dfde6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:15.017846 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a7aedf30-d09e-4aed-ba8b-a025a36dfde6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.158348 Apr 08 11:23:15.018450 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 484/974] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:14 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:23:15.044877 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-048929b9-2c6a-46f7-bc2d-e159a5be27f2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:15.045874 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-048929b9-2c6a-46f7-bc2d-e159a5be27f2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:15.053054 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-048929b9-2c6a-46f7-bc2d-e159a5be27f2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:15.053506 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-048929b9-2c6a-46f7-bc2d-e159a5be27f2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:15.054311 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-048929b9-2c6a-46f7-bc2d-e159a5be27f2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:15.054757 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-048929b9-2c6a-46f7-bc2d-e159a5be27f2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:15.187384 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-048929b9-2c6a-46f7-bc2d-e159a5be27f2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:15.188378 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0408813a-5d5b-4653-aa0b-f9ba08fa8592 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:15.188997 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0408813a-5d5b-4653-aa0b-f9ba08fa8592 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:15.195334 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0408813a-5d5b-4653-aa0b-f9ba08fa8592 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:15.195500 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-048929b9-2c6a-46f7-bc2d-e159a5be27f2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.155718 Apr 08 11:23:15.195909 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0408813a-5d5b-4653-aa0b-f9ba08fa8592 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:15.196053 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 491/975] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:15 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:15.196696 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0408813a-5d5b-4653-aa0b-f9ba08fa8592 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:15.197137 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0408813a-5d5b-4653-aa0b-f9ba08fa8592 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:15.259058 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0408813a-5d5b-4653-aa0b-f9ba08fa8592 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:15.266510 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0408813a-5d5b-4653-aa0b-f9ba08fa8592 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082051 Apr 08 11:23:15.267085 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 485/976] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:15 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:23:15.391492 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-6f3c85fb-407b-4570-ba70-a9afbb2c4d0d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:15.392432 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-6f3c85fb-407b-4570-ba70-a9afbb2c4d0d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:15.398758 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6f3c85fb-407b-4570-ba70-a9afbb2c4d0d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:15.399208 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6f3c85fb-407b-4570-ba70-a9afbb2c4d0d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:15.399991 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6f3c85fb-407b-4570-ba70-a9afbb2c4d0d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:15.400432 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6f3c85fb-407b-4570-ba70-a9afbb2c4d0d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:15.430487 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-6f3c85fb-407b-4570-ba70-a9afbb2c4d0d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042905 Apr 08 11:23:15.431054 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 492/977] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:15 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:16.036238 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e62ca48a-6358-42b6-8b55-70655d9e947d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:16.036846 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e62ca48a-6358-42b6-8b55-70655d9e947d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:16.043221 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e62ca48a-6358-42b6-8b55-70655d9e947d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:16.043670 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e62ca48a-6358-42b6-8b55-70655d9e947d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:16.044446 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e62ca48a-6358-42b6-8b55-70655d9e947d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:16.044884 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e62ca48a-6358-42b6-8b55-70655d9e947d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:16.175398 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e62ca48a-6358-42b6-8b55-70655d9e947d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:16.183716 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e62ca48a-6358-42b6-8b55-70655d9e947d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:16.185223 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e62ca48a-6358-42b6-8b55-70655d9e947d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:16.186406 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e62ca48a-6358-42b6-8b55-70655d9e947d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.154151 Apr 08 11:23:16.186967 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 486/978] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:16 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:23:16.212191 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-9e698ed6-9e02-4d37-af27-37bc10432858 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:16.212935 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-9e698ed6-9e02-4d37-af27-37bc10432858 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:16.218846 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9e698ed6-9e02-4d37-af27-37bc10432858 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:16.219301 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9e698ed6-9e02-4d37-af27-37bc10432858 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:16.220070 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9e698ed6-9e02-4d37-af27-37bc10432858 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:16.220509 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9e698ed6-9e02-4d37-af27-37bc10432858 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:16.283111 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-38a58d06-4946-40ca-83b2-7fc5ac89359b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:16.283731 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-38a58d06-4946-40ca-83b2-7fc5ac89359b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:16.289572 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-38a58d06-4946-40ca-83b2-7fc5ac89359b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:16.290013 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-38a58d06-4946-40ca-83b2-7fc5ac89359b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:16.290797 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-38a58d06-4946-40ca-83b2-7fc5ac89359b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:16.291242 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-38a58d06-4946-40ca-83b2-7fc5ac89359b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:16.357974 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-38a58d06-4946-40ca-83b2-7fc5ac89359b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:16.366045 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-38a58d06-4946-40ca-83b2-7fc5ac89359b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.086681 Apr 08 11:23:16.366631 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 487/979] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:16 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:23:16.382650 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-9e698ed6-9e02-4d37-af27-37bc10432858 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:16.390025 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-9e698ed6-9e02-4d37-af27-37bc10432858 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.181600 Apr 08 11:23:16.390586 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 493/980] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:16 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:16.442419 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-059da14a-2901-42a5-b809-a884ce3dfd65 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:16.443349 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-059da14a-2901-42a5-b809-a884ce3dfd65 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:16.449201 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-059da14a-2901-42a5-b809-a884ce3dfd65 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:16.449652 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-059da14a-2901-42a5-b809-a884ce3dfd65 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:16.450453 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-059da14a-2901-42a5-b809-a884ce3dfd65 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:16.450891 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-059da14a-2901-42a5-b809-a884ce3dfd65 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:16.478383 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-059da14a-2901-42a5-b809-a884ce3dfd65 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040520 Apr 08 11:23:16.478937 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 488/981] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:16 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:17.204914 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2855a1e7-1593-491f-802b-a49702273ef4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:17.206080 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-2855a1e7-1593-491f-802b-a49702273ef4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:17.212302 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2855a1e7-1593-491f-802b-a49702273ef4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:17.212745 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2855a1e7-1593-491f-802b-a49702273ef4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:17.213505 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2855a1e7-1593-491f-802b-a49702273ef4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:17.213970 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2855a1e7-1593-491f-802b-a49702273ef4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:17.346873 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2855a1e7-1593-491f-802b-a49702273ef4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:17.355244 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2855a1e7-1593-491f-802b-a49702273ef4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:17.356776 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2855a1e7-1593-491f-802b-a49702273ef4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:17.357960 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-2855a1e7-1593-491f-802b-a49702273ef4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.156923 Apr 08 11:23:17.358521 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 494/982] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:17 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:23:17.382623 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b7abb402-88be-44d6-91d2-4425e118eeee tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:17.383240 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b7abb402-88be-44d6-91d2-4425e118eeee tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:17.389645 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b7abb402-88be-44d6-91d2-4425e118eeee tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:17.390133 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b7abb402-88be-44d6-91d2-4425e118eeee tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:17.390919 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b7abb402-88be-44d6-91d2-4425e118eeee tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:17.391357 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b7abb402-88be-44d6-91d2-4425e118eeee tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:17.406701 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-75f511e6-f7e8-46db-b621-8e55fa6b4cff tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:17.407316 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-75f511e6-f7e8-46db-b621-8e55fa6b4cff tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:17.413728 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-75f511e6-f7e8-46db-b621-8e55fa6b4cff tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:17.414213 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-75f511e6-f7e8-46db-b621-8e55fa6b4cff tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:17.415025 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-75f511e6-f7e8-46db-b621-8e55fa6b4cff tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:17.415464 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-75f511e6-f7e8-46db-b621-8e55fa6b4cff tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:17.453296 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b7abb402-88be-44d6-91d2-4425e118eeee tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:17.461860 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b7abb402-88be-44d6-91d2-4425e118eeee tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082783 Apr 08 11:23:17.462391 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 489/983] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:17 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:17.490110 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ba38ec34-6588-4c36-9c49-7e92f10efafe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:17.491151 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ba38ec34-6588-4c36-9c49-7e92f10efafe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:17.497433 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ba38ec34-6588-4c36-9c49-7e92f10efafe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:17.497927 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ba38ec34-6588-4c36-9c49-7e92f10efafe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:17.498718 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ba38ec34-6588-4c36-9c49-7e92f10efafe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:17.499228 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ba38ec34-6588-4c36-9c49-7e92f10efafe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:17.531202 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ba38ec34-6588-4c36-9c49-7e92f10efafe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045039 Apr 08 11:23:17.536978 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 490/984] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:17 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:23:17.558999 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-75f511e6-f7e8-46db-b621-8e55fa6b4cff tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:17.566831 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-75f511e6-f7e8-46db-b621-8e55fa6b4cff tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.163911 Apr 08 11:23:17.569461 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 495/985] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:17 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:23:18.375557 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6f9de8af-2db1-41f7-b6d9-2c2dce4e2de7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:18.376176 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6f9de8af-2db1-41f7-b6d9-2c2dce4e2de7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:18.382059 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6f9de8af-2db1-41f7-b6d9-2c2dce4e2de7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:18.382515 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6f9de8af-2db1-41f7-b6d9-2c2dce4e2de7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:18.383287 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6f9de8af-2db1-41f7-b6d9-2c2dce4e2de7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:18.383824 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6f9de8af-2db1-41f7-b6d9-2c2dce4e2de7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:18.479095 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-23a4c493-ed4d-4f2b-989d-24381ee63c7c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:18.479822 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-23a4c493-ed4d-4f2b-989d-24381ee63c7c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:18.486116 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-23a4c493-ed4d-4f2b-989d-24381ee63c7c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:18.486609 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-23a4c493-ed4d-4f2b-989d-24381ee63c7c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:18.487396 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-23a4c493-ed4d-4f2b-989d-24381ee63c7c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:18.487971 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-23a4c493-ed4d-4f2b-989d-24381ee63c7c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:18.515081 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6f9de8af-2db1-41f7-b6d9-2c2dce4e2de7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:18.523382 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6f9de8af-2db1-41f7-b6d9-2c2dce4e2de7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:18.524866 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6f9de8af-2db1-41f7-b6d9-2c2dce4e2de7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:18.526046 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6f9de8af-2db1-41f7-b6d9-2c2dce4e2de7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.154384 Apr 08 11:23:18.526605 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 491/986] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:18 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:23:18.544381 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ddf1892b-0bb1-4224-9d72-e69807d10b24 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:18.545398 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ddf1892b-0bb1-4224-9d72-e69807d10b24 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:18.547988 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-23a4c493-ed4d-4f2b-989d-24381ee63c7c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:18.552034 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ddf1892b-0bb1-4224-9d72-e69807d10b24 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:18.552481 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ddf1892b-0bb1-4224-9d72-e69807d10b24 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:18.553253 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ddf1892b-0bb1-4224-9d72-e69807d10b24 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:18.553685 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ddf1892b-0bb1-4224-9d72-e69807d10b24 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:18.556075 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-23a4c493-ed4d-4f2b-989d-24381ee63c7c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080907 Apr 08 11:23:18.556843 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 496/987] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:18 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:23:18.581267 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ddf1892b-0bb1-4224-9d72-e69807d10b24 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040719 Apr 08 11:23:18.582385 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 492/988] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:18 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:23:18.584966 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-bca6ebb0-08d1-4707-9dce-86139d1977a0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:18.585578 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-bca6ebb0-08d1-4707-9dce-86139d1977a0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:18.591507 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bca6ebb0-08d1-4707-9dce-86139d1977a0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:18.591961 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bca6ebb0-08d1-4707-9dce-86139d1977a0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:18.592748 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bca6ebb0-08d1-4707-9dce-86139d1977a0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:18.593189 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bca6ebb0-08d1-4707-9dce-86139d1977a0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:18.733000 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-bca6ebb0-08d1-4707-9dce-86139d1977a0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:18.740639 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-bca6ebb0-08d1-4707-9dce-86139d1977a0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.160031 Apr 08 11:23:18.741217 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 497/989] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:18 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:23:19.545114 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-63645fcf-9c92-4549-a979-39384468eaa1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:19.545722 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-63645fcf-9c92-4549-a979-39384468eaa1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:19.552778 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-63645fcf-9c92-4549-a979-39384468eaa1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:19.553227 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-63645fcf-9c92-4549-a979-39384468eaa1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:19.554034 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-63645fcf-9c92-4549-a979-39384468eaa1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:19.554478 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-63645fcf-9c92-4549-a979-39384468eaa1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:19.572922 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-16854327-01a9-48b5-a4ff-cf20bf9d10f2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:19.573539 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-16854327-01a9-48b5-a4ff-cf20bf9d10f2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:19.579770 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-16854327-01a9-48b5-a4ff-cf20bf9d10f2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:19.580220 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-16854327-01a9-48b5-a4ff-cf20bf9d10f2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:19.580984 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-16854327-01a9-48b5-a4ff-cf20bf9d10f2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:19.581419 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-16854327-01a9-48b5-a4ff-cf20bf9d10f2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:19.647335 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-16854327-01a9-48b5-a4ff-cf20bf9d10f2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:19.654742 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-16854327-01a9-48b5-a4ff-cf20bf9d10f2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.085607 Apr 08 11:23:19.655314 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 498/990] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:19 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:19.659942 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-1396affa-f957-44e2-9838-e5a7e6602f52 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:19.660826 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-1396affa-f957-44e2-9838-e5a7e6602f52 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:19.667057 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1396affa-f957-44e2-9838-e5a7e6602f52 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:19.667485 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1396affa-f957-44e2-9838-e5a7e6602f52 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:19.668255 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1396affa-f957-44e2-9838-e5a7e6602f52 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:19.668688 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1396affa-f957-44e2-9838-e5a7e6602f52 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:19.698050 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-1396affa-f957-44e2-9838-e5a7e6602f52 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041646 Apr 08 11:23:19.698623 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 499/991] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:19 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:19.715324 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-63645fcf-9c92-4549-a979-39384468eaa1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:19.724321 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-63645fcf-9c92-4549-a979-39384468eaa1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:19.725889 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-63645fcf-9c92-4549-a979-39384468eaa1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:19.727057 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-63645fcf-9c92-4549-a979-39384468eaa1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.186150 Apr 08 11:23:19.727621 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 493/992] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:19 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:23:19.758355 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-1504f5f4-849f-4f39-98f2-0a0a6453cb2c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:19.759019 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-1504f5f4-849f-4f39-98f2-0a0a6453cb2c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:19.765008 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1504f5f4-849f-4f39-98f2-0a0a6453cb2c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:19.765464 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1504f5f4-849f-4f39-98f2-0a0a6453cb2c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:19.766273 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1504f5f4-849f-4f39-98f2-0a0a6453cb2c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:19.766717 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1504f5f4-849f-4f39-98f2-0a0a6453cb2c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:19.903884 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1504f5f4-849f-4f39-98f2-0a0a6453cb2c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:19.911961 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-1504f5f4-849f-4f39-98f2-0a0a6453cb2c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.157516 Apr 08 11:23:19.912538 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 500/993] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:19 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:20.670903 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1a525119-0ecc-4f1b-848c-b873c6a15e71 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:20.671520 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1a525119-0ecc-4f1b-848c-b873c6a15e71 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:20.677845 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1a525119-0ecc-4f1b-848c-b873c6a15e71 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:20.678305 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1a525119-0ecc-4f1b-848c-b873c6a15e71 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:20.679082 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1a525119-0ecc-4f1b-848c-b873c6a15e71 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:20.679529 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1a525119-0ecc-4f1b-848c-b873c6a15e71 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:20.710821 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-82eaee76-9d97-4981-a437-53875b06ac4c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:20.711748 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-82eaee76-9d97-4981-a437-53875b06ac4c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:20.717795 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-82eaee76-9d97-4981-a437-53875b06ac4c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:20.718241 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-82eaee76-9d97-4981-a437-53875b06ac4c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:20.719018 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-82eaee76-9d97-4981-a437-53875b06ac4c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:20.719453 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-82eaee76-9d97-4981-a437-53875b06ac4c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:20.739375 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1a525119-0ecc-4f1b-848c-b873c6a15e71 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:20.747474 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1a525119-0ecc-4f1b-848c-b873c6a15e71 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080428 Apr 08 11:23:20.748045 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 494/994] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:20 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:20.748435 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-82eaee76-9d97-4981-a437-53875b06ac4c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042377 Apr 08 11:23:20.749217 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 501/995] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:20 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:23:20.753123 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-def871d8-79ce-4dc8-adee-1cc26be56a78 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:20.754288 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-def871d8-79ce-4dc8-adee-1cc26be56a78 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:20.760159 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-def871d8-79ce-4dc8-adee-1cc26be56a78 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:20.760650 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-def871d8-79ce-4dc8-adee-1cc26be56a78 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:20.761427 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-def871d8-79ce-4dc8-adee-1cc26be56a78 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:20.761892 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-def871d8-79ce-4dc8-adee-1cc26be56a78 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:20.847478 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 11:23:20.849514 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:23:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d (ip 10.222.0.46) !!! Apr 08 11:23:20.897266 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-def871d8-79ce-4dc8-adee-1cc26be56a78 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:20.905433 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-def871d8-79ce-4dc8-adee-1cc26be56a78 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:20.906974 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-def871d8-79ce-4dc8-adee-1cc26be56a78 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:20.908127 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-def871d8-79ce-4dc8-adee-1cc26be56a78 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.159177 Apr 08 11:23:20.908685 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 495/996] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:20 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:23:20.928992 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-ea065a7f-d687-40a1-b95e-9055198e3377 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:20.929610 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-ea065a7f-d687-40a1-b95e-9055198e3377 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:20.935591 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ea065a7f-d687-40a1-b95e-9055198e3377 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:20.936088 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ea065a7f-d687-40a1-b95e-9055198e3377 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:20.936834 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ea065a7f-d687-40a1-b95e-9055198e3377 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:20.937277 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ea065a7f-d687-40a1-b95e-9055198e3377 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:21.070622 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-ea065a7f-d687-40a1-b95e-9055198e3377 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:21.078237 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-ea065a7f-d687-40a1-b95e-9055198e3377 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.153620 Apr 08 11:23:21.078815 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 502/997] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:20 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:21.760259 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-fbc2c731-b476-446d-88e9-5fea454db1a4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:21.761277 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-fbc2c731-b476-446d-88e9-5fea454db1a4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:21.764059 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-faa599b9-4e0f-4efe-bc15-9f3fd4cf0c40 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:21.764672 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-faa599b9-4e0f-4efe-bc15-9f3fd4cf0c40 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:21.767808 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fbc2c731-b476-446d-88e9-5fea454db1a4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:21.768267 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fbc2c731-b476-446d-88e9-5fea454db1a4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:21.769051 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fbc2c731-b476-446d-88e9-5fea454db1a4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:21.769496 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fbc2c731-b476-446d-88e9-5fea454db1a4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:21.770898 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-faa599b9-4e0f-4efe-bc15-9f3fd4cf0c40 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:21.771346 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-faa599b9-4e0f-4efe-bc15-9f3fd4cf0c40 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:21.772108 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-faa599b9-4e0f-4efe-bc15-9f3fd4cf0c40 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:21.772548 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-faa599b9-4e0f-4efe-bc15-9f3fd4cf0c40 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:21.797754 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-fbc2c731-b476-446d-88e9-5fea454db1a4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041510 Apr 08 11:23:21.798348 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 496/998] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:21 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:21.832709 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-faa599b9-4e0f-4efe-bc15-9f3fd4cf0c40 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:21.840068 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-faa599b9-4e0f-4efe-bc15-9f3fd4cf0c40 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079784 Apr 08 11:23:21.840625 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 503/999] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:21 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:23:21.929678 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0bb1ca25-8b59-4c1d-a55c-6552ad36f30a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:21.930226 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0bb1ca25-8b59-4c1d-a55c-6552ad36f30a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:21.936171 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0bb1ca25-8b59-4c1d-a55c-6552ad36f30a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:21.936617 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0bb1ca25-8b59-4c1d-a55c-6552ad36f30a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:21.937378 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0bb1ca25-8b59-4c1d-a55c-6552ad36f30a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:21.937827 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0bb1ca25-8b59-4c1d-a55c-6552ad36f30a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:22.072748 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0bb1ca25-8b59-4c1d-a55c-6552ad36f30a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:22.081064 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0bb1ca25-8b59-4c1d-a55c-6552ad36f30a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:22.082616 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0bb1ca25-8b59-4c1d-a55c-6552ad36f30a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:22.083808 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0bb1ca25-8b59-4c1d-a55c-6552ad36f30a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.158692 Apr 08 11:23:22.084371 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 497/1000] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:21 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:23:22.094954 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e9abb8c9-3e3d-4d81-b335-242b78bea56d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:22.095568 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e9abb8c9-3e3d-4d81-b335-242b78bea56d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:22.102120 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e9abb8c9-3e3d-4d81-b335-242b78bea56d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:22.102495 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e9abb8c9-3e3d-4d81-b335-242b78bea56d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:22.103269 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e9abb8c9-3e3d-4d81-b335-242b78bea56d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:22.103712 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e9abb8c9-3e3d-4d81-b335-242b78bea56d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:22.235790 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e9abb8c9-3e3d-4d81-b335-242b78bea56d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:22.244155 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e9abb8c9-3e3d-4d81-b335-242b78bea56d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.152710 Apr 08 11:23:22.244760 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 504/1001] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:22 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:22.809286 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-753010d8-2526-4af5-936e-40b2270b6a4e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:22.810251 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-753010d8-2526-4af5-936e-40b2270b6a4e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:22.816637 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-753010d8-2526-4af5-936e-40b2270b6a4e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:22.819487 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-753010d8-2526-4af5-936e-40b2270b6a4e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:22.819487 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-753010d8-2526-4af5-936e-40b2270b6a4e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:22.819487 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-753010d8-2526-4af5-936e-40b2270b6a4e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:22.849287 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-753010d8-2526-4af5-936e-40b2270b6a4e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044033 Apr 08 11:23:22.850069 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 498/1002] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:22 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:22.856409 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-04613767-7e0c-4a14-a95e-433719fcb185 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:22.859734 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-04613767-7e0c-4a14-a95e-433719fcb185 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:22.863392 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-04613767-7e0c-4a14-a95e-433719fcb185 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:22.863843 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-04613767-7e0c-4a14-a95e-433719fcb185 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:22.864611 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-04613767-7e0c-4a14-a95e-433719fcb185 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:22.865052 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-04613767-7e0c-4a14-a95e-433719fcb185 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:22.925169 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-04613767-7e0c-4a14-a95e-433719fcb185 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:22.932741 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-04613767-7e0c-4a14-a95e-433719fcb185 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080300 Apr 08 11:23:22.933478 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 505/1003] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:22 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:23.102849 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a2304af1-5d84-4b20-955b-95e3150fc271 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:23.103463 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a2304af1-5d84-4b20-955b-95e3150fc271 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:23.109257 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a2304af1-5d84-4b20-955b-95e3150fc271 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:23.115523 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a2304af1-5d84-4b20-955b-95e3150fc271 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:23.115523 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a2304af1-5d84-4b20-955b-95e3150fc271 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:23.115523 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a2304af1-5d84-4b20-955b-95e3150fc271 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:23.246851 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a2304af1-5d84-4b20-955b-95e3150fc271 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:23.256230 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a2304af1-5d84-4b20-955b-95e3150fc271 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:23.257754 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a2304af1-5d84-4b20-955b-95e3150fc271 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:23.258947 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a2304af1-5d84-4b20-955b-95e3150fc271 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.160241 Apr 08 11:23:23.259503 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 499/1004] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:23 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:23:23.264500 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a36949a6-70b2-407c-92e9-0d9aa9840522 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:23.265634 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a36949a6-70b2-407c-92e9-0d9aa9840522 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:23.275747 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a36949a6-70b2-407c-92e9-0d9aa9840522 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:23.276549 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a36949a6-70b2-407c-92e9-0d9aa9840522 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:23.277988 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a36949a6-70b2-407c-92e9-0d9aa9840522 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:23.278606 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a36949a6-70b2-407c-92e9-0d9aa9840522 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:23.432756 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a36949a6-70b2-407c-92e9-0d9aa9840522 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:23.440377 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a36949a6-70b2-407c-92e9-0d9aa9840522 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.182380 Apr 08 11:23:23.440951 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 506/1005] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:23 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:23.860648 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9fc934b7-7ae6-435a-aea4-e4a6cbe9ab5c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:23.861612 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9fc934b7-7ae6-435a-aea4-e4a6cbe9ab5c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:23.868063 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9fc934b7-7ae6-435a-aea4-e4a6cbe9ab5c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:23.868519 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9fc934b7-7ae6-435a-aea4-e4a6cbe9ab5c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:23.869605 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9fc934b7-7ae6-435a-aea4-e4a6cbe9ab5c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:23.870081 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9fc934b7-7ae6-435a-aea4-e4a6cbe9ab5c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:23.899699 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9fc934b7-7ae6-435a-aea4-e4a6cbe9ab5c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042889 Apr 08 11:23:23.900188 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 500/1006] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:23 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:23.964354 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-09e7a117-8542-43fa-92e9-39aa7a742607 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:23.964964 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-09e7a117-8542-43fa-92e9-39aa7a742607 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:23.971413 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-09e7a117-8542-43fa-92e9-39aa7a742607 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:23.971859 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-09e7a117-8542-43fa-92e9-39aa7a742607 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:23.972630 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-09e7a117-8542-43fa-92e9-39aa7a742607 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:23.973071 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-09e7a117-8542-43fa-92e9-39aa7a742607 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:24.032856 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-09e7a117-8542-43fa-92e9-39aa7a742607 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:24.040728 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-09e7a117-8542-43fa-92e9-39aa7a742607 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080194 Apr 08 11:23:24.041289 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 507/1007] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:23 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:23:24.285107 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-248e5e65-9a5e-4962-a1b2-5591de7b11e2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:24.285713 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-248e5e65-9a5e-4962-a1b2-5591de7b11e2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:24.291622 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-248e5e65-9a5e-4962-a1b2-5591de7b11e2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:24.292070 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-248e5e65-9a5e-4962-a1b2-5591de7b11e2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:24.292830 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-248e5e65-9a5e-4962-a1b2-5591de7b11e2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:24.293267 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-248e5e65-9a5e-4962-a1b2-5591de7b11e2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:24.428016 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-248e5e65-9a5e-4962-a1b2-5591de7b11e2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:24.436138 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-248e5e65-9a5e-4962-a1b2-5591de7b11e2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:24.437622 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-248e5e65-9a5e-4962-a1b2-5591de7b11e2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:24.438792 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-248e5e65-9a5e-4962-a1b2-5591de7b11e2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.157598 Apr 08 11:23:24.439351 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 501/1008] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:24 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:23:24.457402 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2f2f3935-99dc-4d77-bd10-60a60744e329 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:24.458260 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-2f2f3935-99dc-4d77-bd10-60a60744e329 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:24.464614 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2f2f3935-99dc-4d77-bd10-60a60744e329 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:24.465063 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2f2f3935-99dc-4d77-bd10-60a60744e329 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:24.465881 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2f2f3935-99dc-4d77-bd10-60a60744e329 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:24.466324 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2f2f3935-99dc-4d77-bd10-60a60744e329 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:24.596843 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2f2f3935-99dc-4d77-bd10-60a60744e329 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:24.604130 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-2f2f3935-99dc-4d77-bd10-60a60744e329 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.150570 Apr 08 11:23:24.604694 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 508/1009] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:24 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:24.911830 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-933ee48b-19db-4cf3-ae27-8385da9756c7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:24.912767 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-933ee48b-19db-4cf3-ae27-8385da9756c7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:24.919010 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-933ee48b-19db-4cf3-ae27-8385da9756c7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:24.919461 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-933ee48b-19db-4cf3-ae27-8385da9756c7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:24.920231 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-933ee48b-19db-4cf3-ae27-8385da9756c7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:24.920669 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-933ee48b-19db-4cf3-ae27-8385da9756c7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:24.948927 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-933ee48b-19db-4cf3-ae27-8385da9756c7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041586 Apr 08 11:23:24.949485 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 502/1010] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:24 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:23:25.058139 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-b7973650-e7e9-44d2-b33e-37ca47b3c9ac tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:25.058755 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-b7973650-e7e9-44d2-b33e-37ca47b3c9ac tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:25.064983 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b7973650-e7e9-44d2-b33e-37ca47b3c9ac tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:25.065437 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b7973650-e7e9-44d2-b33e-37ca47b3c9ac tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:25.066239 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b7973650-e7e9-44d2-b33e-37ca47b3c9ac tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:25.066681 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b7973650-e7e9-44d2-b33e-37ca47b3c9ac tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:25.138763 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b7973650-e7e9-44d2-b33e-37ca47b3c9ac tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:25.146940 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-b7973650-e7e9-44d2-b33e-37ca47b3c9ac tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.092622 Apr 08 11:23:25.147514 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 509/1011] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:25 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:25.457501 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-60be5217-0ee4-48c9-a030-a98128d7348b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:25.458057 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-60be5217-0ee4-48c9-a030-a98128d7348b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:25.464449 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-60be5217-0ee4-48c9-a030-a98128d7348b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:25.464902 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-60be5217-0ee4-48c9-a030-a98128d7348b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:25.465675 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-60be5217-0ee4-48c9-a030-a98128d7348b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:25.466143 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-60be5217-0ee4-48c9-a030-a98128d7348b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:25.598193 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-60be5217-0ee4-48c9-a030-a98128d7348b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:25.607582 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-60be5217-0ee4-48c9-a030-a98128d7348b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:25.609078 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-60be5217-0ee4-48c9-a030-a98128d7348b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:25.610290 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-60be5217-0ee4-48c9-a030-a98128d7348b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.156886 Apr 08 11:23:25.610860 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 503/1012] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:25 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:23:25.620706 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-42cc24ba-8edb-4438-ac25-3b7e514a6a86 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:25.621455 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-42cc24ba-8edb-4438-ac25-3b7e514a6a86 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:25.627385 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-42cc24ba-8edb-4438-ac25-3b7e514a6a86 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:25.627842 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-42cc24ba-8edb-4438-ac25-3b7e514a6a86 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:25.628621 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-42cc24ba-8edb-4438-ac25-3b7e514a6a86 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:25.629064 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-42cc24ba-8edb-4438-ac25-3b7e514a6a86 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:25.763730 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-42cc24ba-8edb-4438-ac25-3b7e514a6a86 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:25.771806 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-42cc24ba-8edb-4438-ac25-3b7e514a6a86 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.154721 Apr 08 11:23:25.772382 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 510/1013] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:25 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:25.960723 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6654b57f-1681-4d34-9aa4-118bedaddaf6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:25.961675 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6654b57f-1681-4d34-9aa4-118bedaddaf6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:25.967947 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6654b57f-1681-4d34-9aa4-118bedaddaf6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:25.968333 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6654b57f-1681-4d34-9aa4-118bedaddaf6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:25.969121 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6654b57f-1681-4d34-9aa4-118bedaddaf6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:25.969553 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6654b57f-1681-4d34-9aa4-118bedaddaf6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:25.996957 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6654b57f-1681-4d34-9aa4-118bedaddaf6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040762 Apr 08 11:23:25.997503 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 504/1014] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:25 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:26.163785 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-92358c39-c341-492d-a181-841a3da9efce tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:26.164408 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-92358c39-c341-492d-a181-841a3da9efce tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:26.170785 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-92358c39-c341-492d-a181-841a3da9efce tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:26.171266 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-92358c39-c341-492d-a181-841a3da9efce tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:26.172038 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-92358c39-c341-492d-a181-841a3da9efce tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:26.172481 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-92358c39-c341-492d-a181-841a3da9efce tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:26.234406 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-92358c39-c341-492d-a181-841a3da9efce tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:26.242409 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-92358c39-c341-492d-a181-841a3da9efce tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082568 Apr 08 11:23:26.242988 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 511/1015] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:26 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:26.629157 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-71cf2a5a-0d90-4e98-8d21-9af0735945e8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:26.629779 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-71cf2a5a-0d90-4e98-8d21-9af0735945e8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:26.635619 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-71cf2a5a-0d90-4e98-8d21-9af0735945e8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:26.636063 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-71cf2a5a-0d90-4e98-8d21-9af0735945e8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:26.636817 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-71cf2a5a-0d90-4e98-8d21-9af0735945e8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:26.637246 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-71cf2a5a-0d90-4e98-8d21-9af0735945e8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:26.769236 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-71cf2a5a-0d90-4e98-8d21-9af0735945e8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:26.777972 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-71cf2a5a-0d90-4e98-8d21-9af0735945e8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:26.779480 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-71cf2a5a-0d90-4e98-8d21-9af0735945e8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:26.780639 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-71cf2a5a-0d90-4e98-8d21-9af0735945e8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.155539 Apr 08 11:23:26.781237 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 505/1016] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:26 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:23:26.788679 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-80d4842d-507f-4a6a-b147-1bf5e21cddf0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:26.789294 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-80d4842d-507f-4a6a-b147-1bf5e21cddf0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:26.795294 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-80d4842d-507f-4a6a-b147-1bf5e21cddf0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:26.795754 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-80d4842d-507f-4a6a-b147-1bf5e21cddf0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:26.796531 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-80d4842d-507f-4a6a-b147-1bf5e21cddf0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:26.796974 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-80d4842d-507f-4a6a-b147-1bf5e21cddf0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:26.927981 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-80d4842d-507f-4a6a-b147-1bf5e21cddf0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:26.935370 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-80d4842d-507f-4a6a-b147-1bf5e21cddf0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.150991 Apr 08 11:23:26.935947 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 512/1017] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:26 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:27.008638 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8658b7d9-64ec-4c8b-8273-d5a013e1adcc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:27.009570 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8658b7d9-64ec-4c8b-8273-d5a013e1adcc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:27.015674 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8658b7d9-64ec-4c8b-8273-d5a013e1adcc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:27.016135 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8658b7d9-64ec-4c8b-8273-d5a013e1adcc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:27.016919 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8658b7d9-64ec-4c8b-8273-d5a013e1adcc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:27.017364 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8658b7d9-64ec-4c8b-8273-d5a013e1adcc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:27.046209 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8658b7d9-64ec-4c8b-8273-d5a013e1adcc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041509 Apr 08 11:23:27.046762 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 506/1018] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:27 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:27.259097 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-cb31e483-a940-4926-b019-5b8cdb9a2d56 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:27.259715 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-cb31e483-a940-4926-b019-5b8cdb9a2d56 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:27.266110 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cb31e483-a940-4926-b019-5b8cdb9a2d56 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:27.266570 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cb31e483-a940-4926-b019-5b8cdb9a2d56 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:27.267348 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cb31e483-a940-4926-b019-5b8cdb9a2d56 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:27.267789 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cb31e483-a940-4926-b019-5b8cdb9a2d56 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:27.334607 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-cb31e483-a940-4926-b019-5b8cdb9a2d56 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:27.342379 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-cb31e483-a940-4926-b019-5b8cdb9a2d56 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.087637 Apr 08 11:23:27.342954 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 513/1019] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:27 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:27.799432 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f8890320-e912-48f7-a174-d7c0677572ed tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:27.800050 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f8890320-e912-48f7-a174-d7c0677572ed tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:27.806933 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f8890320-e912-48f7-a174-d7c0677572ed tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:27.807387 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f8890320-e912-48f7-a174-d7c0677572ed tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:27.808182 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f8890320-e912-48f7-a174-d7c0677572ed tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:27.808651 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f8890320-e912-48f7-a174-d7c0677572ed tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:27.939315 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f8890320-e912-48f7-a174-d7c0677572ed tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:27.948033 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f8890320-e912-48f7-a174-d7c0677572ed tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:27.949578 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f8890320-e912-48f7-a174-d7c0677572ed tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:27.950803 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f8890320-e912-48f7-a174-d7c0677572ed tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.155385 Apr 08 11:23:27.951365 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 507/1020] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:27 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:23:27.952650 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-75bb0690-0e80-44af-b41b-a1566848e0d1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:27.953173 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-75bb0690-0e80-44af-b41b-a1566848e0d1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:27.959686 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-75bb0690-0e80-44af-b41b-a1566848e0d1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:27.960297 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-75bb0690-0e80-44af-b41b-a1566848e0d1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:27.961077 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-75bb0690-0e80-44af-b41b-a1566848e0d1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:27.961516 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-75bb0690-0e80-44af-b41b-a1566848e0d1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:28.066304 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-074c01da-7bf8-4abf-a72b-2ab2ef28d57c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:28.068005 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-074c01da-7bf8-4abf-a72b-2ab2ef28d57c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:28.079040 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-074c01da-7bf8-4abf-a72b-2ab2ef28d57c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:28.087159 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-074c01da-7bf8-4abf-a72b-2ab2ef28d57c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:28.087159 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-074c01da-7bf8-4abf-a72b-2ab2ef28d57c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:28.087159 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-074c01da-7bf8-4abf-a72b-2ab2ef28d57c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:28.114373 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-074c01da-7bf8-4abf-a72b-2ab2ef28d57c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059600 Apr 08 11:23:28.115024 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 508/1021] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:28 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:23:28.127053 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-75bb0690-0e80-44af-b41b-a1566848e0d1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:28.131330 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-75bb0690-0e80-44af-b41b-a1566848e0d1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.182806 Apr 08 11:23:28.131911 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 514/1022] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:27 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:23:28.358907 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-51538086-a024-4513-8207-9fc0a32648be tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:28.359523 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-51538086-a024-4513-8207-9fc0a32648be tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:28.365292 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-51538086-a024-4513-8207-9fc0a32648be tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:28.365750 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-51538086-a024-4513-8207-9fc0a32648be tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:28.366559 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-51538086-a024-4513-8207-9fc0a32648be tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:28.367270 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-51538086-a024-4513-8207-9fc0a32648be tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:28.430915 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-51538086-a024-4513-8207-9fc0a32648be tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:28.440096 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-51538086-a024-4513-8207-9fc0a32648be tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.085069 Apr 08 11:23:28.440664 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 509/1023] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:28 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:28.968911 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a4b545ca-fe45-43b1-98ac-9e71289fe224 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:28.969462 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a4b545ca-fe45-43b1-98ac-9e71289fe224 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:28.975725 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a4b545ca-fe45-43b1-98ac-9e71289fe224 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:28.976173 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a4b545ca-fe45-43b1-98ac-9e71289fe224 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:28.976931 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a4b545ca-fe45-43b1-98ac-9e71289fe224 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:28.977364 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a4b545ca-fe45-43b1-98ac-9e71289fe224 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:29.124598 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a4b545ca-fe45-43b1-98ac-9e71289fe224 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:29.126867 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1decb768-07be-4532-b1f9-18ae6e4dfce9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:29.127753 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1decb768-07be-4532-b1f9-18ae6e4dfce9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:29.134481 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a4b545ca-fe45-43b1-98ac-9e71289fe224 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:29.135046 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1decb768-07be-4532-b1f9-18ae6e4dfce9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:29.135582 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1decb768-07be-4532-b1f9-18ae6e4dfce9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:29.136010 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1decb768-07be-4532-b1f9-18ae6e4dfce9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:29.136461 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1decb768-07be-4532-b1f9-18ae6e4dfce9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:29.136944 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a4b545ca-fe45-43b1-98ac-9e71289fe224 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:29.138754 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a4b545ca-fe45-43b1-98ac-9e71289fe224 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.173624 Apr 08 11:23:29.139645 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 515/1024] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:28 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:23:29.148028 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-0cd5b935-2846-413e-9a42-be69e867e94f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:29.149045 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-0cd5b935-2846-413e-9a42-be69e867e94f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:29.156523 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0cd5b935-2846-413e-9a42-be69e867e94f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:29.156938 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0cd5b935-2846-413e-9a42-be69e867e94f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:29.157785 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0cd5b935-2846-413e-9a42-be69e867e94f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:29.158245 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0cd5b935-2846-413e-9a42-be69e867e94f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:29.166269 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1decb768-07be-4532-b1f9-18ae6e4dfce9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043307 Apr 08 11:23:29.166848 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 510/1025] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:29 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:29.289304 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-0cd5b935-2846-413e-9a42-be69e867e94f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:29.296694 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-0cd5b935-2846-413e-9a42-be69e867e94f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.153001 Apr 08 11:23:29.297264 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 516/1026] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:29 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:23:29.456536 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4d006586-f185-42f9-b146-630658ef8e88 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:29.457155 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4d006586-f185-42f9-b146-630658ef8e88 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:29.463260 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4d006586-f185-42f9-b146-630658ef8e88 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:29.463708 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4d006586-f185-42f9-b146-630658ef8e88 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:29.464469 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4d006586-f185-42f9-b146-630658ef8e88 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:29.464906 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4d006586-f185-42f9-b146-630658ef8e88 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:29.525827 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4d006586-f185-42f9-b146-630658ef8e88 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:29.533075 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4d006586-f185-42f9-b146-630658ef8e88 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080384 Apr 08 11:23:29.533622 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 511/1027] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:29 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:30.157883 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-416cafcc-69a1-48ff-b314-1c7203eba8fe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:30.158554 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-416cafcc-69a1-48ff-b314-1c7203eba8fe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:30.164740 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-416cafcc-69a1-48ff-b314-1c7203eba8fe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:30.165185 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-416cafcc-69a1-48ff-b314-1c7203eba8fe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:30.166003 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-416cafcc-69a1-48ff-b314-1c7203eba8fe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:30.166435 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-416cafcc-69a1-48ff-b314-1c7203eba8fe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:30.178161 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d653a663-614a-476a-987e-082086eba8f7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:30.179099 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d653a663-614a-476a-987e-082086eba8f7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:30.185281 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d653a663-614a-476a-987e-082086eba8f7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:30.185735 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d653a663-614a-476a-987e-082086eba8f7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:30.186546 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d653a663-614a-476a-987e-082086eba8f7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:30.186989 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d653a663-614a-476a-987e-082086eba8f7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:30.216548 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d653a663-614a-476a-987e-082086eba8f7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042605 Apr 08 11:23:30.217111 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 512/1028] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:30 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:23:30.297288 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-416cafcc-69a1-48ff-b314-1c7203eba8fe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:30.305689 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-416cafcc-69a1-48ff-b314-1c7203eba8fe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:30.307210 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-416cafcc-69a1-48ff-b314-1c7203eba8fe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:30.308398 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-416cafcc-69a1-48ff-b314-1c7203eba8fe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.154556 Apr 08 11:23:30.308956 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 517/1029] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:30 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:23:30.314025 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7ed520fe-4273-44ed-869c-ef06dcad6517 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:30.314643 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7ed520fe-4273-44ed-869c-ef06dcad6517 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:30.321281 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7ed520fe-4273-44ed-869c-ef06dcad6517 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:30.321738 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7ed520fe-4273-44ed-869c-ef06dcad6517 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:30.322540 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7ed520fe-4273-44ed-869c-ef06dcad6517 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:30.322983 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7ed520fe-4273-44ed-869c-ef06dcad6517 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:30.458131 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7ed520fe-4273-44ed-869c-ef06dcad6517 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:30.466499 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7ed520fe-4273-44ed-869c-ef06dcad6517 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.156130 Apr 08 11:23:30.467085 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 513/1030] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:30 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:23:30.550182 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-250a8bdf-d042-4774-b5dd-cb9ba3ace871 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:30.550784 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-250a8bdf-d042-4774-b5dd-cb9ba3ace871 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:30.557333 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-250a8bdf-d042-4774-b5dd-cb9ba3ace871 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:30.557800 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-250a8bdf-d042-4774-b5dd-cb9ba3ace871 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:30.558657 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-250a8bdf-d042-4774-b5dd-cb9ba3ace871 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:30.559094 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-250a8bdf-d042-4774-b5dd-cb9ba3ace871 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:30.622240 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-250a8bdf-d042-4774-b5dd-cb9ba3ace871 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:30.630288 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-250a8bdf-d042-4774-b5dd-cb9ba3ace871 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.083839 Apr 08 11:23:30.631621 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 518/1031] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:30 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:31.228686 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-24c1fee4-614a-414b-bc68-049410bd2d51 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:31.229614 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-24c1fee4-614a-414b-bc68-049410bd2d51 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:31.235997 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-24c1fee4-614a-414b-bc68-049410bd2d51 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:31.236442 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-24c1fee4-614a-414b-bc68-049410bd2d51 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:31.237221 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-24c1fee4-614a-414b-bc68-049410bd2d51 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:31.237660 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-24c1fee4-614a-414b-bc68-049410bd2d51 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:31.267344 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-24c1fee4-614a-414b-bc68-049410bd2d51 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043121 Apr 08 11:23:31.267902 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 514/1032] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:31 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:31.327302 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-b325f633-0126-4ee6-a6b9-9dd46e88cbaf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:31.327863 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-b325f633-0126-4ee6-a6b9-9dd46e88cbaf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:31.334712 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b325f633-0126-4ee6-a6b9-9dd46e88cbaf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:31.335165 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b325f633-0126-4ee6-a6b9-9dd46e88cbaf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:31.335972 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b325f633-0126-4ee6-a6b9-9dd46e88cbaf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:31.336413 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b325f633-0126-4ee6-a6b9-9dd46e88cbaf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:31.465969 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b325f633-0126-4ee6-a6b9-9dd46e88cbaf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:31.474131 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b325f633-0126-4ee6-a6b9-9dd46e88cbaf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:31.476191 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b325f633-0126-4ee6-a6b9-9dd46e88cbaf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:31.477386 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-b325f633-0126-4ee6-a6b9-9dd46e88cbaf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.154209 Apr 08 11:23:31.477984 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 519/1033] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:31 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:23:31.483438 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-da8fd108-8ece-4493-8041-b98a2d4047b3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:31.484046 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-da8fd108-8ece-4493-8041-b98a2d4047b3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:31.489960 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-da8fd108-8ece-4493-8041-b98a2d4047b3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:31.490408 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-da8fd108-8ece-4493-8041-b98a2d4047b3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:31.491167 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-da8fd108-8ece-4493-8041-b98a2d4047b3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:31.491596 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-da8fd108-8ece-4493-8041-b98a2d4047b3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:31.622127 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-da8fd108-8ece-4493-8041-b98a2d4047b3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:31.629482 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-da8fd108-8ece-4493-8041-b98a2d4047b3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.149857 Apr 08 11:23:31.630082 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 515/1034] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:31 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:31.648988 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-34285f35-525c-48b9-8a9c-72df8b633c90 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:31.649608 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-34285f35-525c-48b9-8a9c-72df8b633c90 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:31.655640 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-34285f35-525c-48b9-8a9c-72df8b633c90 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:31.656106 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-34285f35-525c-48b9-8a9c-72df8b633c90 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:31.656883 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-34285f35-525c-48b9-8a9c-72df8b633c90 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:31.657327 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-34285f35-525c-48b9-8a9c-72df8b633c90 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:31.719351 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-34285f35-525c-48b9-8a9c-72df8b633c90 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:31.726841 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-34285f35-525c-48b9-8a9c-72df8b633c90 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.083252 Apr 08 11:23:31.727411 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 520/1035] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:31 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:23:32.279121 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6b6f6147-c9e9-491b-8cab-0e190f488985 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:32.280081 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6b6f6147-c9e9-491b-8cab-0e190f488985 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:32.286429 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6b6f6147-c9e9-491b-8cab-0e190f488985 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:32.286912 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6b6f6147-c9e9-491b-8cab-0e190f488985 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:32.287688 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6b6f6147-c9e9-491b-8cab-0e190f488985 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:32.288174 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6b6f6147-c9e9-491b-8cab-0e190f488985 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:32.316578 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6b6f6147-c9e9-491b-8cab-0e190f488985 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041397 Apr 08 11:23:32.317125 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 516/1036] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:32 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:32.496421 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-fba50ada-209a-43a1-b453-0cdc6373281a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:32.497055 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-fba50ada-209a-43a1-b453-0cdc6373281a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:32.503334 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fba50ada-209a-43a1-b453-0cdc6373281a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:32.503791 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fba50ada-209a-43a1-b453-0cdc6373281a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:32.504562 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fba50ada-209a-43a1-b453-0cdc6373281a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:32.505003 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fba50ada-209a-43a1-b453-0cdc6373281a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:32.636091 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-fba50ada-209a-43a1-b453-0cdc6373281a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:32.646345 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-fba50ada-209a-43a1-b453-0cdc6373281a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:32.646508 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f5c46325-18da-4c16-8273-a8eae3a3cb14 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:32.647142 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f5c46325-18da-4c16-8273-a8eae3a3cb14 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:32.647837 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-fba50ada-209a-43a1-b453-0cdc6373281a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:32.649003 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-fba50ada-209a-43a1-b453-0cdc6373281a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.156800 Apr 08 11:23:32.649567 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 521/1037] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:32 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:23:32.653414 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f5c46325-18da-4c16-8273-a8eae3a3cb14 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:32.653897 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f5c46325-18da-4c16-8273-a8eae3a3cb14 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:32.654681 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f5c46325-18da-4c16-8273-a8eae3a3cb14 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:32.655124 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f5c46325-18da-4c16-8273-a8eae3a3cb14 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:32.744076 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-296689af-aa98-4bfa-889d-63d2f417c37b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:32.744995 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-296689af-aa98-4bfa-889d-63d2f417c37b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:32.751563 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-296689af-aa98-4bfa-889d-63d2f417c37b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:32.752016 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-296689af-aa98-4bfa-889d-63d2f417c37b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:32.752800 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-296689af-aa98-4bfa-889d-63d2f417c37b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:32.753243 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-296689af-aa98-4bfa-889d-63d2f417c37b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:32.792160 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f5c46325-18da-4c16-8273-a8eae3a3cb14 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:32.799996 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f5c46325-18da-4c16-8273-a8eae3a3cb14 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.157840 Apr 08 11:23:32.800580 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 517/1038] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:32 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:23:32.822101 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-296689af-aa98-4bfa-889d-63d2f417c37b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:32.828253 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-296689af-aa98-4bfa-889d-63d2f417c37b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.088913 Apr 08 11:23:32.828830 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 522/1039] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:32 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:23:33.328657 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8a6d69bc-3d21-46e3-afbb-c461b14471bb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:33.329589 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8a6d69bc-3d21-46e3-afbb-c461b14471bb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:33.336575 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8a6d69bc-3d21-46e3-afbb-c461b14471bb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:33.337025 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8a6d69bc-3d21-46e3-afbb-c461b14471bb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:33.337816 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8a6d69bc-3d21-46e3-afbb-c461b14471bb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:33.338262 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8a6d69bc-3d21-46e3-afbb-c461b14471bb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:33.366031 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8a6d69bc-3d21-46e3-afbb-c461b14471bb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041160 Apr 08 11:23:33.366591 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 518/1040] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:33 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:33.669507 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e651379b-2fc2-4675-80b4-fe374c6f6da3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:33.670176 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e651379b-2fc2-4675-80b4-fe374c6f6da3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:33.677560 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e651379b-2fc2-4675-80b4-fe374c6f6da3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:33.678616 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e651379b-2fc2-4675-80b4-fe374c6f6da3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:33.679478 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e651379b-2fc2-4675-80b4-fe374c6f6da3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:33.679927 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e651379b-2fc2-4675-80b4-fe374c6f6da3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:33.811787 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e651379b-2fc2-4675-80b4-fe374c6f6da3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:33.816227 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8a776ddd-5f1e-430d-98ae-1781fe271182 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:33.816854 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8a776ddd-5f1e-430d-98ae-1781fe271182 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:33.820739 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e651379b-2fc2-4675-80b4-fe374c6f6da3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:33.822275 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e651379b-2fc2-4675-80b4-fe374c6f6da3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:33.823132 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8a776ddd-5f1e-430d-98ae-1781fe271182 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:33.823595 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e651379b-2fc2-4675-80b4-fe374c6f6da3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.159628 Apr 08 11:23:33.823773 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8a776ddd-5f1e-430d-98ae-1781fe271182 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:33.824589 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 523/1041] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:33 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:23:33.831163 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8a776ddd-5f1e-430d-98ae-1781fe271182 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:33.831640 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8a776ddd-5f1e-430d-98ae-1781fe271182 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:33.844915 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-d8b6c0e9-710b-4dee-a3ae-a530b6fb5090 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:33.845556 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-d8b6c0e9-710b-4dee-a3ae-a530b6fb5090 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:33.851465 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d8b6c0e9-710b-4dee-a3ae-a530b6fb5090 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:33.851921 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d8b6c0e9-710b-4dee-a3ae-a530b6fb5090 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:33.852689 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d8b6c0e9-710b-4dee-a3ae-a530b6fb5090 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:33.853129 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d8b6c0e9-710b-4dee-a3ae-a530b6fb5090 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:33.922699 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d8b6c0e9-710b-4dee-a3ae-a530b6fb5090 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:33.930653 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-d8b6c0e9-710b-4dee-a3ae-a530b6fb5090 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.089512 Apr 08 11:23:33.931240 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 524/1042] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:33 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:23:33.989324 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8a776ddd-5f1e-430d-98ae-1781fe271182 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:33.997783 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8a776ddd-5f1e-430d-98ae-1781fe271182 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.185283 Apr 08 11:23:33.998345 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 519/1043] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:33 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:23:34.378066 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a0ba8a90-11da-4829-8e54-cb6964f58920 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:34.379022 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a0ba8a90-11da-4829-8e54-cb6964f58920 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:34.385456 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a0ba8a90-11da-4829-8e54-cb6964f58920 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:34.385946 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a0ba8a90-11da-4829-8e54-cb6964f58920 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:34.386715 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a0ba8a90-11da-4829-8e54-cb6964f58920 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:34.387153 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a0ba8a90-11da-4829-8e54-cb6964f58920 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:34.414750 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a0ba8a90-11da-4829-8e54-cb6964f58920 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040733 Apr 08 11:23:34.415307 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 525/1044] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:34 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:34.840465 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f3034304-c3f8-4657-9db8-c157766b6f9e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:34.841107 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f3034304-c3f8-4657-9db8-c157766b6f9e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:34.847619 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f3034304-c3f8-4657-9db8-c157766b6f9e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:34.848173 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f3034304-c3f8-4657-9db8-c157766b6f9e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:34.848956 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f3034304-c3f8-4657-9db8-c157766b6f9e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:34.849402 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f3034304-c3f8-4657-9db8-c157766b6f9e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:34.947295 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-5b79c9e7-ee44-4537-bc80-cb821163d05d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:34.947962 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-5b79c9e7-ee44-4537-bc80-cb821163d05d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:34.954405 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5b79c9e7-ee44-4537-bc80-cb821163d05d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:34.954867 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5b79c9e7-ee44-4537-bc80-cb821163d05d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:34.955647 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5b79c9e7-ee44-4537-bc80-cb821163d05d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:34.956094 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5b79c9e7-ee44-4537-bc80-cb821163d05d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:34.980313 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f3034304-c3f8-4657-9db8-c157766b6f9e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:34.988754 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f3034304-c3f8-4657-9db8-c157766b6f9e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:34.990281 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f3034304-c3f8-4657-9db8-c157766b6f9e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:34.992102 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f3034304-c3f8-4657-9db8-c157766b6f9e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.155568 Apr 08 11:23:34.992666 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 520/1045] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:34 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:23:35.014857 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-552ed0c5-3308-4b13-b2ca-d424342a59db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:35.015473 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-552ed0c5-3308-4b13-b2ca-d424342a59db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:35.015781 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-5b79c9e7-ee44-4537-bc80-cb821163d05d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:35.022438 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-552ed0c5-3308-4b13-b2ca-d424342a59db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:35.022889 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-552ed0c5-3308-4b13-b2ca-d424342a59db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:35.023703 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-552ed0c5-3308-4b13-b2ca-d424342a59db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:35.023817 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-5b79c9e7-ee44-4537-bc80-cb821163d05d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080219 Apr 08 11:23:35.024140 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-552ed0c5-3308-4b13-b2ca-d424342a59db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:35.024573 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 526/1046] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:34 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:23:35.160992 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-552ed0c5-3308-4b13-b2ca-d424342a59db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:35.168979 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-552ed0c5-3308-4b13-b2ca-d424342a59db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.158075 Apr 08 11:23:35.169544 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 521/1047] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:35 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:23:35.426489 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-04aab7a9-4f53-402d-8b8f-6b77a47936fe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:35.427434 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-04aab7a9-4f53-402d-8b8f-6b77a47936fe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:35.433517 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-04aab7a9-4f53-402d-8b8f-6b77a47936fe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:35.434001 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-04aab7a9-4f53-402d-8b8f-6b77a47936fe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:35.434787 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-04aab7a9-4f53-402d-8b8f-6b77a47936fe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:35.435231 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-04aab7a9-4f53-402d-8b8f-6b77a47936fe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:35.464908 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-04aab7a9-4f53-402d-8b8f-6b77a47936fe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042336 Apr 08 11:23:35.465481 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 527/1048] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:35 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:36.011121 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-75c9fc7d-bf1a-4669-acb8-45ab12c32eee tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:36.011761 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-75c9fc7d-bf1a-4669-acb8-45ab12c32eee tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:36.018100 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-75c9fc7d-bf1a-4669-acb8-45ab12c32eee tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:36.018557 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-75c9fc7d-bf1a-4669-acb8-45ab12c32eee tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:36.019332 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-75c9fc7d-bf1a-4669-acb8-45ab12c32eee tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:36.019776 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-75c9fc7d-bf1a-4669-acb8-45ab12c32eee tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:36.040078 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a5e94f56-f50a-4b3e-885b-7ec0beda5f93 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:36.040800 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a5e94f56-f50a-4b3e-885b-7ec0beda5f93 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:36.047161 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a5e94f56-f50a-4b3e-885b-7ec0beda5f93 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:36.047617 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a5e94f56-f50a-4b3e-885b-7ec0beda5f93 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:36.048395 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a5e94f56-f50a-4b3e-885b-7ec0beda5f93 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:36.048906 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a5e94f56-f50a-4b3e-885b-7ec0beda5f93 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:36.111717 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a5e94f56-f50a-4b3e-885b-7ec0beda5f93 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:36.120749 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a5e94f56-f50a-4b3e-885b-7ec0beda5f93 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.084424 Apr 08 11:23:36.121338 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 528/1049] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:36 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:23:36.177678 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-75c9fc7d-bf1a-4669-acb8-45ab12c32eee tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:36.185970 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-91500283-fb90-4b26-9c9a-e43c3a0be2c2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:36.186631 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-91500283-fb90-4b26-9c9a-e43c3a0be2c2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:36.187033 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-75c9fc7d-bf1a-4669-acb8-45ab12c32eee tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:36.188551 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-75c9fc7d-bf1a-4669-acb8-45ab12c32eee tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:36.189710 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-75c9fc7d-bf1a-4669-acb8-45ab12c32eee tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.182523 Apr 08 11:23:36.190294 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 522/1050] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:36 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:23:36.192453 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-91500283-fb90-4b26-9c9a-e43c3a0be2c2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:36.192905 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-91500283-fb90-4b26-9c9a-e43c3a0be2c2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:36.193720 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-91500283-fb90-4b26-9c9a-e43c3a0be2c2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:36.194253 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-91500283-fb90-4b26-9c9a-e43c3a0be2c2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:36.327625 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-91500283-fb90-4b26-9c9a-e43c3a0be2c2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:36.334942 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-91500283-fb90-4b26-9c9a-e43c3a0be2c2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.153024 Apr 08 11:23:36.335532 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 529/1051] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:36 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:23:36.479820 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7e0055ba-7c87-43ba-b78f-fdb24474bbd2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:36.480665 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7e0055ba-7c87-43ba-b78f-fdb24474bbd2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:36.487981 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7e0055ba-7c87-43ba-b78f-fdb24474bbd2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:36.488434 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7e0055ba-7c87-43ba-b78f-fdb24474bbd2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:36.489210 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7e0055ba-7c87-43ba-b78f-fdb24474bbd2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:36.489643 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7e0055ba-7c87-43ba-b78f-fdb24474bbd2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:36.522672 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7e0055ba-7c87-43ba-b78f-fdb24474bbd2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049159 Apr 08 11:23:36.523221 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 523/1052] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:36 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:37.137810 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-ee02d12d-fd63-41fb-85b0-c428576d5337 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:37.138366 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-ee02d12d-fd63-41fb-85b0-c428576d5337 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:37.144702 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ee02d12d-fd63-41fb-85b0-c428576d5337 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:37.145151 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ee02d12d-fd63-41fb-85b0-c428576d5337 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:37.145948 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ee02d12d-fd63-41fb-85b0-c428576d5337 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:37.146391 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ee02d12d-fd63-41fb-85b0-c428576d5337 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:37.206137 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-ee02d12d-fd63-41fb-85b0-c428576d5337 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:37.207793 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3f86adce-eb93-4add-ba13-5c85305015d1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:37.208618 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3f86adce-eb93-4add-ba13-5c85305015d1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:37.214361 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-ee02d12d-fd63-41fb-85b0-c428576d5337 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080467 Apr 08 11:23:37.214941 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 530/1053] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:37 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:37.215437 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3f86adce-eb93-4add-ba13-5c85305015d1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:37.216009 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3f86adce-eb93-4add-ba13-5c85305015d1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:37.216823 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3f86adce-eb93-4add-ba13-5c85305015d1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:37.217260 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3f86adce-eb93-4add-ba13-5c85305015d1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:37.350096 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3f86adce-eb93-4add-ba13-5c85305015d1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:37.352637 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-4070cda3-8e1d-47c8-8f64-9d257d5ff379 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:37.353337 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-4070cda3-8e1d-47c8-8f64-9d257d5ff379 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:37.358955 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3f86adce-eb93-4add-ba13-5c85305015d1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:37.359304 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4070cda3-8e1d-47c8-8f64-9d257d5ff379 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:37.359759 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4070cda3-8e1d-47c8-8f64-9d257d5ff379 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:37.360480 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3f86adce-eb93-4add-ba13-5c85305015d1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:37.360619 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4070cda3-8e1d-47c8-8f64-9d257d5ff379 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:37.360959 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4070cda3-8e1d-47c8-8f64-9d257d5ff379 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:37.361617 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3f86adce-eb93-4add-ba13-5c85305015d1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.157634 Apr 08 11:23:37.365818 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 524/1054] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:37 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:23:37.493181 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-4070cda3-8e1d-47c8-8f64-9d257d5ff379 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:37.500872 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-4070cda3-8e1d-47c8-8f64-9d257d5ff379 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.152236 Apr 08 11:23:37.501468 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 531/1055] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:37 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:23:37.533503 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2dab54f6-a997-4003-9fc5-4ff9ba619be0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:37.534498 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2dab54f6-a997-4003-9fc5-4ff9ba619be0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:37.540365 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2dab54f6-a997-4003-9fc5-4ff9ba619be0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:37.540822 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2dab54f6-a997-4003-9fc5-4ff9ba619be0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:37.541596 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2dab54f6-a997-4003-9fc5-4ff9ba619be0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:37.542081 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2dab54f6-a997-4003-9fc5-4ff9ba619be0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:37.571187 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2dab54f6-a997-4003-9fc5-4ff9ba619be0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041562 Apr 08 11:23:37.571888 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 525/1056] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:37 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:23:38.231508 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e2115b47-9a47-4cbd-9296-0499d157ba9a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:38.232050 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e2115b47-9a47-4cbd-9296-0499d157ba9a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:38.238676 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e2115b47-9a47-4cbd-9296-0499d157ba9a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:38.239128 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e2115b47-9a47-4cbd-9296-0499d157ba9a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:38.239893 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e2115b47-9a47-4cbd-9296-0499d157ba9a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:38.240329 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e2115b47-9a47-4cbd-9296-0499d157ba9a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:38.299452 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e2115b47-9a47-4cbd-9296-0499d157ba9a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:38.306862 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e2115b47-9a47-4cbd-9296-0499d157ba9a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079255 Apr 08 11:23:38.307428 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 532/1057] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:38 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:38.381472 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-90e2f4e4-f4a2-4df4-aae3-4da77599b856 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:38.382151 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-90e2f4e4-f4a2-4df4-aae3-4da77599b856 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:38.388525 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-90e2f4e4-f4a2-4df4-aae3-4da77599b856 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:38.388992 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-90e2f4e4-f4a2-4df4-aae3-4da77599b856 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:38.389780 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-90e2f4e4-f4a2-4df4-aae3-4da77599b856 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:38.390238 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-90e2f4e4-f4a2-4df4-aae3-4da77599b856 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:38.518480 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e005d7f6-783f-4c1b-8165-e7a53fa6f84d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:38.519199 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e005d7f6-783f-4c1b-8165-e7a53fa6f84d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:38.521295 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-90e2f4e4-f4a2-4df4-aae3-4da77599b856 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:38.525639 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e005d7f6-783f-4c1b-8165-e7a53fa6f84d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:38.526119 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e005d7f6-783f-4c1b-8165-e7a53fa6f84d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:38.526889 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e005d7f6-783f-4c1b-8165-e7a53fa6f84d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:38.527326 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e005d7f6-783f-4c1b-8165-e7a53fa6f84d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:38.530340 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-90e2f4e4-f4a2-4df4-aae3-4da77599b856 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:38.531862 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-90e2f4e4-f4a2-4df4-aae3-4da77599b856 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:38.533026 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-90e2f4e4-f4a2-4df4-aae3-4da77599b856 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.155966 Apr 08 11:23:38.533585 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 526/1058] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:38 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:23:38.582734 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-65e751a1-e67d-4732-9e3d-b4e57f927cfb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:38.583931 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-65e751a1-e67d-4732-9e3d-b4e57f927cfb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:38.590336 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-65e751a1-e67d-4732-9e3d-b4e57f927cfb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:38.590734 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-65e751a1-e67d-4732-9e3d-b4e57f927cfb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:38.591443 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-65e751a1-e67d-4732-9e3d-b4e57f927cfb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:38.591885 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-65e751a1-e67d-4732-9e3d-b4e57f927cfb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:38.621981 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-65e751a1-e67d-4732-9e3d-b4e57f927cfb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043183 Apr 08 11:23:38.622558 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 527/1059] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:38 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:23:38.663120 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e005d7f6-783f-4c1b-8165-e7a53fa6f84d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:38.670638 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e005d7f6-783f-4c1b-8165-e7a53fa6f84d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.155928 Apr 08 11:23:38.671209 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 533/1060] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:38 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:23:39.323743 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-223cdc7e-1213-41fe-ba6e-f837d3200317 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:39.324361 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-223cdc7e-1213-41fe-ba6e-f837d3200317 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:39.330293 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-223cdc7e-1213-41fe-ba6e-f837d3200317 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:39.330748 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-223cdc7e-1213-41fe-ba6e-f837d3200317 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:39.331520 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-223cdc7e-1213-41fe-ba6e-f837d3200317 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:39.331959 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-223cdc7e-1213-41fe-ba6e-f837d3200317 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:39.390427 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-223cdc7e-1213-41fe-ba6e-f837d3200317 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:39.398717 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-223cdc7e-1213-41fe-ba6e-f837d3200317 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078845 Apr 08 11:23:39.399284 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 528/1061] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:39 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:39.551456 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-cb07006a-45a9-4a3c-a47b-05fd52427795 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:39.552179 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-cb07006a-45a9-4a3c-a47b-05fd52427795 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:39.559001 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cb07006a-45a9-4a3c-a47b-05fd52427795 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:39.559445 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cb07006a-45a9-4a3c-a47b-05fd52427795 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:39.560232 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cb07006a-45a9-4a3c-a47b-05fd52427795 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:39.560667 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cb07006a-45a9-4a3c-a47b-05fd52427795 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:39.634337 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-99900c9e-947c-44d2-b990-7ead164da91c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:39.635220 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-99900c9e-947c-44d2-b990-7ead164da91c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:39.641264 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-99900c9e-947c-44d2-b990-7ead164da91c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:39.641728 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-99900c9e-947c-44d2-b990-7ead164da91c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:39.642553 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-99900c9e-947c-44d2-b990-7ead164da91c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:39.642999 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-99900c9e-947c-44d2-b990-7ead164da91c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:39.675204 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-99900c9e-947c-44d2-b990-7ead164da91c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045459 Apr 08 11:23:39.675776 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 529/1062] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:39 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:23:39.687853 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-66c8ac00-6457-49a4-8db1-22839b35c884 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:39.688525 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-66c8ac00-6457-49a4-8db1-22839b35c884 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:39.694976 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-66c8ac00-6457-49a4-8db1-22839b35c884 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:39.695540 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-66c8ac00-6457-49a4-8db1-22839b35c884 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:39.696234 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-cb07006a-45a9-4a3c-a47b-05fd52427795 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:39.696380 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-66c8ac00-6457-49a4-8db1-22839b35c884 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:39.696931 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-66c8ac00-6457-49a4-8db1-22839b35c884 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:39.704558 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-cb07006a-45a9-4a3c-a47b-05fd52427795 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:39.706107 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-cb07006a-45a9-4a3c-a47b-05fd52427795 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:39.707276 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-cb07006a-45a9-4a3c-a47b-05fd52427795 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.159773 Apr 08 11:23:39.707843 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 534/1063] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:39 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:23:39.836666 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-66c8ac00-6457-49a4-8db1-22839b35c884 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:39.843999 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-66c8ac00-6457-49a4-8db1-22839b35c884 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.159968 Apr 08 11:23:39.844562 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 530/1064] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:39 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:40.415116 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-f4446372-cc74-4091-99bb-bdd7e2cd7bb4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:40.415724 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-f4446372-cc74-4091-99bb-bdd7e2cd7bb4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:40.421594 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f4446372-cc74-4091-99bb-bdd7e2cd7bb4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:40.422075 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f4446372-cc74-4091-99bb-bdd7e2cd7bb4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:40.422873 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f4446372-cc74-4091-99bb-bdd7e2cd7bb4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:40.423317 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f4446372-cc74-4091-99bb-bdd7e2cd7bb4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:40.480781 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f4446372-cc74-4091-99bb-bdd7e2cd7bb4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:40.488144 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-f4446372-cc74-4091-99bb-bdd7e2cd7bb4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.076905 Apr 08 11:23:40.488799 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 535/1065] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:40 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:40.686685 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7d311641-ea32-4302-ba6b-b18fc14da8b4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:40.687525 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7d311641-ea32-4302-ba6b-b18fc14da8b4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:40.694714 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d311641-ea32-4302-ba6b-b18fc14da8b4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:40.695186 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d311641-ea32-4302-ba6b-b18fc14da8b4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:40.695974 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d311641-ea32-4302-ba6b-b18fc14da8b4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:40.696408 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d311641-ea32-4302-ba6b-b18fc14da8b4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:40.727061 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7d311641-ea32-4302-ba6b-b18fc14da8b4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044382 Apr 08 11:23:40.727329 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-5ecbb0f1-c300-498c-ba40-9013e167bb2d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:40.727832 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-5ecbb0f1-c300-498c-ba40-9013e167bb2d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:40.728033 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 531/1066] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:40 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:40.734716 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5ecbb0f1-c300-498c-ba40-9013e167bb2d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:40.735161 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5ecbb0f1-c300-498c-ba40-9013e167bb2d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:40.735950 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5ecbb0f1-c300-498c-ba40-9013e167bb2d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:40.736388 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5ecbb0f1-c300-498c-ba40-9013e167bb2d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:40.861964 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ab645295-061f-4978-8093-c3405fb23004 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:40.862687 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ab645295-061f-4978-8093-c3405fb23004 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:40.869313 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ab645295-061f-4978-8093-c3405fb23004 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:40.869753 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ab645295-061f-4978-8093-c3405fb23004 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:40.870542 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ab645295-061f-4978-8093-c3405fb23004 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:40.870978 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ab645295-061f-4978-8093-c3405fb23004 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:40.876248 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-5ecbb0f1-c300-498c-ba40-9013e167bb2d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:40.884582 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-5ecbb0f1-c300-498c-ba40-9013e167bb2d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:40.886114 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-5ecbb0f1-c300-498c-ba40-9013e167bb2d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:40.887290 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-5ecbb0f1-c300-498c-ba40-9013e167bb2d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.164472 Apr 08 11:23:40.887957 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 536/1067] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:40 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:23:41.002154 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ab645295-061f-4978-8093-c3405fb23004 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:41.010028 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ab645295-061f-4978-8093-c3405fb23004 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.151960 Apr 08 11:23:41.010593 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 532/1068] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:40 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:23:41.504613 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-af4dd3d0-c556-498e-b9a5-9d1e80940ca4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:41.505231 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-af4dd3d0-c556-498e-b9a5-9d1e80940ca4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:41.511784 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-af4dd3d0-c556-498e-b9a5-9d1e80940ca4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:41.512237 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-af4dd3d0-c556-498e-b9a5-9d1e80940ca4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:41.513021 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-af4dd3d0-c556-498e-b9a5-9d1e80940ca4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:41.513464 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-af4dd3d0-c556-498e-b9a5-9d1e80940ca4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:41.576763 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-af4dd3d0-c556-498e-b9a5-9d1e80940ca4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:41.584892 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-af4dd3d0-c556-498e-b9a5-9d1e80940ca4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.084169 Apr 08 11:23:41.585481 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 537/1069] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:41 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:41.739030 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b6c34d29-2210-4839-a4f3-c754aaef97c2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:41.740497 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b6c34d29-2210-4839-a4f3-c754aaef97c2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:41.747706 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b6c34d29-2210-4839-a4f3-c754aaef97c2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:41.748170 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b6c34d29-2210-4839-a4f3-c754aaef97c2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:41.748970 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b6c34d29-2210-4839-a4f3-c754aaef97c2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:41.749412 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b6c34d29-2210-4839-a4f3-c754aaef97c2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:41.779245 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b6c34d29-2210-4839-a4f3-c754aaef97c2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044156 Apr 08 11:23:41.779806 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 533/1070] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:41 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:41.905358 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-613f988e-d545-4398-9015-aaa9900e5e75 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:41.905985 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-613f988e-d545-4398-9015-aaa9900e5e75 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:41.912804 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-613f988e-d545-4398-9015-aaa9900e5e75 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:41.913258 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-613f988e-d545-4398-9015-aaa9900e5e75 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:41.914104 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-613f988e-d545-4398-9015-aaa9900e5e75 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:41.914578 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-613f988e-d545-4398-9015-aaa9900e5e75 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:42.027091 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-44f4d49b-1dd8-42d2-b298-676d41676497 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:42.027705 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-44f4d49b-1dd8-42d2-b298-676d41676497 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:42.033744 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-44f4d49b-1dd8-42d2-b298-676d41676497 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:42.034195 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-44f4d49b-1dd8-42d2-b298-676d41676497 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:42.034975 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-44f4d49b-1dd8-42d2-b298-676d41676497 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:42.035416 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-44f4d49b-1dd8-42d2-b298-676d41676497 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:42.047134 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-613f988e-d545-4398-9015-aaa9900e5e75 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:42.056446 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-613f988e-d545-4398-9015-aaa9900e5e75 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:42.057967 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-613f988e-d545-4398-9015-aaa9900e5e75 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:42.059145 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-613f988e-d545-4398-9015-aaa9900e5e75 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.157712 Apr 08 11:23:42.059715 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 538/1071] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:41 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:23:42.170543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-44f4d49b-1dd8-42d2-b298-676d41676497 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:42.178656 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-44f4d49b-1dd8-42d2-b298-676d41676497 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.155434 Apr 08 11:23:42.179222 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 534/1072] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:42 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:23:42.602245 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a818a7ab-0f0d-445e-864a-69172561bdee tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:42.602860 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a818a7ab-0f0d-445e-864a-69172561bdee tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:42.608799 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a818a7ab-0f0d-445e-864a-69172561bdee tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:42.609251 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a818a7ab-0f0d-445e-864a-69172561bdee tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:42.610056 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a818a7ab-0f0d-445e-864a-69172561bdee tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:42.610502 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a818a7ab-0f0d-445e-864a-69172561bdee tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:42.678698 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a818a7ab-0f0d-445e-864a-69172561bdee tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:42.686190 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a818a7ab-0f0d-445e-864a-69172561bdee tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.088423 Apr 08 11:23:42.686759 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 539/1073] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:42 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:42.793738 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-908c7e06-b064-44ec-b284-85fd03179efe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:42.794708 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-908c7e06-b064-44ec-b284-85fd03179efe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:42.801488 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-908c7e06-b064-44ec-b284-85fd03179efe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:42.801988 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-908c7e06-b064-44ec-b284-85fd03179efe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:42.802788 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-908c7e06-b064-44ec-b284-85fd03179efe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:42.803237 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-908c7e06-b064-44ec-b284-85fd03179efe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:42.834736 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-908c7e06-b064-44ec-b284-85fd03179efe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046229 Apr 08 11:23:42.835310 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 535/1074] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:42 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:43.078120 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-bcaa12e7-ed51-471b-b8c2-39dc210dc769 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:43.078741 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-bcaa12e7-ed51-471b-b8c2-39dc210dc769 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:43.085348 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bcaa12e7-ed51-471b-b8c2-39dc210dc769 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:43.085830 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bcaa12e7-ed51-471b-b8c2-39dc210dc769 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:43.086605 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bcaa12e7-ed51-471b-b8c2-39dc210dc769 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:43.087049 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bcaa12e7-ed51-471b-b8c2-39dc210dc769 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:43.196040 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-be33e1d8-9113-425d-bf9f-96f52cd7235c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:43.196695 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-be33e1d8-9113-425d-bf9f-96f52cd7235c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:43.203700 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-be33e1d8-9113-425d-bf9f-96f52cd7235c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:43.204171 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-be33e1d8-9113-425d-bf9f-96f52cd7235c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:43.204940 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-be33e1d8-9113-425d-bf9f-96f52cd7235c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:43.205386 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-be33e1d8-9113-425d-bf9f-96f52cd7235c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:43.534909 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-bcaa12e7-ed51-471b-b8c2-39dc210dc769 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:43.539135 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-be33e1d8-9113-425d-bf9f-96f52cd7235c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:43.544197 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-bcaa12e7-ed51-471b-b8c2-39dc210dc769 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:43.545838 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-bcaa12e7-ed51-471b-b8c2-39dc210dc769 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:43.546482 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-be33e1d8-9113-425d-bf9f-96f52cd7235c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.354382 Apr 08 11:23:43.547023 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-bcaa12e7-ed51-471b-b8c2-39dc210dc769 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.473433 Apr 08 11:23:43.547140 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 536/1075] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:43 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:23:43.547655 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 540/1076] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:43 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:23:43.702885 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d73e185c-d6bd-4949-853d-f0009dd09e80 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:43.703423 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d73e185c-d6bd-4949-853d-f0009dd09e80 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:43.709938 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d73e185c-d6bd-4949-853d-f0009dd09e80 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:43.710393 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d73e185c-d6bd-4949-853d-f0009dd09e80 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:43.711162 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d73e185c-d6bd-4949-853d-f0009dd09e80 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:43.711603 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d73e185c-d6bd-4949-853d-f0009dd09e80 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:43.770067 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d73e185c-d6bd-4949-853d-f0009dd09e80 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:43.778111 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d73e185c-d6bd-4949-853d-f0009dd09e80 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079209 Apr 08 11:23:43.778673 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 537/1077] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:43 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:43.845722 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-5f654bf5-b524-4db0-a89e-6d34454c24b6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:43.846747 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-5f654bf5-b524-4db0-a89e-6d34454c24b6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:43.852939 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5f654bf5-b524-4db0-a89e-6d34454c24b6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:43.853395 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5f654bf5-b524-4db0-a89e-6d34454c24b6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:43.854209 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5f654bf5-b524-4db0-a89e-6d34454c24b6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:43.854653 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5f654bf5-b524-4db0-a89e-6d34454c24b6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:43.894709 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-5f654bf5-b524-4db0-a89e-6d34454c24b6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053040 Apr 08 11:23:43.895268 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 541/1078] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:43 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:44.564158 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-870a5836-2faa-4286-b592-5f13ba216264 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:44.564863 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-870a5836-2faa-4286-b592-5f13ba216264 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:44.565885 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-30fd73bf-a0d6-41c8-819b-bdd0ae45639d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:44.566650 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-30fd73bf-a0d6-41c8-819b-bdd0ae45639d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:44.571113 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-870a5836-2faa-4286-b592-5f13ba216264 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:44.571567 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-870a5836-2faa-4286-b592-5f13ba216264 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:44.572353 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-870a5836-2faa-4286-b592-5f13ba216264 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:44.572792 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-870a5836-2faa-4286-b592-5f13ba216264 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:44.573075 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-30fd73bf-a0d6-41c8-819b-bdd0ae45639d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:44.573532 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-30fd73bf-a0d6-41c8-819b-bdd0ae45639d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:44.574340 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-30fd73bf-a0d6-41c8-819b-bdd0ae45639d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:44.574783 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-30fd73bf-a0d6-41c8-819b-bdd0ae45639d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:44.772420 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-870a5836-2faa-4286-b592-5f13ba216264 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:44.777074 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-30fd73bf-a0d6-41c8-819b-bdd0ae45639d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:44.781534 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-870a5836-2faa-4286-b592-5f13ba216264 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:44.783078 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-870a5836-2faa-4286-b592-5f13ba216264 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:44.784241 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-870a5836-2faa-4286-b592-5f13ba216264 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.223929 Apr 08 11:23:44.784564 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-30fd73bf-a0d6-41c8-819b-bdd0ae45639d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.225527 Apr 08 11:23:44.784846 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 542/1079] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:44 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:23:44.785125 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 538/1080] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:44 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:44.794555 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-352f886a-51b2-4c44-9f8b-7b8c69486a2f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:44.795173 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-352f886a-51b2-4c44-9f8b-7b8c69486a2f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:44.801314 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-352f886a-51b2-4c44-9f8b-7b8c69486a2f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:44.801773 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-352f886a-51b2-4c44-9f8b-7b8c69486a2f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:44.802589 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-352f886a-51b2-4c44-9f8b-7b8c69486a2f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:44.803066 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-352f886a-51b2-4c44-9f8b-7b8c69486a2f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:44.861632 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-352f886a-51b2-4c44-9f8b-7b8c69486a2f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:44.878261 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-352f886a-51b2-4c44-9f8b-7b8c69486a2f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.087391 Apr 08 11:23:44.878969 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 543/1081] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:44 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:23:44.907175 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4d33d037-7ec9-4414-83d9-c38c8be9be41 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:44.908131 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4d33d037-7ec9-4414-83d9-c38c8be9be41 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:44.914625 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4d33d037-7ec9-4414-83d9-c38c8be9be41 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:44.915078 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4d33d037-7ec9-4414-83d9-c38c8be9be41 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:44.915875 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4d33d037-7ec9-4414-83d9-c38c8be9be41 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:44.916314 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4d33d037-7ec9-4414-83d9-c38c8be9be41 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:44.944147 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4d33d037-7ec9-4414-83d9-c38c8be9be41 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041296 Apr 08 11:23:44.944699 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 539/1082] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:44 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:45.802641 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-18c77b54-66c8-44a0-af0f-42faa17805ce tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:45.803225 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-899562bb-c50a-4088-b147-b183a540f5fe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:45.803619 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-18c77b54-66c8-44a0-af0f-42faa17805ce tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:45.803728 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-899562bb-c50a-4088-b147-b183a540f5fe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:45.809494 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-18c77b54-66c8-44a0-af0f-42faa17805ce tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:45.809647 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-899562bb-c50a-4088-b147-b183a540f5fe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:45.809984 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-18c77b54-66c8-44a0-af0f-42faa17805ce tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:45.810121 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-899562bb-c50a-4088-b147-b183a540f5fe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:45.810765 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-18c77b54-66c8-44a0-af0f-42faa17805ce tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:45.810884 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-899562bb-c50a-4088-b147-b183a540f5fe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:45.811194 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-899562bb-c50a-4088-b147-b183a540f5fe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:45.811298 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-18c77b54-66c8-44a0-af0f-42faa17805ce tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:46.016101 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-18c77b54-66c8-44a0-af0f-42faa17805ce tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:46.020055 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-899562bb-c50a-4088-b147-b183a540f5fe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:46.024481 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-18c77b54-66c8-44a0-af0f-42faa17805ce tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.225884 Apr 08 11:23:46.025061 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 544/1083] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:45 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:46.029214 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-899562bb-c50a-4088-b147-b183a540f5fe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:46.030277 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-8ed93725-6047-499c-970b-82a10bd38592 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:46.030740 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-899562bb-c50a-4088-b147-b183a540f5fe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:46.030875 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-8ed93725-6047-499c-970b-82a10bd38592 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:46.031908 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-899562bb-c50a-4088-b147-b183a540f5fe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.233092 Apr 08 11:23:46.034166 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 540/1084] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:45 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:23:46.036968 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8ed93725-6047-499c-970b-82a10bd38592 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:46.037425 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8ed93725-6047-499c-970b-82a10bd38592 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:46.037884 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4e830636-681f-4c84-9a9b-ef023b3e83f0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:46.038231 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8ed93725-6047-499c-970b-82a10bd38592 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:46.038674 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8ed93725-6047-499c-970b-82a10bd38592 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:46.038848 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4e830636-681f-4c84-9a9b-ef023b3e83f0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:46.044813 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4e830636-681f-4c84-9a9b-ef023b3e83f0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:46.045269 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4e830636-681f-4c84-9a9b-ef023b3e83f0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:46.046067 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4e830636-681f-4c84-9a9b-ef023b3e83f0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:46.046504 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4e830636-681f-4c84-9a9b-ef023b3e83f0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:46.075632 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4e830636-681f-4c84-9a9b-ef023b3e83f0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041705 Apr 08 11:23:46.076342 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 541/1085] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:46 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:46.100121 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-8ed93725-6047-499c-970b-82a10bd38592 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:46.107509 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-8ed93725-6047-499c-970b-82a10bd38592 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081511 Apr 08 11:23:46.108075 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 545/1086] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:46 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:47.041371 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-df100aa5-ce26-41e8-b457-48b84025779e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:47.042022 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-df100aa5-ce26-41e8-b457-48b84025779e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:47.048571 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-df100aa5-ce26-41e8-b457-48b84025779e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:47.049027 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-df100aa5-ce26-41e8-b457-48b84025779e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:47.049830 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-df100aa5-ce26-41e8-b457-48b84025779e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:47.050157 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-cafce823-c08a-4289-aab4-69da4bc69901 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:47.050575 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-df100aa5-ce26-41e8-b457-48b84025779e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:47.050805 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-cafce823-c08a-4289-aab4-69da4bc69901 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:47.057013 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cafce823-c08a-4289-aab4-69da4bc69901 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:47.057469 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cafce823-c08a-4289-aab4-69da4bc69901 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:47.058261 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cafce823-c08a-4289-aab4-69da4bc69901 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:47.058702 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cafce823-c08a-4289-aab4-69da4bc69901 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:47.247530 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-df100aa5-ce26-41e8-b457-48b84025779e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:47.251638 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-cafce823-c08a-4289-aab4-69da4bc69901 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:47.255289 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-df100aa5-ce26-41e8-b457-48b84025779e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.218392 Apr 08 11:23:47.255868 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 542/1087] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:47 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:47.260041 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-cafce823-c08a-4289-aab4-69da4bc69901 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:47.260711 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-017fde0e-4b05-4659-916a-172685233801 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:47.261545 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-cafce823-c08a-4289-aab4-69da4bc69901 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:47.261689 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-017fde0e-4b05-4659-916a-172685233801 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:47.262743 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-cafce823-c08a-4289-aab4-69da4bc69901 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.216814 Apr 08 11:23:47.267410 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 546/1088] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:47 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:23:47.267568 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-017fde0e-4b05-4659-916a-172685233801 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:47.267989 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-017fde0e-4b05-4659-916a-172685233801 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:47.268777 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-017fde0e-4b05-4659-916a-172685233801 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:47.269229 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-017fde0e-4b05-4659-916a-172685233801 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:47.270931 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-6f7dd852-1dc8-470f-b9f2-3ce60d44e971 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:47.271554 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-6f7dd852-1dc8-470f-b9f2-3ce60d44e971 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:47.277924 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6f7dd852-1dc8-470f-b9f2-3ce60d44e971 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:47.278374 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6f7dd852-1dc8-470f-b9f2-3ce60d44e971 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:47.279143 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6f7dd852-1dc8-470f-b9f2-3ce60d44e971 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:47.279578 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6f7dd852-1dc8-470f-b9f2-3ce60d44e971 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:47.299040 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-017fde0e-4b05-4659-916a-172685233801 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042047 Apr 08 11:23:47.299545 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 543/1089] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:47 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:47.339179 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6f7dd852-1dc8-470f-b9f2-3ce60d44e971 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:47.346464 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-6f7dd852-1dc8-470f-b9f2-3ce60d44e971 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082237 Apr 08 11:23:47.347024 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 547/1090] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:47 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:48.272434 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-722772e3-ae2e-4b38-b94c-0d9a21c7a7bd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:48.273065 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-722772e3-ae2e-4b38-b94c-0d9a21c7a7bd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:48.279405 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-722772e3-ae2e-4b38-b94c-0d9a21c7a7bd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:48.279866 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-722772e3-ae2e-4b38-b94c-0d9a21c7a7bd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:48.280226 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-6ebb3929-f012-4edf-b4e0-8c0122fedadb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:48.280763 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-722772e3-ae2e-4b38-b94c-0d9a21c7a7bd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:48.280872 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-6ebb3929-f012-4edf-b4e0-8c0122fedadb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:48.281212 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-722772e3-ae2e-4b38-b94c-0d9a21c7a7bd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:48.287106 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6ebb3929-f012-4edf-b4e0-8c0122fedadb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:48.287559 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6ebb3929-f012-4edf-b4e0-8c0122fedadb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:48.288846 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6ebb3929-f012-4edf-b4e0-8c0122fedadb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:48.289291 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6ebb3929-f012-4edf-b4e0-8c0122fedadb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:48.480604 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6ebb3929-f012-4edf-b4e0-8c0122fedadb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:48.484406 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-722772e3-ae2e-4b38-b94c-0d9a21c7a7bd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:48.492042 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-722772e3-ae2e-4b38-b94c-0d9a21c7a7bd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.223394 Apr 08 11:23:48.492622 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 544/1091] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:48 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:48.493309 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6ebb3929-f012-4edf-b4e0-8c0122fedadb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:48.495327 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6ebb3929-f012-4edf-b4e0-8c0122fedadb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:48.496853 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-6ebb3929-f012-4edf-b4e0-8c0122fedadb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.220274 Apr 08 11:23:48.498334 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6f295d75-f7f4-44a5-8c4b-1bf19029f250 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:48.498334 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6f295d75-f7f4-44a5-8c4b-1bf19029f250 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:48.498947 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 548/1092] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:48 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:23:48.504117 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2e00ef71-845f-420d-a5d4-5f4606e2917b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:48.504998 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-2e00ef71-845f-420d-a5d4-5f4606e2917b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:48.505200 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6f295d75-f7f4-44a5-8c4b-1bf19029f250 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:48.505732 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6f295d75-f7f4-44a5-8c4b-1bf19029f250 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:48.506714 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6f295d75-f7f4-44a5-8c4b-1bf19029f250 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:48.507020 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6f295d75-f7f4-44a5-8c4b-1bf19029f250 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:48.511229 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2e00ef71-845f-420d-a5d4-5f4606e2917b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:48.511728 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2e00ef71-845f-420d-a5d4-5f4606e2917b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:48.512516 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2e00ef71-845f-420d-a5d4-5f4606e2917b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:48.512954 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2e00ef71-845f-420d-a5d4-5f4606e2917b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:48.536861 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6f295d75-f7f4-44a5-8c4b-1bf19029f250 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043102 Apr 08 11:23:48.537352 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 545/1093] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:48 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:48.579795 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2e00ef71-845f-420d-a5d4-5f4606e2917b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:48.588342 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-2e00ef71-845f-420d-a5d4-5f4606e2917b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.087915 Apr 08 11:23:48.588967 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 549/1094] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:48 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:49.511548 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-dc0a9eaf-b5b4-4d52-8cb4-b622d4ccfe2c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:49.512141 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-dc0a9eaf-b5b4-4d52-8cb4-b622d4ccfe2c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:49.515471 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-246fd28f-b12f-4a87-a584-801082279527 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:49.516210 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-246fd28f-b12f-4a87-a584-801082279527 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:49.518694 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dc0a9eaf-b5b4-4d52-8cb4-b622d4ccfe2c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:49.519139 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dc0a9eaf-b5b4-4d52-8cb4-b622d4ccfe2c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:49.519905 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dc0a9eaf-b5b4-4d52-8cb4-b622d4ccfe2c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:49.520338 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dc0a9eaf-b5b4-4d52-8cb4-b622d4ccfe2c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:49.523589 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-246fd28f-b12f-4a87-a584-801082279527 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:49.524271 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-246fd28f-b12f-4a87-a584-801082279527 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:49.525506 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-246fd28f-b12f-4a87-a584-801082279527 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:49.526190 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-246fd28f-b12f-4a87-a584-801082279527 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:49.717597 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-dc0a9eaf-b5b4-4d52-8cb4-b622d4ccfe2c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:49.724509 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-246fd28f-b12f-4a87-a584-801082279527 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:49.725052 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-dc0a9eaf-b5b4-4d52-8cb4-b622d4ccfe2c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.218052 Apr 08 11:23:49.726164 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 546/1095] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:49 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:49.730805 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f1679aef-655e-425e-98c0-694f178d37b6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:49.731727 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f1679aef-655e-425e-98c0-694f178d37b6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:49.733520 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-246fd28f-b12f-4a87-a584-801082279527 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:49.735049 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-246fd28f-b12f-4a87-a584-801082279527 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:49.736206 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-246fd28f-b12f-4a87-a584-801082279527 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.225390 Apr 08 11:23:49.736972 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 550/1096] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:49 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:23:49.737440 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f1679aef-655e-425e-98c0-694f178d37b6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:49.737898 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f1679aef-655e-425e-98c0-694f178d37b6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:49.738688 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f1679aef-655e-425e-98c0-694f178d37b6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:49.739128 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f1679aef-655e-425e-98c0-694f178d37b6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:49.746650 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-62e61e3e-6e66-4993-acf8-771677c1a427 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:49.747260 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-62e61e3e-6e66-4993-acf8-771677c1a427 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:49.752946 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-62e61e3e-6e66-4993-acf8-771677c1a427 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:49.753619 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-62e61e3e-6e66-4993-acf8-771677c1a427 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:49.754429 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-62e61e3e-6e66-4993-acf8-771677c1a427 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:49.754869 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-62e61e3e-6e66-4993-acf8-771677c1a427 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:49.769187 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f1679aef-655e-425e-98c0-694f178d37b6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041829 Apr 08 11:23:49.769593 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 547/1097] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:49 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:49.814650 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-62e61e3e-6e66-4993-acf8-771677c1a427 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:49.822105 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-62e61e3e-6e66-4993-acf8-771677c1a427 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079314 Apr 08 11:23:49.822673 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 551/1098] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:49 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:50.743870 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6606beb0-993b-44b9-9cb0-575949efa8cd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:50.744516 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6606beb0-993b-44b9-9cb0-575949efa8cd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:50.751285 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6606beb0-993b-44b9-9cb0-575949efa8cd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:50.751738 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6606beb0-993b-44b9-9cb0-575949efa8cd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:50.752527 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6606beb0-993b-44b9-9cb0-575949efa8cd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:50.752970 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6606beb0-993b-44b9-9cb0-575949efa8cd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:50.755460 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-1b19e7ad-17f8-4845-b49a-898a868784dc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:50.756240 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-1b19e7ad-17f8-4845-b49a-898a868784dc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:50.762379 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1b19e7ad-17f8-4845-b49a-898a868784dc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:50.762824 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1b19e7ad-17f8-4845-b49a-898a868784dc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:50.763608 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1b19e7ad-17f8-4845-b49a-898a868784dc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:50.764051 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1b19e7ad-17f8-4845-b49a-898a868784dc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:50.971485 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6606beb0-993b-44b9-9cb0-575949efa8cd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:50.973655 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1b19e7ad-17f8-4845-b49a-898a868784dc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:50.979260 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6606beb0-993b-44b9-9cb0-575949efa8cd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.240238 Apr 08 11:23:50.980634 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 548/1099] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:50 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:23:50.984314 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1b19e7ad-17f8-4845-b49a-898a868784dc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:50.985172 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-388f5d69-806d-456e-92a1-2b8bc229eba4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:50.986024 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1b19e7ad-17f8-4845-b49a-898a868784dc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:50.986175 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-388f5d69-806d-456e-92a1-2b8bc229eba4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:50.987356 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-1b19e7ad-17f8-4845-b49a-898a868784dc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.236105 Apr 08 11:23:50.988170 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 552/1100] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:50 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:23:50.992131 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-388f5d69-806d-456e-92a1-2b8bc229eba4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:50.992577 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-388f5d69-806d-456e-92a1-2b8bc229eba4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:50.993667 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-388f5d69-806d-456e-92a1-2b8bc229eba4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:50.994077 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-388f5d69-806d-456e-92a1-2b8bc229eba4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:50.997118 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-6d6435f4-9511-4448-af76-2996ad0d3e45 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:50.998737 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-6d6435f4-9511-4448-af76-2996ad0d3e45 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:51.003477 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6d6435f4-9511-4448-af76-2996ad0d3e45 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:51.003933 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6d6435f4-9511-4448-af76-2996ad0d3e45 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:51.004719 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6d6435f4-9511-4448-af76-2996ad0d3e45 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:51.005160 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6d6435f4-9511-4448-af76-2996ad0d3e45 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:51.023687 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-388f5d69-806d-456e-92a1-2b8bc229eba4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042158 Apr 08 11:23:51.024252 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 549/1101] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:50 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:51.071169 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6d6435f4-9511-4448-af76-2996ad0d3e45 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:51.078516 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-6d6435f4-9511-4448-af76-2996ad0d3e45 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.085307 Apr 08 11:23:51.079089 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 553/1102] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:50 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:51.997943 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-32b5151b-7a30-4327-b968-72cab6cb0d06 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:51.998504 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-32b5151b-7a30-4327-b968-72cab6cb0d06 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:52.005307 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-f20a6a09-324a-4c3e-9293-ba1e89e026b4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:52.005912 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-32b5151b-7a30-4327-b968-72cab6cb0d06 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:52.006030 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-f20a6a09-324a-4c3e-9293-ba1e89e026b4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:52.006131 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-32b5151b-7a30-4327-b968-72cab6cb0d06 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:52.007469 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-32b5151b-7a30-4327-b968-72cab6cb0d06 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:52.007917 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-32b5151b-7a30-4327-b968-72cab6cb0d06 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:52.013630 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f20a6a09-324a-4c3e-9293-ba1e89e026b4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:52.014122 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f20a6a09-324a-4c3e-9293-ba1e89e026b4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:52.014913 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f20a6a09-324a-4c3e-9293-ba1e89e026b4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:52.015355 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f20a6a09-324a-4c3e-9293-ba1e89e026b4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:52.213889 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-32b5151b-7a30-4327-b968-72cab6cb0d06 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:52.216898 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f20a6a09-324a-4c3e-9293-ba1e89e026b4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:52.221406 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-32b5151b-7a30-4327-b968-72cab6cb0d06 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.227430 Apr 08 11:23:52.222172 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 550/1103] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:51 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:52.225686 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f20a6a09-324a-4c3e-9293-ba1e89e026b4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:52.226734 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f2040647-45c1-4525-b2c6-43427b766ea8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:52.227229 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f20a6a09-324a-4c3e-9293-ba1e89e026b4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:52.228799 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f2040647-45c1-4525-b2c6-43427b766ea8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:52.228918 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-f20a6a09-324a-4c3e-9293-ba1e89e026b4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.227023 Apr 08 11:23:52.239868 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 554/1104] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:52 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:23:52.239868 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-f079925b-1e8a-4861-bdee-ddfee22935bf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:52.240225 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f2040647-45c1-4525-b2c6-43427b766ea8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:52.240225 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f2040647-45c1-4525-b2c6-43427b766ea8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:52.240415 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-f079925b-1e8a-4861-bdee-ddfee22935bf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:52.240517 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f2040647-45c1-4525-b2c6-43427b766ea8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:52.240517 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f2040647-45c1-4525-b2c6-43427b766ea8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:52.242671 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f079925b-1e8a-4861-bdee-ddfee22935bf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:52.243135 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f079925b-1e8a-4861-bdee-ddfee22935bf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:52.244192 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f079925b-1e8a-4861-bdee-ddfee22935bf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:52.244634 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f079925b-1e8a-4861-bdee-ddfee22935bf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:52.266712 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f2040647-45c1-4525-b2c6-43427b766ea8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043499 Apr 08 11:23:52.267273 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 551/1105] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:52 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:52.305352 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f079925b-1e8a-4861-bdee-ddfee22935bf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:52.312835 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-f079925b-1e8a-4861-bdee-ddfee22935bf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082520 Apr 08 11:23:52.313435 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 555/1106] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:52 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:53.239745 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ac997be2-cd04-49dc-bb8c-9ae82be39ce7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:53.240621 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ac997be2-cd04-49dc-bb8c-9ae82be39ce7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:53.253042 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ac997be2-cd04-49dc-bb8c-9ae82be39ce7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:53.257126 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-ad99d74e-b7d0-4d12-8d9f-ac5700583d31 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:53.258197 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ac997be2-cd04-49dc-bb8c-9ae82be39ce7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:53.258315 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-ad99d74e-b7d0-4d12-8d9f-ac5700583d31 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:53.258419 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ac997be2-cd04-49dc-bb8c-9ae82be39ce7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:53.258419 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ac997be2-cd04-49dc-bb8c-9ae82be39ce7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:53.258605 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ad99d74e-b7d0-4d12-8d9f-ac5700583d31 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:53.258605 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ad99d74e-b7d0-4d12-8d9f-ac5700583d31 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:53.259568 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ad99d74e-b7d0-4d12-8d9f-ac5700583d31 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:53.260182 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ad99d74e-b7d0-4d12-8d9f-ac5700583d31 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:53.460326 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ac997be2-cd04-49dc-bb8c-9ae82be39ce7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:53.467016 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-ad99d74e-b7d0-4d12-8d9f-ac5700583d31 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:53.467858 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ac997be2-cd04-49dc-bb8c-9ae82be39ce7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.233365 Apr 08 11:23:53.468446 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 552/1107] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:53 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:53.473055 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7356848f-68ca-45e2-a72c-ea232eca6f99 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:53.474002 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7356848f-68ca-45e2-a72c-ea232eca6f99 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:53.476914 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-ad99d74e-b7d0-4d12-8d9f-ac5700583d31 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:53.478788 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-ad99d74e-b7d0-4d12-8d9f-ac5700583d31 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:53.484547 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-ad99d74e-b7d0-4d12-8d9f-ac5700583d31 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.235169 Apr 08 11:23:53.484854 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7356848f-68ca-45e2-a72c-ea232eca6f99 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:53.484971 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 556/1108] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:53 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:23:53.485058 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7356848f-68ca-45e2-a72c-ea232eca6f99 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:53.485058 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7356848f-68ca-45e2-a72c-ea232eca6f99 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:53.485058 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7356848f-68ca-45e2-a72c-ea232eca6f99 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:53.485307 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-4464dbdd-25fb-401b-81d0-11dd85bc4acc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:53.486972 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-4464dbdd-25fb-401b-81d0-11dd85bc4acc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:53.491899 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4464dbdd-25fb-401b-81d0-11dd85bc4acc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:53.492387 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4464dbdd-25fb-401b-81d0-11dd85bc4acc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:53.493150 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4464dbdd-25fb-401b-81d0-11dd85bc4acc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:53.493892 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4464dbdd-25fb-401b-81d0-11dd85bc4acc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:53.512653 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7356848f-68ca-45e2-a72c-ea232eca6f99 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043171 Apr 08 11:23:53.513224 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 553/1109] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:53 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:53.552296 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-4464dbdd-25fb-401b-81d0-11dd85bc4acc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:53.560315 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-4464dbdd-25fb-401b-81d0-11dd85bc4acc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078841 Apr 08 11:23:53.560882 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 557/1110] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:53 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:54.485070 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9cc95b1a-9868-4a04-a043-96f9cf25abf4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:54.485668 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9cc95b1a-9868-4a04-a043-96f9cf25abf4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:54.492028 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9cc95b1a-9868-4a04-a043-96f9cf25abf4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:54.492486 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9cc95b1a-9868-4a04-a043-96f9cf25abf4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:54.493524 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9cc95b1a-9868-4a04-a043-96f9cf25abf4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:54.494002 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9cc95b1a-9868-4a04-a043-96f9cf25abf4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:54.501735 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-3b994ecd-b0da-47cf-95ee-6b0e3a32bb24 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:54.502373 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-3b994ecd-b0da-47cf-95ee-6b0e3a32bb24 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:54.508616 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3b994ecd-b0da-47cf-95ee-6b0e3a32bb24 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:54.509067 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3b994ecd-b0da-47cf-95ee-6b0e3a32bb24 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:54.509866 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3b994ecd-b0da-47cf-95ee-6b0e3a32bb24 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:54.510305 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3b994ecd-b0da-47cf-95ee-6b0e3a32bb24 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:54.720461 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9cc95b1a-9868-4a04-a043-96f9cf25abf4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:54.728885 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9cc95b1a-9868-4a04-a043-96f9cf25abf4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.247589 Apr 08 11:23:54.729414 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-3b994ecd-b0da-47cf-95ee-6b0e3a32bb24 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:54.729973 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 554/1111] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:54 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:54.734943 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-01d4aac3-8f5f-4502-94e2-e8264cea6378 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:54.735976 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-01d4aac3-8f5f-4502-94e2-e8264cea6378 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:54.739166 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-3b994ecd-b0da-47cf-95ee-6b0e3a32bb24 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:54.740808 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-3b994ecd-b0da-47cf-95ee-6b0e3a32bb24 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:54.742050 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-01d4aac3-8f5f-4502-94e2-e8264cea6378 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:54.742199 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-3b994ecd-b0da-47cf-95ee-6b0e3a32bb24 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.244215 Apr 08 11:23:54.742512 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-01d4aac3-8f5f-4502-94e2-e8264cea6378 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:54.743584 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-01d4aac3-8f5f-4502-94e2-e8264cea6378 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:54.744030 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-01d4aac3-8f5f-4502-94e2-e8264cea6378 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:54.745939 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 558/1112] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:54 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:23:54.751074 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-7fbbb654-1dc6-48a5-9720-99791cd7d443 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:54.751697 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-7fbbb654-1dc6-48a5-9720-99791cd7d443 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:54.758066 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7fbbb654-1dc6-48a5-9720-99791cd7d443 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:54.758525 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7fbbb654-1dc6-48a5-9720-99791cd7d443 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:54.759320 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7fbbb654-1dc6-48a5-9720-99791cd7d443 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:54.759764 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7fbbb654-1dc6-48a5-9720-99791cd7d443 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:54.775854 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-01d4aac3-8f5f-4502-94e2-e8264cea6378 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044711 Apr 08 11:23:54.776441 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 555/1113] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:54 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:54.827152 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-7fbbb654-1dc6-48a5-9720-99791cd7d443 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:54.835239 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-7fbbb654-1dc6-48a5-9720-99791cd7d443 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.087379 Apr 08 11:23:54.835811 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 559/1114] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:54 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:55.747536 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e2fbc7e9-03da-44e4-8ef9-ea12db829d20 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:55.748167 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e2fbc7e9-03da-44e4-8ef9-ea12db829d20 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:55.754637 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e2fbc7e9-03da-44e4-8ef9-ea12db829d20 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:55.755196 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e2fbc7e9-03da-44e4-8ef9-ea12db829d20 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:55.755998 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e2fbc7e9-03da-44e4-8ef9-ea12db829d20 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:55.756442 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e2fbc7e9-03da-44e4-8ef9-ea12db829d20 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:55.760566 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-d26be2df-cb9c-4912-adc7-154584d26081 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:55.761203 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-d26be2df-cb9c-4912-adc7-154584d26081 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:55.767503 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d26be2df-cb9c-4912-adc7-154584d26081 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:55.767954 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d26be2df-cb9c-4912-adc7-154584d26081 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:55.768728 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d26be2df-cb9c-4912-adc7-154584d26081 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:55.769163 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d26be2df-cb9c-4912-adc7-154584d26081 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:55.962518 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e2fbc7e9-03da-44e4-8ef9-ea12db829d20 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:55.970056 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e2fbc7e9-03da-44e4-8ef9-ea12db829d20 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.226518 Apr 08 11:23:55.970401 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d26be2df-cb9c-4912-adc7-154584d26081 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:55.970932 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 556/1115] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:55 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:55.976139 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-50481503-fd5c-460f-8386-cfd3d331e7bd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:55.977063 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-50481503-fd5c-460f-8386-cfd3d331e7bd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:55.979963 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d26be2df-cb9c-4912-adc7-154584d26081 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:55.981584 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d26be2df-cb9c-4912-adc7-154584d26081 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:55.982854 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-50481503-fd5c-460f-8386-cfd3d331e7bd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:55.983037 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-d26be2df-cb9c-4912-adc7-154584d26081 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.226383 Apr 08 11:23:55.983308 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-50481503-fd5c-460f-8386-cfd3d331e7bd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:55.986915 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 560/1116] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:55 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:23:55.987087 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-50481503-fd5c-460f-8386-cfd3d331e7bd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:55.987087 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-50481503-fd5c-460f-8386-cfd3d331e7bd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:55.988321 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e5c40781-ed13-46c3-94ae-41a959c5e772 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:55.992892 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e5c40781-ed13-46c3-94ae-41a959c5e772 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:55.995281 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e5c40781-ed13-46c3-94ae-41a959c5e772 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:55.995733 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e5c40781-ed13-46c3-94ae-41a959c5e772 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:55.996515 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e5c40781-ed13-46c3-94ae-41a959c5e772 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:55.996956 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e5c40781-ed13-46c3-94ae-41a959c5e772 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:56.027424 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-50481503-fd5c-460f-8386-cfd3d331e7bd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055410 Apr 08 11:23:56.027995 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 557/1117] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:55 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:56.058590 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e5c40781-ed13-46c3-94ae-41a959c5e772 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:56.066224 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e5c40781-ed13-46c3-94ae-41a959c5e772 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081494 Apr 08 11:23:56.066808 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 561/1118] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:55 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:56.987753 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8214a6ee-93ea-40f7-ac9a-3b9a9ed16f9e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:56.988320 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8214a6ee-93ea-40f7-ac9a-3b9a9ed16f9e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:56.995267 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8214a6ee-93ea-40f7-ac9a-3b9a9ed16f9e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:56.995722 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8214a6ee-93ea-40f7-ac9a-3b9a9ed16f9e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:56.996504 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8214a6ee-93ea-40f7-ac9a-3b9a9ed16f9e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:56.996953 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8214a6ee-93ea-40f7-ac9a-3b9a9ed16f9e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:57.000241 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-cf0408cb-3382-42c4-bc94-55e9a1d14a35 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:57.000861 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-cf0408cb-3382-42c4-bc94-55e9a1d14a35 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:57.007787 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cf0408cb-3382-42c4-bc94-55e9a1d14a35 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:57.008246 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cf0408cb-3382-42c4-bc94-55e9a1d14a35 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:57.009033 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cf0408cb-3382-42c4-bc94-55e9a1d14a35 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:57.009478 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cf0408cb-3382-42c4-bc94-55e9a1d14a35 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:57.207614 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8214a6ee-93ea-40f7-ac9a-3b9a9ed16f9e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:57.210946 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-cf0408cb-3382-42c4-bc94-55e9a1d14a35 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:57.215804 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8214a6ee-93ea-40f7-ac9a-3b9a9ed16f9e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.231865 Apr 08 11:23:57.216480 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 558/1119] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:56 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:57.219533 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-cf0408cb-3382-42c4-bc94-55e9a1d14a35 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:57.221082 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-cf0408cb-3382-42c4-bc94-55e9a1d14a35 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:57.221593 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9b74df5d-58f3-427f-a0a6-0608998e11ca tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:57.222272 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-cf0408cb-3382-42c4-bc94-55e9a1d14a35 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.225866 Apr 08 11:23:57.222559 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9b74df5d-58f3-427f-a0a6-0608998e11ca tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:57.223087 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 562/1120] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:56 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:23:57.231028 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-ca8474ae-c4f7-41a8-876e-800afce1c034 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:57.231900 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9b74df5d-58f3-427f-a0a6-0608998e11ca tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:57.232041 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-ca8474ae-c4f7-41a8-876e-800afce1c034 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:57.232668 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9b74df5d-58f3-427f-a0a6-0608998e11ca tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:57.233906 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9b74df5d-58f3-427f-a0a6-0608998e11ca tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:57.237318 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9b74df5d-58f3-427f-a0a6-0608998e11ca tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:57.239719 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ca8474ae-c4f7-41a8-876e-800afce1c034 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:57.240176 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ca8474ae-c4f7-41a8-876e-800afce1c034 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:57.241698 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ca8474ae-c4f7-41a8-876e-800afce1c034 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:57.242260 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ca8474ae-c4f7-41a8-876e-800afce1c034 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:57.277037 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9b74df5d-58f3-427f-a0a6-0608998e11ca tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059256 Apr 08 11:23:57.277632 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 559/1121] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:57 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:57.314947 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-ca8474ae-c4f7-41a8-876e-800afce1c034 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:57.323169 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-ca8474ae-c4f7-41a8-876e-800afce1c034 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.098082 Apr 08 11:23:57.323755 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 563/1122] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:57 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:58.234196 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a58d2585-40f8-4b93-9f32-d56857433b24 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:58.234982 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a58d2585-40f8-4b93-9f32-d56857433b24 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:58.241959 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a58d2585-40f8-4b93-9f32-d56857433b24 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:58.242380 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-c292f5ae-50cc-42b6-be00-4a4c8dc118cc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:58.242978 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a58d2585-40f8-4b93-9f32-d56857433b24 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:58.243438 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-c292f5ae-50cc-42b6-be00-4a4c8dc118cc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:58.243603 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a58d2585-40f8-4b93-9f32-d56857433b24 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:58.243878 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a58d2585-40f8-4b93-9f32-d56857433b24 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:58.250242 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c292f5ae-50cc-42b6-be00-4a4c8dc118cc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:58.250680 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c292f5ae-50cc-42b6-be00-4a4c8dc118cc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:58.251463 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c292f5ae-50cc-42b6-be00-4a4c8dc118cc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:58.251891 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c292f5ae-50cc-42b6-be00-4a4c8dc118cc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:58.459216 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a58d2585-40f8-4b93-9f32-d56857433b24 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:58.462464 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-c292f5ae-50cc-42b6-be00-4a4c8dc118cc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:58.466771 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a58d2585-40f8-4b93-9f32-d56857433b24 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.236413 Apr 08 11:23:58.467356 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 560/1123] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:58 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:58.471102 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-c292f5ae-50cc-42b6-be00-4a4c8dc118cc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:58.472120 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-45fb2ea3-d5e6-4a1d-970e-978fc2389c1c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:58.472596 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-c292f5ae-50cc-42b6-be00-4a4c8dc118cc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:58.473075 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-45fb2ea3-d5e6-4a1d-970e-978fc2389c1c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:58.473744 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-c292f5ae-50cc-42b6-be00-4a4c8dc118cc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.236940 Apr 08 11:23:58.476210 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 564/1124] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:58 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:23:58.478892 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-45fb2ea3-d5e6-4a1d-970e-978fc2389c1c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:58.479058 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a471d490-d84a-42c5-9ce1-40d3a282e692 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:58.479351 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-45fb2ea3-d5e6-4a1d-970e-978fc2389c1c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:58.479512 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a471d490-d84a-42c5-9ce1-40d3a282e692 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:58.480129 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-45fb2ea3-d5e6-4a1d-970e-978fc2389c1c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:58.480576 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-45fb2ea3-d5e6-4a1d-970e-978fc2389c1c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:58.485386 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a471d490-d84a-42c5-9ce1-40d3a282e692 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:58.485800 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a471d490-d84a-42c5-9ce1-40d3a282e692 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:58.486572 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a471d490-d84a-42c5-9ce1-40d3a282e692 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:58.487007 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a471d490-d84a-42c5-9ce1-40d3a282e692 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:58.510631 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-45fb2ea3-d5e6-4a1d-970e-978fc2389c1c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042139 Apr 08 11:23:58.511201 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 561/1125] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:58 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:58.549128 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a471d490-d84a-42c5-9ce1-40d3a282e692 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:58.557120 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a471d490-d84a-42c5-9ce1-40d3a282e692 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081882 Apr 08 11:23:58.557689 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 565/1126] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:58 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:59.483794 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d4c8c6b4-09cc-489e-ada5-e9f0311e58fd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:59.484412 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d4c8c6b4-09cc-489e-ada5-e9f0311e58fd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:59.490998 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d4c8c6b4-09cc-489e-ada5-e9f0311e58fd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:59.491454 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d4c8c6b4-09cc-489e-ada5-e9f0311e58fd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:59.492239 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d4c8c6b4-09cc-489e-ada5-e9f0311e58fd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:59.492359 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-9eddc359-610a-42e1-96a1-983063f309a6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:59.492787 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d4c8c6b4-09cc-489e-ada5-e9f0311e58fd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:59.492891 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-9eddc359-610a-42e1-96a1-983063f309a6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:59.499367 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9eddc359-610a-42e1-96a1-983063f309a6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:59.499837 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9eddc359-610a-42e1-96a1-983063f309a6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:59.500598 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9eddc359-610a-42e1-96a1-983063f309a6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:59.501033 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9eddc359-610a-42e1-96a1-983063f309a6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:59.697825 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d4c8c6b4-09cc-489e-ada5-e9f0311e58fd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:59.702077 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-9eddc359-610a-42e1-96a1-983063f309a6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:59.706691 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d4c8c6b4-09cc-489e-ada5-e9f0311e58fd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.226455 Apr 08 11:23:59.707292 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 562/1127] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:59 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:23:59.712982 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2fa905bd-609b-484e-b051-999a574b7eea tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:59.714517 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2fa905bd-609b-484e-b051-999a574b7eea tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:59.718727 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-9eddc359-610a-42e1-96a1-983063f309a6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:59.722591 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2fa905bd-609b-484e-b051-999a574b7eea tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:59.722811 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-9eddc359-610a-42e1-96a1-983063f309a6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:59.723058 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2fa905bd-609b-484e-b051-999a574b7eea tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:59.723864 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2fa905bd-609b-484e-b051-999a574b7eea tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:59.724199 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-9eddc359-610a-42e1-96a1-983063f309a6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.235863 Apr 08 11:23:59.724323 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2fa905bd-609b-484e-b051-999a574b7eea tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:59.728827 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 566/1128] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:23:59 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:23:59.745027 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2a8dee4b-5d69-4eef-9394-7730bffe9c06 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:23:59.745027 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-2a8dee4b-5d69-4eef-9394-7730bffe9c06 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:23:59.745027 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2a8dee4b-5d69-4eef-9394-7730bffe9c06 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:59.745027 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2a8dee4b-5d69-4eef-9394-7730bffe9c06 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:59.745425 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2a8dee4b-5d69-4eef-9394-7730bffe9c06 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:23:59.745425 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2a8dee4b-5d69-4eef-9394-7730bffe9c06 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:23:59.758133 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2fa905bd-609b-484e-b051-999a574b7eea tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049521 Apr 08 11:23:59.758922 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 563/1129] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:23:59 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:23:59.811608 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2a8dee4b-5d69-4eef-9394-7730bffe9c06 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:23:59.822598 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-2a8dee4b-5d69-4eef-9394-7730bffe9c06 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.093974 Apr 08 11:23:59.823196 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 567/1130] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:23:59 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:00.724470 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d01b9a24-e412-4c87-9f18-b47c51b8c08d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:00.725654 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d01b9a24-e412-4c87-9f18-b47c51b8c08d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:00.733206 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d01b9a24-e412-4c87-9f18-b47c51b8c08d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:00.733671 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d01b9a24-e412-4c87-9f18-b47c51b8c08d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:00.734489 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d01b9a24-e412-4c87-9f18-b47c51b8c08d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:00.734930 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d01b9a24-e412-4c87-9f18-b47c51b8c08d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:00.752537 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-1f0c61ec-0752-48a7-9f70-50c12955ff02 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:00.753257 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-1f0c61ec-0752-48a7-9f70-50c12955ff02 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:00.759531 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1f0c61ec-0752-48a7-9f70-50c12955ff02 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:00.759989 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1f0c61ec-0752-48a7-9f70-50c12955ff02 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:00.760769 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1f0c61ec-0752-48a7-9f70-50c12955ff02 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:00.761212 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1f0c61ec-0752-48a7-9f70-50c12955ff02 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:00.926968 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d01b9a24-e412-4c87-9f18-b47c51b8c08d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:00.934652 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d01b9a24-e412-4c87-9f18-b47c51b8c08d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.213996 Apr 08 11:24:00.935243 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 564/1131] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:00 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:00.940079 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-76014db2-4f62-49e7-9cbb-2da2355ab9bb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:00.941205 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-76014db2-4f62-49e7-9cbb-2da2355ab9bb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:00.947900 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-76014db2-4f62-49e7-9cbb-2da2355ab9bb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:00.948414 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-76014db2-4f62-49e7-9cbb-2da2355ab9bb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:00.949189 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-76014db2-4f62-49e7-9cbb-2da2355ab9bb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:00.949628 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-76014db2-4f62-49e7-9cbb-2da2355ab9bb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:00.954118 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1f0c61ec-0752-48a7-9f70-50c12955ff02 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:00.963504 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1f0c61ec-0752-48a7-9f70-50c12955ff02 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:00.965020 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1f0c61ec-0752-48a7-9f70-50c12955ff02 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:00.966282 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-1f0c61ec-0752-48a7-9f70-50c12955ff02 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.217714 Apr 08 11:24:00.969085 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 568/1132] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:00 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:24:00.973989 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-f298763e-8f86-48f2-8f29-f80ad092f09e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:00.974599 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-f298763e-8f86-48f2-8f29-f80ad092f09e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:00.980681 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f298763e-8f86-48f2-8f29-f80ad092f09e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:00.980870 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-76014db2-4f62-49e7-9cbb-2da2355ab9bb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044554 Apr 08 11:24:00.981294 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f298763e-8f86-48f2-8f29-f80ad092f09e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:00.981452 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 565/1133] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:00 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:00.982250 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f298763e-8f86-48f2-8f29-f80ad092f09e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:00.982696 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f298763e-8f86-48f2-8f29-f80ad092f09e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:01.049108 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f298763e-8f86-48f2-8f29-f80ad092f09e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:01.056581 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-f298763e-8f86-48f2-8f29-f80ad092f09e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.086496 Apr 08 11:24:01.057157 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 569/1134] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:00 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:01.951842 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9004ad27-bd1c-4837-a5f3-c1da7118d53a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:01.952440 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9004ad27-bd1c-4837-a5f3-c1da7118d53a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:01.958800 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9004ad27-bd1c-4837-a5f3-c1da7118d53a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:01.959766 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9004ad27-bd1c-4837-a5f3-c1da7118d53a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:01.960550 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9004ad27-bd1c-4837-a5f3-c1da7118d53a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:01.960993 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9004ad27-bd1c-4837-a5f3-c1da7118d53a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:01.984686 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-603e175f-516b-4d7d-82d2-7d10a7d780cc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:01.985300 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-603e175f-516b-4d7d-82d2-7d10a7d780cc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:01.995154 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-603e175f-516b-4d7d-82d2-7d10a7d780cc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:01.995606 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-603e175f-516b-4d7d-82d2-7d10a7d780cc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:01.996394 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-603e175f-516b-4d7d-82d2-7d10a7d780cc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:01.996935 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-603e175f-516b-4d7d-82d2-7d10a7d780cc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:02.159452 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9004ad27-bd1c-4837-a5f3-c1da7118d53a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:02.167680 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9004ad27-bd1c-4837-a5f3-c1da7118d53a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.219912 Apr 08 11:24:02.168369 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 566/1135] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:01 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:02.173264 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4f60b210-6cad-4b9b-80be-77ce7ad939ff tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:02.174361 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4f60b210-6cad-4b9b-80be-77ce7ad939ff tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:02.180452 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4f60b210-6cad-4b9b-80be-77ce7ad939ff tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:02.180912 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4f60b210-6cad-4b9b-80be-77ce7ad939ff tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:02.181707 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4f60b210-6cad-4b9b-80be-77ce7ad939ff tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:02.182177 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4f60b210-6cad-4b9b-80be-77ce7ad939ff tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:02.187550 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-603e175f-516b-4d7d-82d2-7d10a7d780cc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:02.196430 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-603e175f-516b-4d7d-82d2-7d10a7d780cc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:02.197968 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-603e175f-516b-4d7d-82d2-7d10a7d780cc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:02.199173 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-603e175f-516b-4d7d-82d2-7d10a7d780cc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.218752 Apr 08 11:24:02.199737 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 570/1136] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:01 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:24:02.204375 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-bc614423-3754-42f6-99f4-b9f655edfc25 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:02.204955 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-bc614423-3754-42f6-99f4-b9f655edfc25 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:02.211809 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bc614423-3754-42f6-99f4-b9f655edfc25 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:02.212271 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bc614423-3754-42f6-99f4-b9f655edfc25 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:02.212916 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4f60b210-6cad-4b9b-80be-77ce7ad939ff tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043422 Apr 08 11:24:02.213397 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bc614423-3754-42f6-99f4-b9f655edfc25 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:02.213509 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 567/1137] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:02 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:02.214043 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bc614423-3754-42f6-99f4-b9f655edfc25 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:02.280773 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-bc614423-3754-42f6-99f4-b9f655edfc25 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:02.288876 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-bc614423-3754-42f6-99f4-b9f655edfc25 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.088161 Apr 08 11:24:02.289449 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 571/1138] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:02 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:03.185442 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b753d20f-601a-40cf-a69c-5546f4e94431 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:03.186111 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b753d20f-601a-40cf-a69c-5546f4e94431 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:03.192154 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b753d20f-601a-40cf-a69c-5546f4e94431 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:03.192606 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b753d20f-601a-40cf-a69c-5546f4e94431 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:03.193391 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b753d20f-601a-40cf-a69c-5546f4e94431 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:03.193848 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b753d20f-601a-40cf-a69c-5546f4e94431 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:03.218924 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2b8159ef-9b0b-473a-ad10-3e539c1f9b82 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:03.219477 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-2b8159ef-9b0b-473a-ad10-3e539c1f9b82 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:03.226646 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2b8159ef-9b0b-473a-ad10-3e539c1f9b82 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:03.227095 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2b8159ef-9b0b-473a-ad10-3e539c1f9b82 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:03.227875 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2b8159ef-9b0b-473a-ad10-3e539c1f9b82 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:03.228306 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2b8159ef-9b0b-473a-ad10-3e539c1f9b82 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:03.410513 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b753d20f-601a-40cf-a69c-5546f4e94431 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:03.419172 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b753d20f-601a-40cf-a69c-5546f4e94431 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.237622 Apr 08 11:24:03.419416 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 568/1139] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:03 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:24:03.426865 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2b8159ef-9b0b-473a-ad10-3e539c1f9b82 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:03.428389 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-720a393b-2e6e-4ae5-b041-531d63693fda tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:03.429408 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-720a393b-2e6e-4ae5-b041-531d63693fda tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:03.435791 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-720a393b-2e6e-4ae5-b041-531d63693fda tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:03.436132 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-720a393b-2e6e-4ae5-b041-531d63693fda tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:03.436312 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2b8159ef-9b0b-473a-ad10-3e539c1f9b82 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:03.436944 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-720a393b-2e6e-4ae5-b041-531d63693fda tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:03.437413 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-720a393b-2e6e-4ae5-b041-531d63693fda tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:03.437848 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2b8159ef-9b0b-473a-ad10-3e539c1f9b82 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:03.439021 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-2b8159ef-9b0b-473a-ad10-3e539c1f9b82 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.224434 Apr 08 11:24:03.439589 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 572/1140] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:03 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:24:03.444334 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-bbefca8f-bb13-4762-b01a-2cd7f9d2239a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:03.444946 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-bbefca8f-bb13-4762-b01a-2cd7f9d2239a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:03.451144 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bbefca8f-bb13-4762-b01a-2cd7f9d2239a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:03.451602 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bbefca8f-bb13-4762-b01a-2cd7f9d2239a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:03.452395 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bbefca8f-bb13-4762-b01a-2cd7f9d2239a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:03.452829 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bbefca8f-bb13-4762-b01a-2cd7f9d2239a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:03.469169 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-720a393b-2e6e-4ae5-b041-531d63693fda tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048748 Apr 08 11:24:03.469744 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 569/1141] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:03 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:03.522665 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-bbefca8f-bb13-4762-b01a-2cd7f9d2239a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:03.530899 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-bbefca8f-bb13-4762-b01a-2cd7f9d2239a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.090199 Apr 08 11:24:03.532515 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 573/1142] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:03 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:04.437218 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ca41289b-f39d-41a6-862b-61f7d41c51fa tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:04.438038 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ca41289b-f39d-41a6-862b-61f7d41c51fa tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:04.444616 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ca41289b-f39d-41a6-862b-61f7d41c51fa tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:04.445064 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ca41289b-f39d-41a6-862b-61f7d41c51fa tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:04.445922 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ca41289b-f39d-41a6-862b-61f7d41c51fa tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:04.446374 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ca41289b-f39d-41a6-862b-61f7d41c51fa tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:04.456472 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-b4a22237-a574-4c82-a41c-6e4520161d0d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:04.457137 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-b4a22237-a574-4c82-a41c-6e4520161d0d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:04.463747 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b4a22237-a574-4c82-a41c-6e4520161d0d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:04.464204 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b4a22237-a574-4c82-a41c-6e4520161d0d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:04.464982 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b4a22237-a574-4c82-a41c-6e4520161d0d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:04.465417 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b4a22237-a574-4c82-a41c-6e4520161d0d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:04.659586 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ca41289b-f39d-41a6-862b-61f7d41c51fa tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:04.668168 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ca41289b-f39d-41a6-862b-61f7d41c51fa tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.235402 Apr 08 11:24:04.668682 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b4a22237-a574-4c82-a41c-6e4520161d0d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:04.669338 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 570/1143] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:04 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:04.674323 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e353e5e9-ce2d-455e-9893-244468424eda tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:04.675372 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e353e5e9-ce2d-455e-9893-244468424eda tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:04.679607 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b4a22237-a574-4c82-a41c-6e4520161d0d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:04.681378 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b4a22237-a574-4c82-a41c-6e4520161d0d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:04.682908 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-b4a22237-a574-4c82-a41c-6e4520161d0d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.230150 Apr 08 11:24:04.683386 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 574/1144] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:04 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:24:04.685196 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e353e5e9-ce2d-455e-9893-244468424eda tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:04.685666 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e353e5e9-ce2d-455e-9893-244468424eda tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:04.686525 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e353e5e9-ce2d-455e-9893-244468424eda tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:04.686976 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e353e5e9-ce2d-455e-9893-244468424eda tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:04.688381 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-bbbac594-20f4-45cd-8eb8-684a0e43c2e8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:04.688951 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-bbbac594-20f4-45cd-8eb8-684a0e43c2e8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:04.696022 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bbbac594-20f4-45cd-8eb8-684a0e43c2e8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:04.696509 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bbbac594-20f4-45cd-8eb8-684a0e43c2e8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:04.697311 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bbbac594-20f4-45cd-8eb8-684a0e43c2e8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:04.697756 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bbbac594-20f4-45cd-8eb8-684a0e43c2e8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:04.720796 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e353e5e9-ce2d-455e-9893-244468424eda tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050530 Apr 08 11:24:04.725610 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 571/1145] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:04 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:04.767574 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-bbbac594-20f4-45cd-8eb8-684a0e43c2e8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:04.775665 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-bbbac594-20f4-45cd-8eb8-684a0e43c2e8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.091189 Apr 08 11:24:04.776265 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 575/1146] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:04 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:05.689452 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c6e3b0b6-a348-4f1c-8c41-0b09ef8125fc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:05.690259 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c6e3b0b6-a348-4f1c-8c41-0b09ef8125fc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:05.697290 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c6e3b0b6-a348-4f1c-8c41-0b09ef8125fc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:05.697749 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c6e3b0b6-a348-4f1c-8c41-0b09ef8125fc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:05.698571 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c6e3b0b6-a348-4f1c-8c41-0b09ef8125fc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:05.699013 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c6e3b0b6-a348-4f1c-8c41-0b09ef8125fc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:05.702961 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2da28d00-d0cd-4b96-b409-ca5584596ff8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:05.703575 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-2da28d00-d0cd-4b96-b409-ca5584596ff8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:05.710626 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2da28d00-d0cd-4b96-b409-ca5584596ff8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:05.711074 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2da28d00-d0cd-4b96-b409-ca5584596ff8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:05.711854 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2da28d00-d0cd-4b96-b409-ca5584596ff8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:05.712289 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2da28d00-d0cd-4b96-b409-ca5584596ff8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:05.905002 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c6e3b0b6-a348-4f1c-8c41-0b09ef8125fc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:05.909148 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2da28d00-d0cd-4b96-b409-ca5584596ff8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:05.912507 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c6e3b0b6-a348-4f1c-8c41-0b09ef8125fc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.226912 Apr 08 11:24:05.913085 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 572/1147] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:05 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:05.917803 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a494374d-ba1b-49a0-9aed-7a56f3617f97 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:05.917980 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2da28d00-d0cd-4b96-b409-ca5584596ff8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:05.918798 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a494374d-ba1b-49a0-9aed-7a56f3617f97 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:05.919415 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2da28d00-d0cd-4b96-b409-ca5584596ff8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:05.920581 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-2da28d00-d0cd-4b96-b409-ca5584596ff8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.221509 Apr 08 11:24:05.921460 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 576/1148] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:05 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:24:05.925651 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-555ceb03-8d3c-471c-8bd8-3c0e9a649861 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:05.926286 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-555ceb03-8d3c-471c-8bd8-3c0e9a649861 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:05.929908 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a494374d-ba1b-49a0-9aed-7a56f3617f97 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:05.930441 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a494374d-ba1b-49a0-9aed-7a56f3617f97 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:05.931309 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a494374d-ba1b-49a0-9aed-7a56f3617f97 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:05.931757 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a494374d-ba1b-49a0-9aed-7a56f3617f97 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:05.932880 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-555ceb03-8d3c-471c-8bd8-3c0e9a649861 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:05.933339 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-555ceb03-8d3c-471c-8bd8-3c0e9a649861 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:05.934154 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-555ceb03-8d3c-471c-8bd8-3c0e9a649861 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:05.934596 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-555ceb03-8d3c-471c-8bd8-3c0e9a649861 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:05.963010 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a494374d-ba1b-49a0-9aed-7a56f3617f97 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048868 Apr 08 11:24:05.966501 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 573/1149] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:05 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:06.000366 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-555ceb03-8d3c-471c-8bd8-3c0e9a649861 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:06.008412 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-555ceb03-8d3c-471c-8bd8-3c0e9a649861 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.086195 Apr 08 11:24:06.008979 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 577/1150] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:05 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:06.930078 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ef230ebe-f6d6-4a23-ac74-9dfd57a69539 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:06.930629 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ef230ebe-f6d6-4a23-ac74-9dfd57a69539 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:06.936862 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ef230ebe-f6d6-4a23-ac74-9dfd57a69539 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:06.937318 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ef230ebe-f6d6-4a23-ac74-9dfd57a69539 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:06.938133 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ef230ebe-f6d6-4a23-ac74-9dfd57a69539 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:06.938575 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ef230ebe-f6d6-4a23-ac74-9dfd57a69539 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:06.939148 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-1d356f43-2980-4126-9ddd-915c7c39fbff tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:06.939759 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-1d356f43-2980-4126-9ddd-915c7c39fbff tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:06.946801 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1d356f43-2980-4126-9ddd-915c7c39fbff tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:06.947245 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1d356f43-2980-4126-9ddd-915c7c39fbff tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:06.948025 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1d356f43-2980-4126-9ddd-915c7c39fbff tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:06.948456 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1d356f43-2980-4126-9ddd-915c7c39fbff tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:07.142465 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ef230ebe-f6d6-4a23-ac74-9dfd57a69539 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:07.145528 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1d356f43-2980-4126-9ddd-915c7c39fbff tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:07.150730 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ef230ebe-f6d6-4a23-ac74-9dfd57a69539 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.224540 Apr 08 11:24:07.151417 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 574/1151] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:06 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:07.160688 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1d356f43-2980-4126-9ddd-915c7c39fbff tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:07.160850 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9be20f9e-2ede-4238-af4d-e2b41c86ca48 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:07.160948 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1d356f43-2980-4126-9ddd-915c7c39fbff tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:07.161045 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9be20f9e-2ede-4238-af4d-e2b41c86ca48 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:07.161133 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-1d356f43-2980-4126-9ddd-915c7c39fbff tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.222640 Apr 08 11:24:07.161133 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 578/1152] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:06 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:24:07.162786 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9be20f9e-2ede-4238-af4d-e2b41c86ca48 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:07.163242 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9be20f9e-2ede-4238-af4d-e2b41c86ca48 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:07.163899 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2a7cca91-3f13-40f6-9ed2-c5365886eb2c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:07.164093 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9be20f9e-2ede-4238-af4d-e2b41c86ca48 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:07.164502 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-2a7cca91-3f13-40f6-9ed2-c5365886eb2c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:07.164619 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9be20f9e-2ede-4238-af4d-e2b41c86ca48 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:07.170293 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2a7cca91-3f13-40f6-9ed2-c5365886eb2c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:07.170745 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2a7cca91-3f13-40f6-9ed2-c5365886eb2c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:07.171510 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2a7cca91-3f13-40f6-9ed2-c5365886eb2c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:07.172180 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2a7cca91-3f13-40f6-9ed2-c5365886eb2c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:07.194829 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9be20f9e-2ede-4238-af4d-e2b41c86ca48 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042139 Apr 08 11:24:07.195220 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 575/1153] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:07 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:07.235202 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2a7cca91-3f13-40f6-9ed2-c5365886eb2c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:07.243561 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-2a7cca91-3f13-40f6-9ed2-c5365886eb2c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082826 Apr 08 11:24:07.244148 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 579/1154] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:07 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:08.168627 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bccd054f-77ae-401d-8c38-8455bffca1fa tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:08.169469 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-bccd054f-77ae-401d-8c38-8455bffca1fa tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:08.175478 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2a569491-51cf-46d2-a9db-ceb6b7d90fd3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:08.176086 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bccd054f-77ae-401d-8c38-8455bffca1fa tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:08.176214 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-2a569491-51cf-46d2-a9db-ceb6b7d90fd3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:08.176543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bccd054f-77ae-401d-8c38-8455bffca1fa tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:08.177323 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bccd054f-77ae-401d-8c38-8455bffca1fa tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:08.177775 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bccd054f-77ae-401d-8c38-8455bffca1fa tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:08.182547 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2a569491-51cf-46d2-a9db-ceb6b7d90fd3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:08.183005 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2a569491-51cf-46d2-a9db-ceb6b7d90fd3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:08.183773 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2a569491-51cf-46d2-a9db-ceb6b7d90fd3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:08.184205 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2a569491-51cf-46d2-a9db-ceb6b7d90fd3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:08.380740 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-bccd054f-77ae-401d-8c38-8455bffca1fa tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:08.385176 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2a569491-51cf-46d2-a9db-ceb6b7d90fd3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:08.389032 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-bccd054f-77ae-401d-8c38-8455bffca1fa tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.224255 Apr 08 11:24:08.389609 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 576/1155] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:08 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:08.393360 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2a569491-51cf-46d2-a9db-ceb6b7d90fd3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:08.394334 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b304c492-b209-4f74-9d5b-7d9158609b6a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:08.394887 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2a569491-51cf-46d2-a9db-ceb6b7d90fd3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:08.395286 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b304c492-b209-4f74-9d5b-7d9158609b6a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:08.396121 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-2a569491-51cf-46d2-a9db-ceb6b7d90fd3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.224515 Apr 08 11:24:08.396750 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 580/1156] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:08 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:24:08.401737 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-94e24e2c-f843-41ec-8acb-97429e402cd6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:08.401932 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b304c492-b209-4f74-9d5b-7d9158609b6a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:08.402298 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b304c492-b209-4f74-9d5b-7d9158609b6a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:08.402418 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-94e24e2c-f843-41ec-8acb-97429e402cd6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:08.403076 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b304c492-b209-4f74-9d5b-7d9158609b6a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:08.403548 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b304c492-b209-4f74-9d5b-7d9158609b6a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:08.408238 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-94e24e2c-f843-41ec-8acb-97429e402cd6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:08.408685 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-94e24e2c-f843-41ec-8acb-97429e402cd6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:08.409447 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-94e24e2c-f843-41ec-8acb-97429e402cd6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:08.409916 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-94e24e2c-f843-41ec-8acb-97429e402cd6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:08.432455 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b304c492-b209-4f74-9d5b-7d9158609b6a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041657 Apr 08 11:24:08.432939 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 577/1157] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:08 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:08.473045 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-94e24e2c-f843-41ec-8acb-97429e402cd6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:08.480562 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-94e24e2c-f843-41ec-8acb-97429e402cd6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082400 Apr 08 11:24:08.481140 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 581/1158] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:08 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:09.407466 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c674a210-6640-4806-89cf-411b25d77c93 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:09.408089 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c674a210-6640-4806-89cf-411b25d77c93 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:09.415144 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-503e6230-d947-4d3e-bbdf-aec7ebb940e7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:09.415768 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-503e6230-d947-4d3e-bbdf-aec7ebb940e7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:09.415881 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c674a210-6640-4806-89cf-411b25d77c93 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:09.416642 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c674a210-6640-4806-89cf-411b25d77c93 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:09.417740 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c674a210-6640-4806-89cf-411b25d77c93 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:09.418621 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c674a210-6640-4806-89cf-411b25d77c93 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:09.423268 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-503e6230-d947-4d3e-bbdf-aec7ebb940e7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:09.423765 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-503e6230-d947-4d3e-bbdf-aec7ebb940e7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:09.424720 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-503e6230-d947-4d3e-bbdf-aec7ebb940e7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:09.425035 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-503e6230-d947-4d3e-bbdf-aec7ebb940e7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:09.633930 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c674a210-6640-4806-89cf-411b25d77c93 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:09.637104 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-503e6230-d947-4d3e-bbdf-aec7ebb940e7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:09.642377 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c674a210-6640-4806-89cf-411b25d77c93 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.238796 Apr 08 11:24:09.643836 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 578/1159] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:09 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:09.649418 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-503e6230-d947-4d3e-bbdf-aec7ebb940e7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:09.649809 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-fe6b7057-0e6b-4dac-9fe8-2996b2664fc2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:09.650767 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-fe6b7057-0e6b-4dac-9fe8-2996b2664fc2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:09.651447 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-503e6230-d947-4d3e-bbdf-aec7ebb940e7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:09.652650 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-503e6230-d947-4d3e-bbdf-aec7ebb940e7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.242054 Apr 08 11:24:09.653220 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 582/1160] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:09 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:24:09.657432 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fe6b7057-0e6b-4dac-9fe8-2996b2664fc2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:09.657880 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2b5876aa-3d00-4f80-b742-3aef319123dd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:09.658157 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fe6b7057-0e6b-4dac-9fe8-2996b2664fc2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:09.658425 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-2b5876aa-3d00-4f80-b742-3aef319123dd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:09.658901 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fe6b7057-0e6b-4dac-9fe8-2996b2664fc2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:09.659357 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fe6b7057-0e6b-4dac-9fe8-2996b2664fc2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:09.664871 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2b5876aa-3d00-4f80-b742-3aef319123dd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:09.665471 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2b5876aa-3d00-4f80-b742-3aef319123dd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:09.666331 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2b5876aa-3d00-4f80-b742-3aef319123dd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:09.666768 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2b5876aa-3d00-4f80-b742-3aef319123dd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:09.689233 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-fe6b7057-0e6b-4dac-9fe8-2996b2664fc2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044564 Apr 08 11:24:09.689815 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 579/1161] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:09 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:09.727093 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2b5876aa-3d00-4f80-b742-3aef319123dd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:09.734743 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-2b5876aa-3d00-4f80-b742-3aef319123dd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080528 Apr 08 11:24:09.735322 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 583/1162] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:09 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:10.660509 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7f3a9138-a2ab-46a0-a35e-87d8ed4e4396 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:10.661128 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7f3a9138-a2ab-46a0-a35e-87d8ed4e4396 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:10.667722 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7f3a9138-a2ab-46a0-a35e-87d8ed4e4396 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:10.668177 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7f3a9138-a2ab-46a0-a35e-87d8ed4e4396 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:10.668958 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7f3a9138-a2ab-46a0-a35e-87d8ed4e4396 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:10.669403 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7f3a9138-a2ab-46a0-a35e-87d8ed4e4396 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:10.670653 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a502fff2-0be0-4a0f-8978-47e4506ca78a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:10.671307 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a502fff2-0be0-4a0f-8978-47e4506ca78a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:10.677629 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a502fff2-0be0-4a0f-8978-47e4506ca78a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:10.678611 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a502fff2-0be0-4a0f-8978-47e4506ca78a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:10.679403 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a502fff2-0be0-4a0f-8978-47e4506ca78a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:10.679850 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a502fff2-0be0-4a0f-8978-47e4506ca78a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:10.877879 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7f3a9138-a2ab-46a0-a35e-87d8ed4e4396 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:10.886026 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7f3a9138-a2ab-46a0-a35e-87d8ed4e4396 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.229324 Apr 08 11:24:10.886617 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 580/1163] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:10 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:10.890416 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a502fff2-0be0-4a0f-8978-47e4506ca78a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:10.891456 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5c69baee-d505-48bc-83ff-132294ee2948 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:10.892560 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5c69baee-d505-48bc-83ff-132294ee2948 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:10.898612 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5c69baee-d505-48bc-83ff-132294ee2948 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:10.898992 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5c69baee-d505-48bc-83ff-132294ee2948 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:10.899679 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a502fff2-0be0-4a0f-8978-47e4506ca78a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:10.899824 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5c69baee-d505-48bc-83ff-132294ee2948 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:10.900227 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5c69baee-d505-48bc-83ff-132294ee2948 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:10.901197 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a502fff2-0be0-4a0f-8978-47e4506ca78a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:10.902397 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a502fff2-0be0-4a0f-8978-47e4506ca78a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.235708 Apr 08 11:24:10.902958 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 584/1164] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:10 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:24:10.907408 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-38c09e8c-9e5b-4013-ae3b-1a8f6779638c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:10.908023 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-38c09e8c-9e5b-4013-ae3b-1a8f6779638c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:10.914232 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-38c09e8c-9e5b-4013-ae3b-1a8f6779638c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:10.914687 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-38c09e8c-9e5b-4013-ae3b-1a8f6779638c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:10.915481 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-38c09e8c-9e5b-4013-ae3b-1a8f6779638c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:10.915918 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-38c09e8c-9e5b-4013-ae3b-1a8f6779638c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:10.931419 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5c69baee-d505-48bc-83ff-132294ee2948 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043739 Apr 08 11:24:10.932246 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 581/1165] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:10 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:10.981457 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-38c09e8c-9e5b-4013-ae3b-1a8f6779638c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:10.988948 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-38c09e8c-9e5b-4013-ae3b-1a8f6779638c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.085017 Apr 08 11:24:10.989781 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 585/1166] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:10 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:11.903489 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-40f5941c-31a8-4d47-ac18-ce9a5e7f1052 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:11.904052 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-40f5941c-31a8-4d47-ac18-ce9a5e7f1052 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:11.910654 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-40f5941c-31a8-4d47-ac18-ce9a5e7f1052 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:11.911114 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-40f5941c-31a8-4d47-ac18-ce9a5e7f1052 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:11.911893 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-40f5941c-31a8-4d47-ac18-ce9a5e7f1052 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:11.912877 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-40f5941c-31a8-4d47-ac18-ce9a5e7f1052 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:11.920607 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2a3b499f-43c8-4413-86da-420d1f1a9118 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:11.921266 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-2a3b499f-43c8-4413-86da-420d1f1a9118 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:11.927841 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2a3b499f-43c8-4413-86da-420d1f1a9118 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:11.928857 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2a3b499f-43c8-4413-86da-420d1f1a9118 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:11.929655 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2a3b499f-43c8-4413-86da-420d1f1a9118 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:11.930124 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2a3b499f-43c8-4413-86da-420d1f1a9118 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:12.134095 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2a3b499f-43c8-4413-86da-420d1f1a9118 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:12.137410 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-40f5941c-31a8-4d47-ac18-ce9a5e7f1052 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:12.143859 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2a3b499f-43c8-4413-86da-420d1f1a9118 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:12.145652 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-40f5941c-31a8-4d47-ac18-ce9a5e7f1052 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.245483 Apr 08 11:24:12.145813 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2a3b499f-43c8-4413-86da-420d1f1a9118 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:12.145937 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 582/1167] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:11 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:12.147392 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-2a3b499f-43c8-4413-86da-420d1f1a9118 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.230187 Apr 08 11:24:12.150482 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 586/1168] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:11 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:24:12.150921 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f40a2f5b-f480-4591-ab81-203a78c4e119 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:12.151983 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f40a2f5b-f480-4591-ab81-203a78c4e119 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:12.158671 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-07a8bc31-5e8f-429e-a394-6660618cb0d3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:12.159020 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f40a2f5b-f480-4591-ab81-203a78c4e119 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:12.159708 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f40a2f5b-f480-4591-ab81-203a78c4e119 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:12.159830 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-07a8bc31-5e8f-429e-a394-6660618cb0d3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:12.161193 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f40a2f5b-f480-4591-ab81-203a78c4e119 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:12.161419 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f40a2f5b-f480-4591-ab81-203a78c4e119 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:12.167410 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-07a8bc31-5e8f-429e-a394-6660618cb0d3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:12.167875 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-07a8bc31-5e8f-429e-a394-6660618cb0d3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:12.169120 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-07a8bc31-5e8f-429e-a394-6660618cb0d3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:12.169120 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-07a8bc31-5e8f-429e-a394-6660618cb0d3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:12.194142 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f40a2f5b-f480-4591-ab81-203a78c4e119 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047274 Apr 08 11:24:12.194733 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 583/1169] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:12 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:12.235524 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-07a8bc31-5e8f-429e-a394-6660618cb0d3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:12.244002 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-07a8bc31-5e8f-429e-a394-6660618cb0d3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.091628 Apr 08 11:24:12.244595 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 587/1170] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:12 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:13.165707 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-8d391fe1-8d06-4abd-a77a-8ba473209a64 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:13.166439 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-8d391fe1-8d06-4abd-a77a-8ba473209a64 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:13.167185 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d31f8985-15ec-4930-91bf-f42152220610 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:13.168411 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d31f8985-15ec-4930-91bf-f42152220610 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:13.173444 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8d391fe1-8d06-4abd-a77a-8ba473209a64 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:13.173945 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8d391fe1-8d06-4abd-a77a-8ba473209a64 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:13.174845 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8d391fe1-8d06-4abd-a77a-8ba473209a64 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:13.175294 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8d391fe1-8d06-4abd-a77a-8ba473209a64 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:13.182836 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d31f8985-15ec-4930-91bf-f42152220610 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:13.183650 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d31f8985-15ec-4930-91bf-f42152220610 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:13.184859 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d31f8985-15ec-4930-91bf-f42152220610 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:13.185493 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d31f8985-15ec-4930-91bf-f42152220610 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:13.400795 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-8d391fe1-8d06-4abd-a77a-8ba473209a64 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:13.405954 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d31f8985-15ec-4930-91bf-f42152220610 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:13.410249 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-8d391fe1-8d06-4abd-a77a-8ba473209a64 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:13.411834 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-8d391fe1-8d06-4abd-a77a-8ba473209a64 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:13.413653 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-8d391fe1-8d06-4abd-a77a-8ba473209a64 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.251831 Apr 08 11:24:13.414288 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 588/1171] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:13 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:24:13.417263 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d31f8985-15ec-4930-91bf-f42152220610 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.257340 Apr 08 11:24:13.418524 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 584/1172] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:13 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:13.419356 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-3091160a-02a9-40e5-acc1-02749a6ed301 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:13.420417 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-3091160a-02a9-40e5-acc1-02749a6ed301 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:13.427183 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3091160a-02a9-40e5-acc1-02749a6ed301 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:13.427671 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3091160a-02a9-40e5-acc1-02749a6ed301 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:13.429081 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3091160a-02a9-40e5-acc1-02749a6ed301 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:13.429532 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3091160a-02a9-40e5-acc1-02749a6ed301 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:13.440295 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a05cb04c-9538-4c60-b74a-977e312ffba0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:13.441348 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a05cb04c-9538-4c60-b74a-977e312ffba0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:13.449126 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a05cb04c-9538-4c60-b74a-977e312ffba0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:13.449580 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a05cb04c-9538-4c60-b74a-977e312ffba0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:13.450451 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a05cb04c-9538-4c60-b74a-977e312ffba0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:13.450906 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a05cb04c-9538-4c60-b74a-977e312ffba0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:13.463362 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-3091160a-02a9-40e5-acc1-02749a6ed301 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047941 Apr 08 11:24:13.463978 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 589/1173] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:13 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:13.518951 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a05cb04c-9538-4c60-b74a-977e312ffba0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:13.527036 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a05cb04c-9538-4c60-b74a-977e312ffba0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.095559 Apr 08 11:24:13.527613 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 585/1174] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:13 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:14.441336 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-c2244f3b-94f9-4f98-b92a-e0939f944b44 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:14.441998 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-c2244f3b-94f9-4f98-b92a-e0939f944b44 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:14.446446 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f13d6bfc-d6f5-4d09-a6ea-af6e8a01e3f8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:14.447241 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f13d6bfc-d6f5-4d09-a6ea-af6e8a01e3f8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:14.449355 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c2244f3b-94f9-4f98-b92a-e0939f944b44 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:14.449852 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c2244f3b-94f9-4f98-b92a-e0939f944b44 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:14.450637 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c2244f3b-94f9-4f98-b92a-e0939f944b44 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:14.451079 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c2244f3b-94f9-4f98-b92a-e0939f944b44 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:14.453915 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f13d6bfc-d6f5-4d09-a6ea-af6e8a01e3f8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:14.454408 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f13d6bfc-d6f5-4d09-a6ea-af6e8a01e3f8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:14.455207 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f13d6bfc-d6f5-4d09-a6ea-af6e8a01e3f8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:14.455644 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f13d6bfc-d6f5-4d09-a6ea-af6e8a01e3f8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:14.676311 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-c2244f3b-94f9-4f98-b92a-e0939f944b44 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:14.682107 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f13d6bfc-d6f5-4d09-a6ea-af6e8a01e3f8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:14.685602 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-c2244f3b-94f9-4f98-b92a-e0939f944b44 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:14.687214 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-c2244f3b-94f9-4f98-b92a-e0939f944b44 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:14.688429 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-c2244f3b-94f9-4f98-b92a-e0939f944b44 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.251184 Apr 08 11:24:14.688995 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 590/1175] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:14 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:24:14.690452 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f13d6bfc-d6f5-4d09-a6ea-af6e8a01e3f8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.248587 Apr 08 11:24:14.691310 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 586/1176] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:14 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:14.694654 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-41a58504-f311-4483-a722-d6771d158a16 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:14.695501 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-41a58504-f311-4483-a722-d6771d158a16 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:14.696251 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-416a82f3-1860-4da4-a63d-a98bc31d48d9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:14.696883 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-416a82f3-1860-4da4-a63d-a98bc31d48d9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:14.703624 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-416a82f3-1860-4da4-a63d-a98bc31d48d9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:14.704133 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-416a82f3-1860-4da4-a63d-a98bc31d48d9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:14.704878 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-416a82f3-1860-4da4-a63d-a98bc31d48d9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:14.705320 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-416a82f3-1860-4da4-a63d-a98bc31d48d9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:14.708178 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-41a58504-f311-4483-a722-d6771d158a16 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:14.708630 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-41a58504-f311-4483-a722-d6771d158a16 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:14.709429 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-41a58504-f311-4483-a722-d6771d158a16 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:14.709911 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-41a58504-f311-4483-a722-d6771d158a16 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:14.743231 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-41a58504-f311-4483-a722-d6771d158a16 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052679 Apr 08 11:24:14.743838 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 591/1177] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:14 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:14.770228 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-416a82f3-1860-4da4-a63d-a98bc31d48d9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:14.778540 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-416a82f3-1860-4da4-a63d-a98bc31d48d9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.086433 Apr 08 11:24:14.779137 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 587/1178] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:14 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:15.711419 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-545ebae8-17ab-4803-85d9-fdcabf65b051 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:15.712088 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-545ebae8-17ab-4803-85d9-fdcabf65b051 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:15.714941 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6d91df9d-2efb-4f86-ba33-e39a7cccf84c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:15.715559 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6d91df9d-2efb-4f86-ba33-e39a7cccf84c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:15.718853 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-545ebae8-17ab-4803-85d9-fdcabf65b051 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:15.719303 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-545ebae8-17ab-4803-85d9-fdcabf65b051 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:15.720128 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-545ebae8-17ab-4803-85d9-fdcabf65b051 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:15.720571 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-545ebae8-17ab-4803-85d9-fdcabf65b051 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:15.722510 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6d91df9d-2efb-4f86-ba33-e39a7cccf84c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:15.722963 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6d91df9d-2efb-4f86-ba33-e39a7cccf84c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:15.723802 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6d91df9d-2efb-4f86-ba33-e39a7cccf84c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:15.724239 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6d91df9d-2efb-4f86-ba33-e39a7cccf84c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:15.947586 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-545ebae8-17ab-4803-85d9-fdcabf65b051 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:15.952512 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6d91df9d-2efb-4f86-ba33-e39a7cccf84c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:15.962430 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6d91df9d-2efb-4f86-ba33-e39a7cccf84c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.251360 Apr 08 11:24:15.963262 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 588/1179] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:15 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:24:15.964081 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-545ebae8-17ab-4803-85d9-fdcabf65b051 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:15.967748 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-545ebae8-17ab-4803-85d9-fdcabf65b051 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:15.970104 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-545ebae8-17ab-4803-85d9-fdcabf65b051 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.263124 Apr 08 11:24:15.971271 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 592/1180] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:15 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:24:15.971422 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e550a089-d33b-4479-82f3-d7df1e3a1e49 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:15.972969 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e550a089-d33b-4479-82f3-d7df1e3a1e49 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:15.979962 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e550a089-d33b-4479-82f3-d7df1e3a1e49 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:15.980410 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-f7c2f9cd-610c-48de-b60b-10bd525bbb57 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:15.980636 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e550a089-d33b-4479-82f3-d7df1e3a1e49 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:15.981188 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e550a089-d33b-4479-82f3-d7df1e3a1e49 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:15.981449 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-f7c2f9cd-610c-48de-b60b-10bd525bbb57 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:15.981624 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e550a089-d33b-4479-82f3-d7df1e3a1e49 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:15.992069 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f7c2f9cd-610c-48de-b60b-10bd525bbb57 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:15.993054 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f7c2f9cd-610c-48de-b60b-10bd525bbb57 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:15.994508 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f7c2f9cd-610c-48de-b60b-10bd525bbb57 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:15.995306 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f7c2f9cd-610c-48de-b60b-10bd525bbb57 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:16.018925 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e550a089-d33b-4479-82f3-d7df1e3a1e49 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054252 Apr 08 11:24:16.019910 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 589/1181] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:15 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:16.085659 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f7c2f9cd-610c-48de-b60b-10bd525bbb57 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:16.093571 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-f7c2f9cd-610c-48de-b60b-10bd525bbb57 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.121034 Apr 08 11:24:16.094267 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 593/1182] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:15 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:16.984642 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e4940360-9db8-4182-9286-9ab9bc9f09e8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:16.985226 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e4940360-9db8-4182-9286-9ab9bc9f09e8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:16.991740 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e4940360-9db8-4182-9286-9ab9bc9f09e8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:16.992195 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e4940360-9db8-4182-9286-9ab9bc9f09e8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:16.993110 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-37be8929-bee6-4078-8437-55b6612400f2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:16.993559 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e4940360-9db8-4182-9286-9ab9bc9f09e8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:16.993723 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e4940360-9db8-4182-9286-9ab9bc9f09e8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:16.993848 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-37be8929-bee6-4078-8437-55b6612400f2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:17.000431 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-37be8929-bee6-4078-8437-55b6612400f2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:17.000884 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-37be8929-bee6-4078-8437-55b6612400f2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:17.001687 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-37be8929-bee6-4078-8437-55b6612400f2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:17.002788 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-37be8929-bee6-4078-8437-55b6612400f2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:17.221353 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e4940360-9db8-4182-9286-9ab9bc9f09e8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:17.226891 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-37be8929-bee6-4078-8437-55b6612400f2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:17.229619 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e4940360-9db8-4182-9286-9ab9bc9f09e8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.248863 Apr 08 11:24:17.230263 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 590/1183] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:16 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:17.235317 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7d2e88fd-d0ba-4a2d-b6c8-eaee1726fec2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:17.236168 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7d2e88fd-d0ba-4a2d-b6c8-eaee1726fec2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:17.236800 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-37be8929-bee6-4078-8437-55b6612400f2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:17.238382 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-37be8929-bee6-4078-8437-55b6612400f2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:17.239590 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-37be8929-bee6-4078-8437-55b6612400f2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.250754 Apr 08 11:24:17.244367 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 594/1184] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:16 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:24:17.244605 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d2e88fd-d0ba-4a2d-b6c8-eaee1726fec2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:17.244605 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d2e88fd-d0ba-4a2d-b6c8-eaee1726fec2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:17.244605 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d2e88fd-d0ba-4a2d-b6c8-eaee1726fec2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:17.244605 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d2e88fd-d0ba-4a2d-b6c8-eaee1726fec2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:17.245613 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-455b7ba3-01d4-491b-839c-e5b146118f52 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:17.246386 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-455b7ba3-01d4-491b-839c-e5b146118f52 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:17.252959 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-455b7ba3-01d4-491b-839c-e5b146118f52 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:17.253444 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-455b7ba3-01d4-491b-839c-e5b146118f52 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:17.254268 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-455b7ba3-01d4-491b-839c-e5b146118f52 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:17.254713 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-455b7ba3-01d4-491b-839c-e5b146118f52 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:17.281262 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7d2e88fd-d0ba-4a2d-b6c8-eaee1726fec2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049893 Apr 08 11:24:17.281902 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 591/1185] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:17 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:17.324655 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-455b7ba3-01d4-491b-839c-e5b146118f52 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:17.332356 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-455b7ba3-01d4-491b-839c-e5b146118f52 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.090843 Apr 08 11:24:17.333007 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 595/1186] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:17 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:18.251537 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-75cb036a-bfa6-4575-9085-f17786877770 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:18.252153 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-75cb036a-bfa6-4575-9085-f17786877770 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:18.258871 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-75cb036a-bfa6-4575-9085-f17786877770 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:18.259321 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-75cb036a-bfa6-4575-9085-f17786877770 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:18.260116 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-75cb036a-bfa6-4575-9085-f17786877770 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:18.260571 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-75cb036a-bfa6-4575-9085-f17786877770 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:18.264922 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-13897bf3-ca0d-4fb7-a968-8b543b2d9255 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:18.266145 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-13897bf3-ca0d-4fb7-a968-8b543b2d9255 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:18.278389 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-13897bf3-ca0d-4fb7-a968-8b543b2d9255 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:18.279175 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-13897bf3-ca0d-4fb7-a968-8b543b2d9255 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:18.280562 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-13897bf3-ca0d-4fb7-a968-8b543b2d9255 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:18.281319 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-13897bf3-ca0d-4fb7-a968-8b543b2d9255 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:18.468822 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-75cb036a-bfa6-4575-9085-f17786877770 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:18.483142 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-75cb036a-bfa6-4575-9085-f17786877770 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.235055 Apr 08 11:24:18.484480 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 592/1187] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:18 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:18.490379 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ce530422-4d88-4951-92ef-5642120bb9b1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:18.492049 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ce530422-4d88-4951-92ef-5642120bb9b1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:18.501454 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ce530422-4d88-4951-92ef-5642120bb9b1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:18.502282 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ce530422-4d88-4951-92ef-5642120bb9b1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:18.503197 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ce530422-4d88-4951-92ef-5642120bb9b1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:18.503769 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ce530422-4d88-4951-92ef-5642120bb9b1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:18.515809 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-13897bf3-ca0d-4fb7-a968-8b543b2d9255 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:18.525583 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-13897bf3-ca0d-4fb7-a968-8b543b2d9255 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:18.527203 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-13897bf3-ca0d-4fb7-a968-8b543b2d9255 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:18.528412 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-13897bf3-ca0d-4fb7-a968-8b543b2d9255 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.271214 Apr 08 11:24:18.528987 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 596/1188] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:18 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:24:18.533997 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-eba3746f-6ee0-4ce9-9c2e-5cc69b49c203 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:18.534628 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-eba3746f-6ee0-4ce9-9c2e-5cc69b49c203 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:18.539034 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ce530422-4d88-4951-92ef-5642120bb9b1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053432 Apr 08 11:24:18.542895 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 593/1189] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:18 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:18.549678 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-eba3746f-6ee0-4ce9-9c2e-5cc69b49c203 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:18.550170 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-eba3746f-6ee0-4ce9-9c2e-5cc69b49c203 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:18.550978 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-eba3746f-6ee0-4ce9-9c2e-5cc69b49c203 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:18.551421 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-eba3746f-6ee0-4ce9-9c2e-5cc69b49c203 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:18.612726 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-eba3746f-6ee0-4ce9-9c2e-5cc69b49c203 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:18.620547 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-eba3746f-6ee0-4ce9-9c2e-5cc69b49c203 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.090524 Apr 08 11:24:18.621138 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 597/1190] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:18 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:19.509543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-619cfc50-69ef-497c-805b-1c35426547dd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:19.510335 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-619cfc50-69ef-497c-805b-1c35426547dd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:19.516844 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-619cfc50-69ef-497c-805b-1c35426547dd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:19.517296 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-619cfc50-69ef-497c-805b-1c35426547dd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:19.518104 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-619cfc50-69ef-497c-805b-1c35426547dd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:19.518553 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-619cfc50-69ef-497c-805b-1c35426547dd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:19.550805 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-6a2abe6b-a033-4d52-8998-1a4384d47da5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:19.551722 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-6a2abe6b-a033-4d52-8998-1a4384d47da5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:19.558960 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6a2abe6b-a033-4d52-8998-1a4384d47da5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:19.559426 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6a2abe6b-a033-4d52-8998-1a4384d47da5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:19.560214 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6a2abe6b-a033-4d52-8998-1a4384d47da5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:19.560657 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6a2abe6b-a033-4d52-8998-1a4384d47da5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:19.592541 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-6a2abe6b-a033-4d52-8998-1a4384d47da5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045678 Apr 08 11:24:19.593143 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 598/1191] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:19 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:24:19.597811 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-cf766bf8-e89c-4f70-9c6c-1cef1e0f2075 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:19.598497 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-cf766bf8-e89c-4f70-9c6c-1cef1e0f2075 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:19.605125 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cf766bf8-e89c-4f70-9c6c-1cef1e0f2075 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:19.605569 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cf766bf8-e89c-4f70-9c6c-1cef1e0f2075 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:19.606413 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cf766bf8-e89c-4f70-9c6c-1cef1e0f2075 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:19.606847 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cf766bf8-e89c-4f70-9c6c-1cef1e0f2075 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:19.706112 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-619cfc50-69ef-497c-805b-1c35426547dd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:19.716387 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-619cfc50-69ef-497c-805b-1c35426547dd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.210880 Apr 08 11:24:19.716982 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 594/1192] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:19 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:19.721539 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-cd557bb3-a472-4812-a908-92780fbfffa5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:19.722190 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-cd557bb3-a472-4812-a908-92780fbfffa5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:19.728947 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cd557bb3-a472-4812-a908-92780fbfffa5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:19.729400 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cd557bb3-a472-4812-a908-92780fbfffa5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:19.730222 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cd557bb3-a472-4812-a908-92780fbfffa5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:19.730659 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cd557bb3-a472-4812-a908-92780fbfffa5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:19.800824 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-cd557bb3-a472-4812-a908-92780fbfffa5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:19.804280 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-cf766bf8-e89c-4f70-9c6c-1cef1e0f2075 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:19.808749 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-cd557bb3-a472-4812-a908-92780fbfffa5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.090731 Apr 08 11:24:19.809333 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 595/1193] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:19 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:19.813397 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-cf766bf8-e89c-4f70-9c6c-1cef1e0f2075 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:19.815032 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-cf766bf8-e89c-4f70-9c6c-1cef1e0f2075 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:19.816214 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-cf766bf8-e89c-4f70-9c6c-1cef1e0f2075 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.222155 Apr 08 11:24:19.816778 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 599/1194] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:19 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:24:20.603387 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-787c9c59-3c5c-4c9b-8882-f11a53841b99 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:20.604319 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-787c9c59-3c5c-4c9b-8882-f11a53841b99 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:20.610560 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-787c9c59-3c5c-4c9b-8882-f11a53841b99 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:20.611019 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-787c9c59-3c5c-4c9b-8882-f11a53841b99 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:20.611863 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-787c9c59-3c5c-4c9b-8882-f11a53841b99 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:20.612305 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-787c9c59-3c5c-4c9b-8882-f11a53841b99 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:20.643349 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-787c9c59-3c5c-4c9b-8882-f11a53841b99 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043831 Apr 08 11:24:20.644154 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 596/1195] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:20 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:20.735899 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-f53cc00f-47e1-4944-97dc-59f9b3f1a4ea tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:20.736527 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-f53cc00f-47e1-4944-97dc-59f9b3f1a4ea tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:20.744025 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f53cc00f-47e1-4944-97dc-59f9b3f1a4ea tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:20.744477 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f53cc00f-47e1-4944-97dc-59f9b3f1a4ea tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:20.745335 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f53cc00f-47e1-4944-97dc-59f9b3f1a4ea tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:20.745785 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f53cc00f-47e1-4944-97dc-59f9b3f1a4ea tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:20.826966 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6d72406f-5be4-4cfc-993d-2ae0c150f7e9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:20.827595 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6d72406f-5be4-4cfc-993d-2ae0c150f7e9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:20.833969 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6d72406f-5be4-4cfc-993d-2ae0c150f7e9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:20.834448 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6d72406f-5be4-4cfc-993d-2ae0c150f7e9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:20.835210 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6d72406f-5be4-4cfc-993d-2ae0c150f7e9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:20.835649 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6d72406f-5be4-4cfc-993d-2ae0c150f7e9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:20.906416 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6d72406f-5be4-4cfc-993d-2ae0c150f7e9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:20.911340 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f53cc00f-47e1-4944-97dc-59f9b3f1a4ea tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:20.914511 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6d72406f-5be4-4cfc-993d-2ae0c150f7e9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.092117 Apr 08 11:24:20.915744 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 597/1196] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:20 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:20.920061 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-dfdc1c60-b52c-46d2-bcb4-4dd2c6075134 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:20.920489 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-f53cc00f-47e1-4944-97dc-59f9b3f1a4ea tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.188506 Apr 08 11:24:20.920663 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-dfdc1c60-b52c-46d2-bcb4-4dd2c6075134 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:20.921564 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 600/1197] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:20 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:20.926669 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dfdc1c60-b52c-46d2-bcb4-4dd2c6075134 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:20.929153 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dfdc1c60-b52c-46d2-bcb4-4dd2c6075134 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:20.929153 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dfdc1c60-b52c-46d2-bcb4-4dd2c6075134 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:20.929153 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dfdc1c60-b52c-46d2-bcb4-4dd2c6075134 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:21.067438 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-dfdc1c60-b52c-46d2-bcb4-4dd2c6075134 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:21.075851 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-dfdc1c60-b52c-46d2-bcb4-4dd2c6075134 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:21.077375 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-dfdc1c60-b52c-46d2-bcb4-4dd2c6075134 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:21.078567 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-dfdc1c60-b52c-46d2-bcb4-4dd2c6075134 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.162205 Apr 08 11:24:21.079131 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 598/1198] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:20 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:24:21.655016 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-52196a85-5d3b-4acf-aedc-5845042f8720 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:21.655968 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-52196a85-5d3b-4acf-aedc-5845042f8720 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:21.662455 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-52196a85-5d3b-4acf-aedc-5845042f8720 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:21.662913 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-52196a85-5d3b-4acf-aedc-5845042f8720 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:21.663682 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-52196a85-5d3b-4acf-aedc-5845042f8720 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:21.664154 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-52196a85-5d3b-4acf-aedc-5845042f8720 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:21.693000 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-52196a85-5d3b-4acf-aedc-5845042f8720 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041879 Apr 08 11:24:21.693572 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 601/1199] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:21 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:21.932067 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d582445b-c8e3-46a3-82ca-2ee859c3876d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:21.932634 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d582445b-c8e3-46a3-82ca-2ee859c3876d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:21.938933 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d582445b-c8e3-46a3-82ca-2ee859c3876d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:21.939384 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d582445b-c8e3-46a3-82ca-2ee859c3876d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:21.940160 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d582445b-c8e3-46a3-82ca-2ee859c3876d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:21.940601 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d582445b-c8e3-46a3-82ca-2ee859c3876d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:21.943584 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-4d20a10a-d309-41c6-9441-c846b2cd1a2d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:21.944222 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-4d20a10a-d309-41c6-9441-c846b2cd1a2d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:21.950673 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4d20a10a-d309-41c6-9441-c846b2cd1a2d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:21.951131 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4d20a10a-d309-41c6-9441-c846b2cd1a2d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:21.951911 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4d20a10a-d309-41c6-9441-c846b2cd1a2d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:21.952357 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4d20a10a-d309-41c6-9441-c846b2cd1a2d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:22.003798 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d582445b-c8e3-46a3-82ca-2ee859c3876d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:22.020767 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d582445b-c8e3-46a3-82ca-2ee859c3876d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.092576 Apr 08 11:24:22.022153 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 599/1200] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:21 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:24:22.096642 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ac6aedad-f2e3-4ef9-8912-59b8f4112d84 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:22.097418 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ac6aedad-f2e3-4ef9-8912-59b8f4112d84 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:22.104253 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ac6aedad-f2e3-4ef9-8912-59b8f4112d84 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:22.104706 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ac6aedad-f2e3-4ef9-8912-59b8f4112d84 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:22.105497 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ac6aedad-f2e3-4ef9-8912-59b8f4112d84 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:22.105973 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ac6aedad-f2e3-4ef9-8912-59b8f4112d84 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:22.110528 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-4d20a10a-d309-41c6-9441-c846b2cd1a2d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:22.119525 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-4d20a10a-d309-41c6-9441-c846b2cd1a2d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.179590 Apr 08 11:24:22.120120 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 602/1201] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:21 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:24:22.244077 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ac6aedad-f2e3-4ef9-8912-59b8f4112d84 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:22.252932 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ac6aedad-f2e3-4ef9-8912-59b8f4112d84 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:22.254516 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ac6aedad-f2e3-4ef9-8912-59b8f4112d84 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:22.255692 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ac6aedad-f2e3-4ef9-8912-59b8f4112d84 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.163013 Apr 08 11:24:22.256303 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 600/1202] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:22 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:24:22.708314 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-8c19308e-3ecf-4d5b-b336-ad21fb31b282 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:22.709790 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-8c19308e-3ecf-4d5b-b336-ad21fb31b282 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:22.715867 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8c19308e-3ecf-4d5b-b336-ad21fb31b282 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:22.716328 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8c19308e-3ecf-4d5b-b336-ad21fb31b282 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:22.717112 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8c19308e-3ecf-4d5b-b336-ad21fb31b282 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:22.717557 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8c19308e-3ecf-4d5b-b336-ad21fb31b282 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:22.746149 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-8c19308e-3ecf-4d5b-b336-ad21fb31b282 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041708 Apr 08 11:24:22.746706 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 603/1203] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:22 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:23.038690 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-83887b05-c1a3-4efd-91cc-b1888e40760c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:23.039305 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-83887b05-c1a3-4efd-91cc-b1888e40760c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:23.045588 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-83887b05-c1a3-4efd-91cc-b1888e40760c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:23.046080 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-83887b05-c1a3-4efd-91cc-b1888e40760c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:23.046859 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-83887b05-c1a3-4efd-91cc-b1888e40760c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:23.047302 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-83887b05-c1a3-4efd-91cc-b1888e40760c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:23.106431 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-83887b05-c1a3-4efd-91cc-b1888e40760c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:23.114269 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-83887b05-c1a3-4efd-91cc-b1888e40760c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079441 Apr 08 11:24:23.114949 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 601/1204] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:23 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:23.137230 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-207371ab-7bcf-4070-a14d-15a86e48fdbf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:23.137899 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-207371ab-7bcf-4070-a14d-15a86e48fdbf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:23.144401 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-207371ab-7bcf-4070-a14d-15a86e48fdbf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:23.144851 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-207371ab-7bcf-4070-a14d-15a86e48fdbf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:23.145657 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-207371ab-7bcf-4070-a14d-15a86e48fdbf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:23.146693 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-207371ab-7bcf-4070-a14d-15a86e48fdbf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:23.274575 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8c99d706-9e31-4aec-aada-1a7c243e3e66 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:23.275465 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8c99d706-9e31-4aec-aada-1a7c243e3e66 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:23.281724 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8c99d706-9e31-4aec-aada-1a7c243e3e66 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:23.282203 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8c99d706-9e31-4aec-aada-1a7c243e3e66 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:23.282988 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8c99d706-9e31-4aec-aada-1a7c243e3e66 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:23.283424 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8c99d706-9e31-4aec-aada-1a7c243e3e66 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:23.287930 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-207371ab-7bcf-4070-a14d-15a86e48fdbf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:23.296257 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-207371ab-7bcf-4070-a14d-15a86e48fdbf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.162897 Apr 08 11:24:23.296861 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 604/1205] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:23 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:23.419667 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8c99d706-9e31-4aec-aada-1a7c243e3e66 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:23.428655 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8c99d706-9e31-4aec-aada-1a7c243e3e66 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:23.430225 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8c99d706-9e31-4aec-aada-1a7c243e3e66 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:23.431391 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8c99d706-9e31-4aec-aada-1a7c243e3e66 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.161388 Apr 08 11:24:23.431949 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 602/1206] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:23 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:24:23.757652 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-8e4e66fa-20ff-4923-b42f-e795e5e482f5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:23.758624 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-8e4e66fa-20ff-4923-b42f-e795e5e482f5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:23.764743 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8e4e66fa-20ff-4923-b42f-e795e5e482f5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:23.765201 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8e4e66fa-20ff-4923-b42f-e795e5e482f5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:23.766013 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8e4e66fa-20ff-4923-b42f-e795e5e482f5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:23.766461 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8e4e66fa-20ff-4923-b42f-e795e5e482f5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:23.794669 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-8e4e66fa-20ff-4923-b42f-e795e5e482f5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041050 Apr 08 11:24:23.795220 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 605/1207] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:23 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:24:24.131278 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-63935a5f-d41f-469d-9f96-461a97418628 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:24.131889 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-63935a5f-d41f-469d-9f96-461a97418628 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:24.138224 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-63935a5f-d41f-469d-9f96-461a97418628 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:24.138683 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-63935a5f-d41f-469d-9f96-461a97418628 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:24.139535 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-63935a5f-d41f-469d-9f96-461a97418628 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:24.139899 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-63935a5f-d41f-469d-9f96-461a97418628 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:24.197689 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-63935a5f-d41f-469d-9f96-461a97418628 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:24.205132 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-63935a5f-d41f-469d-9f96-461a97418628 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077752 Apr 08 11:24:24.205797 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 603/1208] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:24 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:24.313954 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-9fdd1ee7-6cb2-4033-9be7-eb6f1294dfa1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:24.314603 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-9fdd1ee7-6cb2-4033-9be7-eb6f1294dfa1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:24.321113 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9fdd1ee7-6cb2-4033-9be7-eb6f1294dfa1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:24.321561 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9fdd1ee7-6cb2-4033-9be7-eb6f1294dfa1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:24.322369 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9fdd1ee7-6cb2-4033-9be7-eb6f1294dfa1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:24.322864 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9fdd1ee7-6cb2-4033-9be7-eb6f1294dfa1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:24.451180 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-62017db0-8d36-4605-b0b2-882f4195c8cc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:24.451802 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-62017db0-8d36-4605-b0b2-882f4195c8cc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:24.457974 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-62017db0-8d36-4605-b0b2-882f4195c8cc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:24.458508 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-62017db0-8d36-4605-b0b2-882f4195c8cc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:24.459822 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-62017db0-8d36-4605-b0b2-882f4195c8cc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:24.460264 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-62017db0-8d36-4605-b0b2-882f4195c8cc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:24.467141 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-9fdd1ee7-6cb2-4033-9be7-eb6f1294dfa1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:24.475435 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-9fdd1ee7-6cb2-4033-9be7-eb6f1294dfa1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.165417 Apr 08 11:24:24.476092 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 606/1209] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:24 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:24.600381 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-62017db0-8d36-4605-b0b2-882f4195c8cc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:24.609140 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-62017db0-8d36-4605-b0b2-882f4195c8cc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:24.610692 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-62017db0-8d36-4605-b0b2-882f4195c8cc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:24.611936 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-62017db0-8d36-4605-b0b2-882f4195c8cc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.164666 Apr 08 11:24:24.612536 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 604/1210] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:24 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:24:24.806766 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-9f963a8e-547a-40c2-8511-44a37b3e4a43 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:24.807696 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-9f963a8e-547a-40c2-8511-44a37b3e4a43 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:24.813616 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9f963a8e-547a-40c2-8511-44a37b3e4a43 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:24.814097 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9f963a8e-547a-40c2-8511-44a37b3e4a43 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:24.814901 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9f963a8e-547a-40c2-8511-44a37b3e4a43 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:24.815332 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9f963a8e-547a-40c2-8511-44a37b3e4a43 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:24.844520 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-9f963a8e-547a-40c2-8511-44a37b3e4a43 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041553 Apr 08 11:24:24.845087 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 607/1211] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:24 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:25.222066 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f31d4870-96d1-49e3-a3fc-5ed6f0c44846 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:25.222703 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f31d4870-96d1-49e3-a3fc-5ed6f0c44846 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:25.229437 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f31d4870-96d1-49e3-a3fc-5ed6f0c44846 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:25.229909 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f31d4870-96d1-49e3-a3fc-5ed6f0c44846 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:25.231293 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f31d4870-96d1-49e3-a3fc-5ed6f0c44846 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:25.231293 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f31d4870-96d1-49e3-a3fc-5ed6f0c44846 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:25.289722 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f31d4870-96d1-49e3-a3fc-5ed6f0c44846 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:25.296965 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f31d4870-96d1-49e3-a3fc-5ed6f0c44846 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078802 Apr 08 11:24:25.297513 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 605/1212] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:25 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:25.493534 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a6c3cf62-5594-46fc-9a73-20e1586bacb5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:25.494087 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a6c3cf62-5594-46fc-9a73-20e1586bacb5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:25.500379 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a6c3cf62-5594-46fc-9a73-20e1586bacb5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:25.500834 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a6c3cf62-5594-46fc-9a73-20e1586bacb5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:25.501608 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a6c3cf62-5594-46fc-9a73-20e1586bacb5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:25.502159 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a6c3cf62-5594-46fc-9a73-20e1586bacb5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:25.630618 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8c62cf3c-a6c0-41e8-adb0-cf4aa0cf5e52 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:25.631238 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8c62cf3c-a6c0-41e8-adb0-cf4aa0cf5e52 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:25.637236 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8c62cf3c-a6c0-41e8-adb0-cf4aa0cf5e52 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:25.637690 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8c62cf3c-a6c0-41e8-adb0-cf4aa0cf5e52 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:25.638537 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8c62cf3c-a6c0-41e8-adb0-cf4aa0cf5e52 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:25.638982 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8c62cf3c-a6c0-41e8-adb0-cf4aa0cf5e52 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:25.646648 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a6c3cf62-5594-46fc-9a73-20e1586bacb5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:25.662266 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a6c3cf62-5594-46fc-9a73-20e1586bacb5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.172804 Apr 08 11:24:25.662987 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 608/1213] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:25 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:25.790763 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8c62cf3c-a6c0-41e8-adb0-cf4aa0cf5e52 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:25.799295 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8c62cf3c-a6c0-41e8-adb0-cf4aa0cf5e52 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:25.800815 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8c62cf3c-a6c0-41e8-adb0-cf4aa0cf5e52 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:25.802009 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8c62cf3c-a6c0-41e8-adb0-cf4aa0cf5e52 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.175420 Apr 08 11:24:25.802571 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 606/1214] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:25 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:24:25.856507 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-eada38d5-600f-4630-8be8-5f65212381ba tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:25.857432 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-eada38d5-600f-4630-8be8-5f65212381ba tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:25.863801 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-eada38d5-600f-4630-8be8-5f65212381ba tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:25.864255 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-eada38d5-600f-4630-8be8-5f65212381ba tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:25.865071 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-eada38d5-600f-4630-8be8-5f65212381ba tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:25.865541 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-eada38d5-600f-4630-8be8-5f65212381ba tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:25.894297 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-eada38d5-600f-4630-8be8-5f65212381ba tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041749 Apr 08 11:24:25.894859 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 609/1215] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:25 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:26.314221 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-24da0cc8-a04d-4732-b61b-b537def50f07 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:26.314821 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-24da0cc8-a04d-4732-b61b-b537def50f07 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:26.321519 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-24da0cc8-a04d-4732-b61b-b537def50f07 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:26.321994 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-24da0cc8-a04d-4732-b61b-b537def50f07 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:26.322775 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-24da0cc8-a04d-4732-b61b-b537def50f07 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:26.323208 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-24da0cc8-a04d-4732-b61b-b537def50f07 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:26.385425 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-24da0cc8-a04d-4732-b61b-b537def50f07 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:26.393134 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-24da0cc8-a04d-4732-b61b-b537def50f07 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082694 Apr 08 11:24:26.393709 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 607/1216] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:26 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:26.681145 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-7049b0a8-4e6d-45ec-8740-2a139414eab9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:26.681831 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-7049b0a8-4e6d-45ec-8740-2a139414eab9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:26.688314 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7049b0a8-4e6d-45ec-8740-2a139414eab9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:26.688870 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7049b0a8-4e6d-45ec-8740-2a139414eab9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:26.689531 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7049b0a8-4e6d-45ec-8740-2a139414eab9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:26.690021 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7049b0a8-4e6d-45ec-8740-2a139414eab9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:26.821435 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ae3d9ef8-e143-4580-bf9d-5776b7686f43 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:26.822099 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ae3d9ef8-e143-4580-bf9d-5776b7686f43 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:26.828800 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ae3d9ef8-e143-4580-bf9d-5776b7686f43 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:26.829250 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ae3d9ef8-e143-4580-bf9d-5776b7686f43 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:26.830093 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ae3d9ef8-e143-4580-bf9d-5776b7686f43 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:26.830530 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ae3d9ef8-e143-4580-bf9d-5776b7686f43 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:26.907918 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-7049b0a8-4e6d-45ec-8740-2a139414eab9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:26.916228 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-7049b0a8-4e6d-45ec-8740-2a139414eab9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.239533 Apr 08 11:24:26.917547 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 610/1217] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:26 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:26.922541 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-eefb97ae-38bf-4c8b-a9c2-f43e6e0e57c9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:26.923485 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-eefb97ae-38bf-4c8b-a9c2-f43e6e0e57c9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:26.930414 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-eefb97ae-38bf-4c8b-a9c2-f43e6e0e57c9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:26.930871 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-eefb97ae-38bf-4c8b-a9c2-f43e6e0e57c9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:26.931681 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-eefb97ae-38bf-4c8b-a9c2-f43e6e0e57c9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:26.932110 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-eefb97ae-38bf-4c8b-a9c2-f43e6e0e57c9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:26.964091 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-eefb97ae-38bf-4c8b-a9c2-f43e6e0e57c9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045286 Apr 08 11:24:26.964679 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 611/1218] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:26 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:26.985751 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ae3d9ef8-e143-4580-bf9d-5776b7686f43 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:26.995294 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ae3d9ef8-e143-4580-bf9d-5776b7686f43 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:26.996810 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ae3d9ef8-e143-4580-bf9d-5776b7686f43 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:26.998010 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ae3d9ef8-e143-4580-bf9d-5776b7686f43 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.181313 Apr 08 11:24:26.998576 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 608/1219] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:26 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:24:27.409747 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a8158c38-8603-4bda-91c5-44b33f4edcc6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:27.410388 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a8158c38-8603-4bda-91c5-44b33f4edcc6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:27.416831 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a8158c38-8603-4bda-91c5-44b33f4edcc6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:27.417285 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a8158c38-8603-4bda-91c5-44b33f4edcc6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:27.418084 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a8158c38-8603-4bda-91c5-44b33f4edcc6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:27.418528 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a8158c38-8603-4bda-91c5-44b33f4edcc6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:27.477671 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a8158c38-8603-4bda-91c5-44b33f4edcc6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:27.485207 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a8158c38-8603-4bda-91c5-44b33f4edcc6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079308 Apr 08 11:24:27.485787 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 612/1220] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:27 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:27.936077 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8afddc43-b63b-4e7f-85e0-89e74fb071da tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:27.936680 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8afddc43-b63b-4e7f-85e0-89e74fb071da tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:27.943167 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8afddc43-b63b-4e7f-85e0-89e74fb071da tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:27.943619 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8afddc43-b63b-4e7f-85e0-89e74fb071da tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:27.944445 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8afddc43-b63b-4e7f-85e0-89e74fb071da tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:27.945429 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8afddc43-b63b-4e7f-85e0-89e74fb071da tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:27.975679 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-0248fdb0-9a56-4a3b-897d-90f8132b072f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:27.976661 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-0248fdb0-9a56-4a3b-897d-90f8132b072f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:27.983288 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0248fdb0-9a56-4a3b-897d-90f8132b072f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:27.983738 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0248fdb0-9a56-4a3b-897d-90f8132b072f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:27.984529 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0248fdb0-9a56-4a3b-897d-90f8132b072f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:27.985001 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0248fdb0-9a56-4a3b-897d-90f8132b072f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:28.017756 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-0248fdb0-9a56-4a3b-897d-90f8132b072f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045939 Apr 08 11:24:28.021540 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 613/1221] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:27 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:24:28.027289 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-76cc35ad-68e3-4718-a9b8-b1ebc342d473 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:28.027491 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-76cc35ad-68e3-4718-a9b8-b1ebc342d473 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:28.033447 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-76cc35ad-68e3-4718-a9b8-b1ebc342d473 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:28.033949 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-76cc35ad-68e3-4718-a9b8-b1ebc342d473 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:28.034774 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-76cc35ad-68e3-4718-a9b8-b1ebc342d473 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:28.035218 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-76cc35ad-68e3-4718-a9b8-b1ebc342d473 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:28.111918 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8afddc43-b63b-4e7f-85e0-89e74fb071da tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:28.120681 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8afddc43-b63b-4e7f-85e0-89e74fb071da tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.188417 Apr 08 11:24:28.121392 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 609/1222] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:27 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:24:28.185885 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-76cc35ad-68e3-4718-a9b8-b1ebc342d473 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:28.194905 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-76cc35ad-68e3-4718-a9b8-b1ebc342d473 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:28.196494 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-76cc35ad-68e3-4718-a9b8-b1ebc342d473 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:28.197698 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-76cc35ad-68e3-4718-a9b8-b1ebc342d473 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.174854 Apr 08 11:24:28.198283 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 614/1223] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:28 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:24:28.502339 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-af9ca76a-45ee-4df5-a0da-0275ad3bf8f6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:28.502865 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-af9ca76a-45ee-4df5-a0da-0275ad3bf8f6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:28.509140 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-af9ca76a-45ee-4df5-a0da-0275ad3bf8f6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:28.509599 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-af9ca76a-45ee-4df5-a0da-0275ad3bf8f6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:28.510405 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-af9ca76a-45ee-4df5-a0da-0275ad3bf8f6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:28.510847 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-af9ca76a-45ee-4df5-a0da-0275ad3bf8f6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:28.569973 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-af9ca76a-45ee-4df5-a0da-0275ad3bf8f6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:28.577310 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-af9ca76a-45ee-4df5-a0da-0275ad3bf8f6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078876 Apr 08 11:24:28.577904 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 610/1224] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:28 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:29.029116 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-7b74b0ef-03b2-4170-9482-95ebeb03f0c0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:29.030170 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-7b74b0ef-03b2-4170-9482-95ebeb03f0c0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:29.036636 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7b74b0ef-03b2-4170-9482-95ebeb03f0c0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:29.037089 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7b74b0ef-03b2-4170-9482-95ebeb03f0c0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:29.037896 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7b74b0ef-03b2-4170-9482-95ebeb03f0c0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:29.038416 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7b74b0ef-03b2-4170-9482-95ebeb03f0c0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:29.066670 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-7b74b0ef-03b2-4170-9482-95ebeb03f0c0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041375 Apr 08 11:24:29.067267 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 615/1225] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:29 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:29.139000 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-42d22788-f45f-46c6-8b29-6ab8273a7197 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:29.139642 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-42d22788-f45f-46c6-8b29-6ab8273a7197 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:29.146097 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-42d22788-f45f-46c6-8b29-6ab8273a7197 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:29.146545 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-42d22788-f45f-46c6-8b29-6ab8273a7197 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:29.147321 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-42d22788-f45f-46c6-8b29-6ab8273a7197 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:29.148314 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-42d22788-f45f-46c6-8b29-6ab8273a7197 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:29.217607 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-cfa0302b-32ae-443f-8292-3c2e0ba47cfb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:29.217607 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-cfa0302b-32ae-443f-8292-3c2e0ba47cfb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:29.223729 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cfa0302b-32ae-443f-8292-3c2e0ba47cfb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:29.224167 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cfa0302b-32ae-443f-8292-3c2e0ba47cfb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:29.225019 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cfa0302b-32ae-443f-8292-3c2e0ba47cfb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:29.225412 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cfa0302b-32ae-443f-8292-3c2e0ba47cfb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:29.410195 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-42d22788-f45f-46c6-8b29-6ab8273a7197 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:29.420979 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-cfa0302b-32ae-443f-8292-3c2e0ba47cfb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:29.421563 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-42d22788-f45f-46c6-8b29-6ab8273a7197 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.286635 Apr 08 11:24:29.422608 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 611/1226] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:29 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:29.431407 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-cfa0302b-32ae-443f-8292-3c2e0ba47cfb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:29.432927 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-cfa0302b-32ae-443f-8292-3c2e0ba47cfb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:29.434767 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-cfa0302b-32ae-443f-8292-3c2e0ba47cfb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.222037 Apr 08 11:24:29.435335 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 616/1227] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:29 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:24:29.594730 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c40c20a0-3a7e-4d4f-b772-6119949e4c44 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:29.595298 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c40c20a0-3a7e-4d4f-b772-6119949e4c44 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:29.601959 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c40c20a0-3a7e-4d4f-b772-6119949e4c44 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:29.602411 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c40c20a0-3a7e-4d4f-b772-6119949e4c44 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:29.603188 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c40c20a0-3a7e-4d4f-b772-6119949e4c44 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:29.603635 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c40c20a0-3a7e-4d4f-b772-6119949e4c44 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:29.669149 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c40c20a0-3a7e-4d4f-b772-6119949e4c44 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:29.676932 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c40c20a0-3a7e-4d4f-b772-6119949e4c44 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.086301 Apr 08 11:24:29.677521 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 612/1228] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:29 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:30.079103 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-bd0f884a-d83b-4122-b974-dd8bbf063416 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:30.080036 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-bd0f884a-d83b-4122-b974-dd8bbf063416 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:30.086676 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bd0f884a-d83b-4122-b974-dd8bbf063416 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:30.087241 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bd0f884a-d83b-4122-b974-dd8bbf063416 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:30.088016 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bd0f884a-d83b-4122-b974-dd8bbf063416 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:30.088451 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bd0f884a-d83b-4122-b974-dd8bbf063416 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:30.126135 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-bd0f884a-d83b-4122-b974-dd8bbf063416 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050449 Apr 08 11:24:30.127051 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 617/1229] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:30 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:30.439926 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c14dcb92-8d3f-4e69-bbc7-f391cb99c37c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:30.440479 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c14dcb92-8d3f-4e69-bbc7-f391cb99c37c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:30.447269 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c14dcb92-8d3f-4e69-bbc7-f391cb99c37c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:30.447660 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c14dcb92-8d3f-4e69-bbc7-f391cb99c37c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:30.448469 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c14dcb92-8d3f-4e69-bbc7-f391cb99c37c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:30.448910 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c14dcb92-8d3f-4e69-bbc7-f391cb99c37c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:30.453378 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-5fec5ec2-fa3e-463d-8f26-cac0b0418b8a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:30.454028 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-5fec5ec2-fa3e-463d-8f26-cac0b0418b8a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:30.460035 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5fec5ec2-fa3e-463d-8f26-cac0b0418b8a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:30.460485 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5fec5ec2-fa3e-463d-8f26-cac0b0418b8a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:30.461265 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5fec5ec2-fa3e-463d-8f26-cac0b0418b8a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:30.461703 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5fec5ec2-fa3e-463d-8f26-cac0b0418b8a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:30.666322 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c14dcb92-8d3f-4e69-bbc7-f391cb99c37c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:30.675894 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c14dcb92-8d3f-4e69-bbc7-f391cb99c37c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.239660 Apr 08 11:24:30.680057 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-5fec5ec2-fa3e-463d-8f26-cac0b0418b8a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:30.685930 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 613/1230] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:30 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:30.690255 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-5fec5ec2-fa3e-463d-8f26-cac0b0418b8a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:30.691785 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-5fec5ec2-fa3e-463d-8f26-cac0b0418b8a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:30.692991 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-5fec5ec2-fa3e-463d-8f26-cac0b0418b8a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.244138 Apr 08 11:24:30.693722 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 618/1231] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:30 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:24:30.693868 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2d05d81f-db24-4483-894f-c88aeca681fa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:30.694214 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2d05d81f-db24-4483-894f-c88aeca681fa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:30.700237 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2d05d81f-db24-4483-894f-c88aeca681fa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:30.700689 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2d05d81f-db24-4483-894f-c88aeca681fa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:30.702202 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2d05d81f-db24-4483-894f-c88aeca681fa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:30.702643 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2d05d81f-db24-4483-894f-c88aeca681fa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:30.768046 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2d05d81f-db24-4483-894f-c88aeca681fa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:30.776768 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2d05d81f-db24-4483-894f-c88aeca681fa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.086993 Apr 08 11:24:30.777359 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 614/1232] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:30 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:24:31.139841 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-c8aaf5cb-8397-48ef-ab5a-0a6ba6f7c97a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:31.140883 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-c8aaf5cb-8397-48ef-ab5a-0a6ba6f7c97a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:31.147924 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c8aaf5cb-8397-48ef-ab5a-0a6ba6f7c97a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:31.148404 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c8aaf5cb-8397-48ef-ab5a-0a6ba6f7c97a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:31.149191 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c8aaf5cb-8397-48ef-ab5a-0a6ba6f7c97a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:31.149638 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c8aaf5cb-8397-48ef-ab5a-0a6ba6f7c97a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:31.184633 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-c8aaf5cb-8397-48ef-ab5a-0a6ba6f7c97a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048679 Apr 08 11:24:31.185425 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 619/1233] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:31 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:31.693239 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c10c2903-c3f9-4eee-97aa-b6054ea5ee08 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:31.693871 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c10c2903-c3f9-4eee-97aa-b6054ea5ee08 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:31.700868 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c10c2903-c3f9-4eee-97aa-b6054ea5ee08 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:31.701314 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c10c2903-c3f9-4eee-97aa-b6054ea5ee08 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:31.702119 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c10c2903-c3f9-4eee-97aa-b6054ea5ee08 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:31.702556 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c10c2903-c3f9-4eee-97aa-b6054ea5ee08 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:31.710711 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a03b900b-a5a5-466b-bbc7-82bfcd141d9b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:31.711323 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a03b900b-a5a5-466b-bbc7-82bfcd141d9b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:31.717459 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a03b900b-a5a5-466b-bbc7-82bfcd141d9b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:31.717955 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a03b900b-a5a5-466b-bbc7-82bfcd141d9b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:31.718743 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a03b900b-a5a5-466b-bbc7-82bfcd141d9b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:31.719301 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a03b900b-a5a5-466b-bbc7-82bfcd141d9b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:32.161258 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c10c2903-c3f9-4eee-97aa-b6054ea5ee08 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:32.170533 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c10c2903-c3f9-4eee-97aa-b6054ea5ee08 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.481075 Apr 08 11:24:32.171252 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 615/1234] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:31 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:32.177060 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a03b900b-a5a5-466b-bbc7-82bfcd141d9b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:32.180486 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-fc15a289-0ecb-41d9-8190-7e68f21d3620 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:32.181673 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-fc15a289-0ecb-41d9-8190-7e68f21d3620 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:32.191469 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fc15a289-0ecb-41d9-8190-7e68f21d3620 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:32.191926 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fc15a289-0ecb-41d9-8190-7e68f21d3620 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:32.192776 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fc15a289-0ecb-41d9-8190-7e68f21d3620 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:32.193249 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fc15a289-0ecb-41d9-8190-7e68f21d3620 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:32.193744 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a03b900b-a5a5-466b-bbc7-82bfcd141d9b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:32.196946 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a03b900b-a5a5-466b-bbc7-82bfcd141d9b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:32.199303 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a03b900b-a5a5-466b-bbc7-82bfcd141d9b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.492082 Apr 08 11:24:32.200342 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 620/1235] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:31 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:24:32.209165 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-0dc5c6ad-6c58-403b-90fb-b58423caacfc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:32.210305 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-0dc5c6ad-6c58-403b-90fb-b58423caacfc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:32.220137 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0dc5c6ad-6c58-403b-90fb-b58423caacfc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:32.220948 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0dc5c6ad-6c58-403b-90fb-b58423caacfc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:32.222357 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0dc5c6ad-6c58-403b-90fb-b58423caacfc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:32.223153 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0dc5c6ad-6c58-403b-90fb-b58423caacfc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:32.258563 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-0dc5c6ad-6c58-403b-90fb-b58423caacfc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057038 Apr 08 11:24:32.259148 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 621/1236] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:32 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:32.261990 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-fc15a289-0ecb-41d9-8190-7e68f21d3620 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:32.272833 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-fc15a289-0ecb-41d9-8190-7e68f21d3620 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.099565 Apr 08 11:24:32.273449 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 616/1237] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:32 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:33.198396 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a7d281c7-8393-4ad7-94bc-a3c1efdf442e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:33.199018 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a7d281c7-8393-4ad7-94bc-a3c1efdf442e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:33.205494 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a7d281c7-8393-4ad7-94bc-a3c1efdf442e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:33.205974 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a7d281c7-8393-4ad7-94bc-a3c1efdf442e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:33.206802 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a7d281c7-8393-4ad7-94bc-a3c1efdf442e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:33.207236 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a7d281c7-8393-4ad7-94bc-a3c1efdf442e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:33.219428 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2943b91e-2100-4d25-9546-bcb1b01060e6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:33.220044 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2943b91e-2100-4d25-9546-bcb1b01060e6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:33.227087 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2943b91e-2100-4d25-9546-bcb1b01060e6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:33.227548 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2943b91e-2100-4d25-9546-bcb1b01060e6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:33.228343 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2943b91e-2100-4d25-9546-bcb1b01060e6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:33.228786 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2943b91e-2100-4d25-9546-bcb1b01060e6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:33.399501 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a7d281c7-8393-4ad7-94bc-a3c1efdf442e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:33.406939 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a7d281c7-8393-4ad7-94bc-a3c1efdf442e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.212994 Apr 08 11:24:33.407523 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 622/1238] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:33 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:33.412156 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-b8aea010-6fb1-4268-8310-0998174b0bd0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:33.413646 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-b8aea010-6fb1-4268-8310-0998174b0bd0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:33.419425 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b8aea010-6fb1-4268-8310-0998174b0bd0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:33.419872 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b8aea010-6fb1-4268-8310-0998174b0bd0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:33.420649 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b8aea010-6fb1-4268-8310-0998174b0bd0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:33.421091 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b8aea010-6fb1-4268-8310-0998174b0bd0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:33.423691 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2943b91e-2100-4d25-9546-bcb1b01060e6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:33.432253 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2943b91e-2100-4d25-9546-bcb1b01060e6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:33.433810 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2943b91e-2100-4d25-9546-bcb1b01060e6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:33.434992 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2943b91e-2100-4d25-9546-bcb1b01060e6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.219498 Apr 08 11:24:33.435556 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 617/1239] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:33 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:24:33.440128 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-962b5910-58e2-4c3d-838f-fb56b352cc31 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:33.440731 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-962b5910-58e2-4c3d-838f-fb56b352cc31 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:33.447278 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-962b5910-58e2-4c3d-838f-fb56b352cc31 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:33.447735 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-962b5910-58e2-4c3d-838f-fb56b352cc31 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:33.448563 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-962b5910-58e2-4c3d-838f-fb56b352cc31 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:33.448947 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-962b5910-58e2-4c3d-838f-fb56b352cc31 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:33.451058 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-b8aea010-6fb1-4268-8310-0998174b0bd0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042504 Apr 08 11:24:33.451642 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 623/1240] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:33 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:33.509084 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-962b5910-58e2-4c3d-838f-fb56b352cc31 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:33.516368 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-962b5910-58e2-4c3d-838f-fb56b352cc31 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079867 Apr 08 11:24:33.516937 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 618/1241] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:33 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:34.425054 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-cdc34c68-8f5f-4518-9f27-cb4dd80a75ec tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:34.425679 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-cdc34c68-8f5f-4518-9f27-cb4dd80a75ec tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:34.432668 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cdc34c68-8f5f-4518-9f27-cb4dd80a75ec tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:34.433123 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cdc34c68-8f5f-4518-9f27-cb4dd80a75ec tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:34.433920 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cdc34c68-8f5f-4518-9f27-cb4dd80a75ec tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:34.434363 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cdc34c68-8f5f-4518-9f27-cb4dd80a75ec tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:34.454339 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b71db6de-5fcb-4ac9-9df6-25c196b624a7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:34.455344 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b71db6de-5fcb-4ac9-9df6-25c196b624a7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:34.463085 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b71db6de-5fcb-4ac9-9df6-25c196b624a7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:34.463551 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b71db6de-5fcb-4ac9-9df6-25c196b624a7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:34.464341 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b71db6de-5fcb-4ac9-9df6-25c196b624a7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:34.464787 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b71db6de-5fcb-4ac9-9df6-25c196b624a7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:34.632644 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-cdc34c68-8f5f-4518-9f27-cb4dd80a75ec tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:34.640051 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-cdc34c68-8f5f-4518-9f27-cb4dd80a75ec tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.218895 Apr 08 11:24:34.640839 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 624/1242] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:34 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:34.645316 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-cccddbd9-bd7a-4189-b80f-e248f43425dd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:34.646417 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-cccddbd9-bd7a-4189-b80f-e248f43425dd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:34.648577 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b71db6de-5fcb-4ac9-9df6-25c196b624a7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:34.653694 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cccddbd9-bd7a-4189-b80f-e248f43425dd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:34.654333 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cccddbd9-bd7a-4189-b80f-e248f43425dd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:34.655127 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cccddbd9-bd7a-4189-b80f-e248f43425dd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:34.655573 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cccddbd9-bd7a-4189-b80f-e248f43425dd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:34.657139 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b71db6de-5fcb-4ac9-9df6-25c196b624a7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:34.658683 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b71db6de-5fcb-4ac9-9df6-25c196b624a7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:34.659855 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b71db6de-5fcb-4ac9-9df6-25c196b624a7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.209853 Apr 08 11:24:34.660467 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 619/1243] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:34 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:24:34.665036 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7237181f-87fd-4ad6-a617-46c3e22c102e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:34.665642 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7237181f-87fd-4ad6-a617-46c3e22c102e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:34.672611 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7237181f-87fd-4ad6-a617-46c3e22c102e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:34.673071 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7237181f-87fd-4ad6-a617-46c3e22c102e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:34.673891 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7237181f-87fd-4ad6-a617-46c3e22c102e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:34.674338 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7237181f-87fd-4ad6-a617-46c3e22c102e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:34.685751 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-cccddbd9-bd7a-4189-b80f-e248f43425dd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043979 Apr 08 11:24:34.686256 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 625/1244] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:34 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:34.733406 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7237181f-87fd-4ad6-a617-46c3e22c102e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:34.741831 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7237181f-87fd-4ad6-a617-46c3e22c102e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080356 Apr 08 11:24:34.742398 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 620/1245] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:34 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:35.657761 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-b3a32aa7-66c6-4b10-93c8-b449b227180f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:35.658394 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-b3a32aa7-66c6-4b10-93c8-b449b227180f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:35.665198 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b3a32aa7-66c6-4b10-93c8-b449b227180f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:35.665698 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b3a32aa7-66c6-4b10-93c8-b449b227180f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:35.666454 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b3a32aa7-66c6-4b10-93c8-b449b227180f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:35.666979 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b3a32aa7-66c6-4b10-93c8-b449b227180f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:35.677932 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c42045e6-eb2c-4b86-ba4f-566b4a26c471 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:35.679154 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c42045e6-eb2c-4b86-ba4f-566b4a26c471 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:35.685425 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c42045e6-eb2c-4b86-ba4f-566b4a26c471 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:35.685929 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c42045e6-eb2c-4b86-ba4f-566b4a26c471 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:35.686707 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c42045e6-eb2c-4b86-ba4f-566b4a26c471 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:35.687151 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c42045e6-eb2c-4b86-ba4f-566b4a26c471 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:35.884391 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b3a32aa7-66c6-4b10-93c8-b449b227180f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:35.887680 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c42045e6-eb2c-4b86-ba4f-566b4a26c471 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:35.892489 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-b3a32aa7-66c6-4b10-93c8-b449b227180f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.238651 Apr 08 11:24:35.893064 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 626/1246] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:35 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:35.902249 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c42045e6-eb2c-4b86-ba4f-566b4a26c471 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:35.902249 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c42045e6-eb2c-4b86-ba4f-566b4a26c471 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:35.902249 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c42045e6-eb2c-4b86-ba4f-566b4a26c471 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.225445 Apr 08 11:24:35.902753 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 621/1247] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:35 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:24:35.907212 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6f5c0990-efe9-44c8-94d7-0a8f415995ea tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:35.908362 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-553d97c1-7a7b-42d2-bdb5-f0673d48a161 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:35.908494 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6f5c0990-efe9-44c8-94d7-0a8f415995ea tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:35.909314 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-553d97c1-7a7b-42d2-bdb5-f0673d48a161 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:35.915874 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6f5c0990-efe9-44c8-94d7-0a8f415995ea tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:35.916075 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-553d97c1-7a7b-42d2-bdb5-f0673d48a161 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:35.916338 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6f5c0990-efe9-44c8-94d7-0a8f415995ea tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:35.916480 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-553d97c1-7a7b-42d2-bdb5-f0673d48a161 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:35.917156 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6f5c0990-efe9-44c8-94d7-0a8f415995ea tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:35.917298 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-553d97c1-7a7b-42d2-bdb5-f0673d48a161 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:35.917603 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6f5c0990-efe9-44c8-94d7-0a8f415995ea tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:35.917730 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-553d97c1-7a7b-42d2-bdb5-f0673d48a161 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:35.948176 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6f5c0990-efe9-44c8-94d7-0a8f415995ea tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045063 Apr 08 11:24:35.948761 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 622/1248] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:35 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:35.980966 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-553d97c1-7a7b-42d2-bdb5-f0673d48a161 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:35.988337 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-553d97c1-7a7b-42d2-bdb5-f0673d48a161 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.084211 Apr 08 11:24:35.988897 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 627/1249] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:35 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:36.909753 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ec3b9177-7ab1-4dbe-bd54-6961ba21c3bf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:36.910378 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ec3b9177-7ab1-4dbe-bd54-6961ba21c3bf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:36.917346 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ec3b9177-7ab1-4dbe-bd54-6961ba21c3bf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:36.917808 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ec3b9177-7ab1-4dbe-bd54-6961ba21c3bf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:36.917938 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-9db0e84d-c030-4e67-be18-9ddbe344560d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:36.918517 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-9db0e84d-c030-4e67-be18-9ddbe344560d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:36.918629 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ec3b9177-7ab1-4dbe-bd54-6961ba21c3bf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:36.918997 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ec3b9177-7ab1-4dbe-bd54-6961ba21c3bf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:36.924873 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9db0e84d-c030-4e67-be18-9ddbe344560d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:36.925327 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9db0e84d-c030-4e67-be18-9ddbe344560d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:36.926135 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9db0e84d-c030-4e67-be18-9ddbe344560d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:36.926573 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9db0e84d-c030-4e67-be18-9ddbe344560d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:37.120739 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ec3b9177-7ab1-4dbe-bd54-6961ba21c3bf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:37.124819 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-9db0e84d-c030-4e67-be18-9ddbe344560d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:37.128206 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ec3b9177-7ab1-4dbe-bd54-6961ba21c3bf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.222350 Apr 08 11:24:37.128779 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 623/1250] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:36 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:37.133344 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-042f569e-3951-4c26-a65f-532b8a6f0099 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:37.133969 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-9db0e84d-c030-4e67-be18-9ddbe344560d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:37.134470 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-042f569e-3951-4c26-a65f-532b8a6f0099 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:37.135682 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-9db0e84d-c030-4e67-be18-9ddbe344560d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:37.137036 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-9db0e84d-c030-4e67-be18-9ddbe344560d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.222927 Apr 08 11:24:37.138665 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 628/1251] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:36 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:24:37.140977 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-042f569e-3951-4c26-a65f-532b8a6f0099 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:37.141422 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-042f569e-3951-4c26-a65f-532b8a6f0099 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:37.142235 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-042f569e-3951-4c26-a65f-532b8a6f0099 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:37.142757 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-042f569e-3951-4c26-a65f-532b8a6f0099 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:37.143559 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a18d4e10-61a2-4f7d-82cc-4a50d0575533 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:37.144174 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a18d4e10-61a2-4f7d-82cc-4a50d0575533 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:37.150802 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a18d4e10-61a2-4f7d-82cc-4a50d0575533 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:37.151249 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a18d4e10-61a2-4f7d-82cc-4a50d0575533 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:37.152019 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a18d4e10-61a2-4f7d-82cc-4a50d0575533 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:37.152461 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a18d4e10-61a2-4f7d-82cc-4a50d0575533 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:37.173825 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-042f569e-3951-4c26-a65f-532b8a6f0099 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043883 Apr 08 11:24:37.174445 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 624/1252] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:37 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:37.213668 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a18d4e10-61a2-4f7d-82cc-4a50d0575533 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:37.221039 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a18d4e10-61a2-4f7d-82cc-4a50d0575533 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081414 Apr 08 11:24:37.221602 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 629/1253] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:37 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:38.145527 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a3ffeaeb-6bad-4c51-b220-b0ed712a4732 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:38.146180 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a3ffeaeb-6bad-4c51-b220-b0ed712a4732 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:38.152829 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a3ffeaeb-6bad-4c51-b220-b0ed712a4732 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:38.153285 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a3ffeaeb-6bad-4c51-b220-b0ed712a4732 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:38.154109 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a3ffeaeb-6bad-4c51-b220-b0ed712a4732 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:38.154555 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a3ffeaeb-6bad-4c51-b220-b0ed712a4732 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:38.155223 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-fefd5210-8019-40fa-b9bb-d59790081ffe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:38.155863 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-fefd5210-8019-40fa-b9bb-d59790081ffe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:38.162367 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fefd5210-8019-40fa-b9bb-d59790081ffe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:38.163323 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fefd5210-8019-40fa-b9bb-d59790081ffe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:38.164084 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fefd5210-8019-40fa-b9bb-d59790081ffe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:38.164514 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fefd5210-8019-40fa-b9bb-d59790081ffe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:38.359009 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a3ffeaeb-6bad-4c51-b220-b0ed712a4732 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:38.362945 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-fefd5210-8019-40fa-b9bb-d59790081ffe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:38.366660 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a3ffeaeb-6bad-4c51-b220-b0ed712a4732 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.225005 Apr 08 11:24:38.367243 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 625/1254] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:38 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:38.377990 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-fefd5210-8019-40fa-b9bb-d59790081ffe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:38.379506 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-fefd5210-8019-40fa-b9bb-d59790081ffe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:38.380739 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-fefd5210-8019-40fa-b9bb-d59790081ffe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.229548 Apr 08 11:24:38.381331 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 630/1255] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:38 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:24:38.385759 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-4da00c6c-9a0d-48ed-8325-e00522392c56 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:38.386411 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-4da00c6c-9a0d-48ed-8325-e00522392c56 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:38.392236 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4da00c6c-9a0d-48ed-8325-e00522392c56 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:38.392690 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4da00c6c-9a0d-48ed-8325-e00522392c56 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:38.393465 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4da00c6c-9a0d-48ed-8325-e00522392c56 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:38.393935 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4da00c6c-9a0d-48ed-8325-e00522392c56 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:38.438020 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0b544c2f-ae17-4686-89d2-efc87c7b9944 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:38.439022 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0b544c2f-ae17-4686-89d2-efc87c7b9944 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:38.444882 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0b544c2f-ae17-4686-89d2-efc87c7b9944 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:38.445333 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0b544c2f-ae17-4686-89d2-efc87c7b9944 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:38.446133 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0b544c2f-ae17-4686-89d2-efc87c7b9944 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:38.446572 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0b544c2f-ae17-4686-89d2-efc87c7b9944 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:38.453595 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-4da00c6c-9a0d-48ed-8325-e00522392c56 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:38.461311 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-4da00c6c-9a0d-48ed-8325-e00522392c56 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078988 Apr 08 11:24:38.462107 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 631/1256] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:38 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:38.475471 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0b544c2f-ae17-4686-89d2-efc87c7b9944 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106899 Apr 08 11:24:38.476032 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 626/1257] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:38 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:39.384552 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-9eae6a37-619c-458a-b22f-9ad56b37044a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:39.385163 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-9eae6a37-619c-458a-b22f-9ad56b37044a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:39.391457 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9eae6a37-619c-458a-b22f-9ad56b37044a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:39.391914 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9eae6a37-619c-458a-b22f-9ad56b37044a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:39.392688 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9eae6a37-619c-458a-b22f-9ad56b37044a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:39.393168 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9eae6a37-619c-458a-b22f-9ad56b37044a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:39.398167 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-92751736-47e0-49e3-be94-cd3d8136c859 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:39.399019 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-92751736-47e0-49e3-be94-cd3d8136c859 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:39.405305 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-92751736-47e0-49e3-be94-cd3d8136c859 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:39.405776 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-92751736-47e0-49e3-be94-cd3d8136c859 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:39.406577 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-92751736-47e0-49e3-be94-cd3d8136c859 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:39.407022 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-92751736-47e0-49e3-be94-cd3d8136c859 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:39.598612 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-9eae6a37-619c-458a-b22f-9ad56b37044a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:39.602460 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-92751736-47e0-49e3-be94-cd3d8136c859 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:39.606592 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-9eae6a37-619c-458a-b22f-9ad56b37044a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.226436 Apr 08 11:24:39.607165 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 632/1258] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:39 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:39.610897 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-92751736-47e0-49e3-be94-cd3d8136c859 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:39.611682 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-4e8ffd83-e97d-4a76-84b0-a36e2cbb2c72 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:39.612327 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-4e8ffd83-e97d-4a76-84b0-a36e2cbb2c72 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:39.612446 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-92751736-47e0-49e3-be94-cd3d8136c859 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:39.613628 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-92751736-47e0-49e3-be94-cd3d8136c859 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.219351 Apr 08 11:24:39.616907 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 627/1259] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:39 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:24:39.619014 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4e8ffd83-e97d-4a76-84b0-a36e2cbb2c72 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:39.619471 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4e8ffd83-e97d-4a76-84b0-a36e2cbb2c72 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:39.620254 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4e8ffd83-e97d-4a76-84b0-a36e2cbb2c72 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:39.620695 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4e8ffd83-e97d-4a76-84b0-a36e2cbb2c72 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:39.620815 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ad4b2700-e349-4134-857f-bbbed951fac0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:39.621674 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ad4b2700-e349-4134-857f-bbbed951fac0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:39.629989 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ad4b2700-e349-4134-857f-bbbed951fac0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:39.631075 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ad4b2700-e349-4134-857f-bbbed951fac0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:39.631220 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ad4b2700-e349-4134-857f-bbbed951fac0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:39.631688 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ad4b2700-e349-4134-857f-bbbed951fac0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:39.663484 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ad4b2700-e349-4134-857f-bbbed951fac0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047725 Apr 08 11:24:39.664164 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 628/1260] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:39 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:39.683971 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-4e8ffd83-e97d-4a76-84b0-a36e2cbb2c72 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:39.691262 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-4e8ffd83-e97d-4a76-84b0-a36e2cbb2c72 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.083153 Apr 08 11:24:39.691826 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 633/1261] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:39 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:40.496309 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 11:24:40.497006 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: Fri Apr 8 11:24:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 11:24:40.624068 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-39575b96-4178-4278-8bdd-93f24c5d9335 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:40.624764 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-39575b96-4178-4278-8bdd-93f24c5d9335 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:40.634469 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e7bac387-c8d3-4380-acc9-48c3dad1a074 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:40.635178 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e7bac387-c8d3-4380-acc9-48c3dad1a074 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:40.637008 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-39575b96-4178-4278-8bdd-93f24c5d9335 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:40.638287 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-39575b96-4178-4278-8bdd-93f24c5d9335 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:40.640256 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-39575b96-4178-4278-8bdd-93f24c5d9335 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:40.641043 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-39575b96-4178-4278-8bdd-93f24c5d9335 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:40.642331 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e7bac387-c8d3-4380-acc9-48c3dad1a074 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:40.642891 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e7bac387-c8d3-4380-acc9-48c3dad1a074 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:40.643742 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e7bac387-c8d3-4380-acc9-48c3dad1a074 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:40.644256 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e7bac387-c8d3-4380-acc9-48c3dad1a074 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:40.845633 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e7bac387-c8d3-4380-acc9-48c3dad1a074 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:40.849723 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-39575b96-4178-4278-8bdd-93f24c5d9335 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:40.854358 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e7bac387-c8d3-4380-acc9-48c3dad1a074 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:40.855859 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e7bac387-c8d3-4380-acc9-48c3dad1a074 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:40.857026 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e7bac387-c8d3-4380-acc9-48c3dad1a074 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.227277 Apr 08 11:24:40.857339 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-39575b96-4178-4278-8bdd-93f24c5d9335 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.237196 Apr 08 11:24:40.857580 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 634/1262] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:40 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:24:40.859034 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 629/1263] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:40 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:40.862871 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-124208c9-7973-4e27-9f1f-5c41cf2a88ff tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:40.863101 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-d36643b2-0bc2-46bc-ad26-de0e175aa92f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:40.863491 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-124208c9-7973-4e27-9f1f-5c41cf2a88ff tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:40.864350 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-d36643b2-0bc2-46bc-ad26-de0e175aa92f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:40.870629 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-124208c9-7973-4e27-9f1f-5c41cf2a88ff tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:40.871087 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-124208c9-7973-4e27-9f1f-5c41cf2a88ff tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:40.871915 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-124208c9-7973-4e27-9f1f-5c41cf2a88ff tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:40.872360 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-124208c9-7973-4e27-9f1f-5c41cf2a88ff tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:40.872511 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d36643b2-0bc2-46bc-ad26-de0e175aa92f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:40.872973 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d36643b2-0bc2-46bc-ad26-de0e175aa92f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:40.873750 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d36643b2-0bc2-46bc-ad26-de0e175aa92f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:40.874219 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d36643b2-0bc2-46bc-ad26-de0e175aa92f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:40.903928 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-d36643b2-0bc2-46bc-ad26-de0e175aa92f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045276 Apr 08 11:24:40.904503 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 635/1264] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:40 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:40.938148 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-124208c9-7973-4e27-9f1f-5c41cf2a88ff tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:40.945725 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-124208c9-7973-4e27-9f1f-5c41cf2a88ff tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.086770 Apr 08 11:24:40.946313 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 630/1265] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:40 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:41.876332 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a5c2ef11-7614-4fa7-a8d8-4fe73585ad78 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:41.876758 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-da29085d-7083-4dad-9143-79ea4c7e335c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:41.877262 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-da29085d-7083-4dad-9143-79ea4c7e335c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:41.877344 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a5c2ef11-7614-4fa7-a8d8-4fe73585ad78 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:41.884029 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a5c2ef11-7614-4fa7-a8d8-4fe73585ad78 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:41.884250 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-da29085d-7083-4dad-9143-79ea4c7e335c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:41.884476 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-da29085d-7083-4dad-9143-79ea4c7e335c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:41.884588 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a5c2ef11-7614-4fa7-a8d8-4fe73585ad78 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:41.885294 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a5c2ef11-7614-4fa7-a8d8-4fe73585ad78 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:41.885423 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-da29085d-7083-4dad-9143-79ea4c7e335c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:41.885736 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a5c2ef11-7614-4fa7-a8d8-4fe73585ad78 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:41.885881 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-da29085d-7083-4dad-9143-79ea4c7e335c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:42.061348 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a5c2ef11-7614-4fa7-a8d8-4fe73585ad78 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:42.070127 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a5c2ef11-7614-4fa7-a8d8-4fe73585ad78 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.197543 Apr 08 11:24:42.070716 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 636/1266] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:41 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:42.075432 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-515b8e0f-287f-442b-a58d-0ab2a380e676 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:42.076363 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-515b8e0f-287f-442b-a58d-0ab2a380e676 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:42.082416 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-515b8e0f-287f-442b-a58d-0ab2a380e676 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:42.082864 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-515b8e0f-287f-442b-a58d-0ab2a380e676 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:42.083637 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-515b8e0f-287f-442b-a58d-0ab2a380e676 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:42.084074 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-515b8e0f-287f-442b-a58d-0ab2a380e676 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:42.114510 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-515b8e0f-287f-442b-a58d-0ab2a380e676 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042672 Apr 08 11:24:42.115079 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 637/1267] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:42 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:42.120503 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2aa189dd-e198-425c-b8b7-f9424cac72ef tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:42.121109 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-2aa189dd-e198-425c-b8b7-f9424cac72ef tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:42.125125 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-da29085d-7083-4dad-9143-79ea4c7e335c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:42.127096 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2aa189dd-e198-425c-b8b7-f9424cac72ef tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:42.127547 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2aa189dd-e198-425c-b8b7-f9424cac72ef tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:42.128362 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2aa189dd-e198-425c-b8b7-f9424cac72ef tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:42.128889 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2aa189dd-e198-425c-b8b7-f9424cac72ef tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:42.134293 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-da29085d-7083-4dad-9143-79ea4c7e335c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:42.135815 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-da29085d-7083-4dad-9143-79ea4c7e335c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:42.136999 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-da29085d-7083-4dad-9143-79ea4c7e335c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.264588 Apr 08 11:24:42.137561 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 631/1268] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:41 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:24:42.192174 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2aa189dd-e198-425c-b8b7-f9424cac72ef tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:42.200260 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-2aa189dd-e198-425c-b8b7-f9424cac72ef tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.083585 Apr 08 11:24:42.200826 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 638/1269] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:42 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:43.088206 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a947da98-45d5-437f-bf8d-f5dfc614c3b3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:43.088815 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a947da98-45d5-437f-bf8d-f5dfc614c3b3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:43.095254 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a947da98-45d5-437f-bf8d-f5dfc614c3b3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:43.095708 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a947da98-45d5-437f-bf8d-f5dfc614c3b3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:43.096494 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a947da98-45d5-437f-bf8d-f5dfc614c3b3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:43.096935 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a947da98-45d5-437f-bf8d-f5dfc614c3b3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:43.126800 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e9c61ced-ac43-4e86-8c5c-123161fbd607 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:43.127732 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e9c61ced-ac43-4e86-8c5c-123161fbd607 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:43.134698 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e9c61ced-ac43-4e86-8c5c-123161fbd607 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:43.135152 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e9c61ced-ac43-4e86-8c5c-123161fbd607 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:43.135958 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e9c61ced-ac43-4e86-8c5c-123161fbd607 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:43.136413 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e9c61ced-ac43-4e86-8c5c-123161fbd607 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:43.166518 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e9c61ced-ac43-4e86-8c5c-123161fbd607 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043555 Apr 08 11:24:43.167103 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 639/1270] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:43 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:43.171644 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-068288dc-7b86-4d73-a629-5652c35d689e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:43.172263 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-068288dc-7b86-4d73-a629-5652c35d689e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:43.178133 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-068288dc-7b86-4d73-a629-5652c35d689e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:43.178548 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-068288dc-7b86-4d73-a629-5652c35d689e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:43.179333 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-068288dc-7b86-4d73-a629-5652c35d689e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:43.179766 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-068288dc-7b86-4d73-a629-5652c35d689e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:43.258660 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a947da98-45d5-437f-bf8d-f5dfc614c3b3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:43.266048 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a947da98-45d5-437f-bf8d-f5dfc614c3b3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.182671 Apr 08 11:24:43.266835 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 632/1271] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:43 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:43.271136 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e57e9111-e6c4-4c38-911d-9e070175b6ef tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:43.271807 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e57e9111-e6c4-4c38-911d-9e070175b6ef tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:43.278185 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e57e9111-e6c4-4c38-911d-9e070175b6ef tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:43.278639 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e57e9111-e6c4-4c38-911d-9e070175b6ef tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:43.279419 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e57e9111-e6c4-4c38-911d-9e070175b6ef tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:43.279857 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e57e9111-e6c4-4c38-911d-9e070175b6ef tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:43.357075 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e57e9111-e6c4-4c38-911d-9e070175b6ef tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:43.361187 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-068288dc-7b86-4d73-a629-5652c35d689e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:43.364822 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e57e9111-e6c4-4c38-911d-9e070175b6ef tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.097195 Apr 08 11:24:43.365412 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 633/1272] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:43 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:43.369943 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-068288dc-7b86-4d73-a629-5652c35d689e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:43.371433 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-068288dc-7b86-4d73-a629-5652c35d689e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:43.372588 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-068288dc-7b86-4d73-a629-5652c35d689e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.204579 Apr 08 11:24:43.373132 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 640/1273] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:43 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:24:44.178519 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3a511115-6924-4247-9b8d-66dff20965ab tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:44.179494 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3a511115-6924-4247-9b8d-66dff20965ab tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:44.185836 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3a511115-6924-4247-9b8d-66dff20965ab tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:44.186285 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3a511115-6924-4247-9b8d-66dff20965ab tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:44.187045 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3a511115-6924-4247-9b8d-66dff20965ab tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:44.187478 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3a511115-6924-4247-9b8d-66dff20965ab tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:44.216930 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3a511115-6924-4247-9b8d-66dff20965ab tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042705 Apr 08 11:24:44.217488 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 634/1274] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:44 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:44.283850 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-79c50165-8830-4a53-932e-dc437a3dadce tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:44.284497 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-79c50165-8830-4a53-932e-dc437a3dadce tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:44.290946 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-79c50165-8830-4a53-932e-dc437a3dadce tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:44.291402 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-79c50165-8830-4a53-932e-dc437a3dadce tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:44.292181 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-79c50165-8830-4a53-932e-dc437a3dadce tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:44.292626 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-79c50165-8830-4a53-932e-dc437a3dadce tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:44.382362 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7b718832-991e-4674-99d2-bde295e147fa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:44.382986 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7b718832-991e-4674-99d2-bde295e147fa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:44.389124 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7b718832-991e-4674-99d2-bde295e147fa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:44.389577 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7b718832-991e-4674-99d2-bde295e147fa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:44.390396 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7b718832-991e-4674-99d2-bde295e147fa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:44.390839 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7b718832-991e-4674-99d2-bde295e147fa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:44.436561 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-79c50165-8830-4a53-932e-dc437a3dadce tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:44.444627 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-79c50165-8830-4a53-932e-dc437a3dadce tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.164094 Apr 08 11:24:44.447795 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 641/1275] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:44 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:44.449807 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-8e3e4ea1-75ec-4a7e-958a-4a777f538c7b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:44.450411 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-8e3e4ea1-75ec-4a7e-958a-4a777f538c7b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:44.455955 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7b718832-991e-4674-99d2-bde295e147fa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:44.457160 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8e3e4ea1-75ec-4a7e-958a-4a777f538c7b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:44.457628 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8e3e4ea1-75ec-4a7e-958a-4a777f538c7b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:44.458440 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8e3e4ea1-75ec-4a7e-958a-4a777f538c7b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:44.458913 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8e3e4ea1-75ec-4a7e-958a-4a777f538c7b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:44.463327 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7b718832-991e-4674-99d2-bde295e147fa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.085387 Apr 08 11:24:44.464089 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 635/1276] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:44 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:24:44.593665 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-8e3e4ea1-75ec-4a7e-958a-4a777f538c7b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:44.601791 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-8e3e4ea1-75ec-4a7e-958a-4a777f538c7b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:44.603278 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-8e3e4ea1-75ec-4a7e-958a-4a777f538c7b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:44.604417 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-8e3e4ea1-75ec-4a7e-958a-4a777f538c7b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.158263 Apr 08 11:24:44.604978 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 642/1277] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:44 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:24:45.228716 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8c71d30c-fa22-43d4-8397-670aa0447df8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:45.229631 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8c71d30c-fa22-43d4-8397-670aa0447df8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:45.236037 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8c71d30c-fa22-43d4-8397-670aa0447df8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:45.236489 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8c71d30c-fa22-43d4-8397-670aa0447df8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:45.237270 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8c71d30c-fa22-43d4-8397-670aa0447df8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:45.237734 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8c71d30c-fa22-43d4-8397-670aa0447df8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:45.266448 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8c71d30c-fa22-43d4-8397-670aa0447df8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042197 Apr 08 11:24:45.267073 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 636/1278] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:45 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:45.462562 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-931908e5-5813-429d-a004-55fbe9aea11e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:45.463190 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-931908e5-5813-429d-a004-55fbe9aea11e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:45.469484 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-931908e5-5813-429d-a004-55fbe9aea11e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:45.469973 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-931908e5-5813-429d-a004-55fbe9aea11e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:45.470750 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-931908e5-5813-429d-a004-55fbe9aea11e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:45.471193 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-931908e5-5813-429d-a004-55fbe9aea11e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:45.480155 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4dca349a-7096-4c03-9a29-f0de6f23c0fc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:45.480698 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4dca349a-7096-4c03-9a29-f0de6f23c0fc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:45.486583 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4dca349a-7096-4c03-9a29-f0de6f23c0fc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:45.487198 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4dca349a-7096-4c03-9a29-f0de6f23c0fc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:45.487799 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4dca349a-7096-4c03-9a29-f0de6f23c0fc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:45.488242 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4dca349a-7096-4c03-9a29-f0de6f23c0fc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:45.559867 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4dca349a-7096-4c03-9a29-f0de6f23c0fc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:45.567393 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4dca349a-7096-4c03-9a29-f0de6f23c0fc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.091033 Apr 08 11:24:45.567978 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 637/1279] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:45 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:24:45.622713 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d7fd8d31-ab26-44f3-bff3-47037c6daad3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:45.623333 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d7fd8d31-ab26-44f3-bff3-47037c6daad3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:45.629167 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d7fd8d31-ab26-44f3-bff3-47037c6daad3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:45.629657 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d7fd8d31-ab26-44f3-bff3-47037c6daad3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:45.630439 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d7fd8d31-ab26-44f3-bff3-47037c6daad3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:45.630886 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d7fd8d31-ab26-44f3-bff3-47037c6daad3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:45.632856 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-931908e5-5813-429d-a004-55fbe9aea11e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:45.641034 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-931908e5-5813-429d-a004-55fbe9aea11e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.182933 Apr 08 11:24:45.641888 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 643/1280] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:45 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:45.773641 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d7fd8d31-ab26-44f3-bff3-47037c6daad3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:45.781978 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d7fd8d31-ab26-44f3-bff3-47037c6daad3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:45.783495 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d7fd8d31-ab26-44f3-bff3-47037c6daad3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:45.784658 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d7fd8d31-ab26-44f3-bff3-47037c6daad3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.165870 Apr 08 11:24:45.785223 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 638/1281] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:45 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:24:46.278105 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-01c13ab2-8aa1-49f2-beb9-d992bedabfc8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:46.279042 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-01c13ab2-8aa1-49f2-beb9-d992bedabfc8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:46.284968 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-01c13ab2-8aa1-49f2-beb9-d992bedabfc8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:46.285419 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-01c13ab2-8aa1-49f2-beb9-d992bedabfc8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:46.286225 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-01c13ab2-8aa1-49f2-beb9-d992bedabfc8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:46.286668 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-01c13ab2-8aa1-49f2-beb9-d992bedabfc8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:46.315320 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-01c13ab2-8aa1-49f2-beb9-d992bedabfc8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041214 Apr 08 11:24:46.315892 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 644/1282] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:46 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:46.585144 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-00c150ae-058e-4b89-bc9c-02c31f179dec tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:46.585693 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-00c150ae-058e-4b89-bc9c-02c31f179dec tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:46.591987 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-00c150ae-058e-4b89-bc9c-02c31f179dec tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:46.592435 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-00c150ae-058e-4b89-bc9c-02c31f179dec tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:46.593211 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-00c150ae-058e-4b89-bc9c-02c31f179dec tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:46.593645 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-00c150ae-058e-4b89-bc9c-02c31f179dec tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:46.654709 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-00c150ae-058e-4b89-bc9c-02c31f179dec tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:46.658481 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2e1f45a6-4440-4b38-bf94-6a3fb8a4965f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:46.659096 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-2e1f45a6-4440-4b38-bf94-6a3fb8a4965f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:46.663076 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-00c150ae-058e-4b89-bc9c-02c31f179dec tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081781 Apr 08 11:24:46.663661 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 639/1283] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:46 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:46.665987 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2e1f45a6-4440-4b38-bf94-6a3fb8a4965f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:46.666449 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2e1f45a6-4440-4b38-bf94-6a3fb8a4965f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:46.667223 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2e1f45a6-4440-4b38-bf94-6a3fb8a4965f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:46.667661 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2e1f45a6-4440-4b38-bf94-6a3fb8a4965f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:46.802748 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-041c4c8a-1c7c-4015-a0e0-5b05e0b5cba7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:46.803367 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-041c4c8a-1c7c-4015-a0e0-5b05e0b5cba7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:46.807549 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2e1f45a6-4440-4b38-bf94-6a3fb8a4965f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:46.809356 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-041c4c8a-1c7c-4015-a0e0-5b05e0b5cba7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:46.809847 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-041c4c8a-1c7c-4015-a0e0-5b05e0b5cba7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:46.810639 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-041c4c8a-1c7c-4015-a0e0-5b05e0b5cba7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:46.811103 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-041c4c8a-1c7c-4015-a0e0-5b05e0b5cba7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:46.814907 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-2e1f45a6-4440-4b38-bf94-6a3fb8a4965f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.160291 Apr 08 11:24:46.815496 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 645/1284] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:46 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:24:46.945117 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-041c4c8a-1c7c-4015-a0e0-5b05e0b5cba7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:46.953359 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-041c4c8a-1c7c-4015-a0e0-5b05e0b5cba7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:46.954948 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-041c4c8a-1c7c-4015-a0e0-5b05e0b5cba7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:46.956116 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-041c4c8a-1c7c-4015-a0e0-5b05e0b5cba7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.157301 Apr 08 11:24:46.956675 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 640/1285] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:46 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:24:47.327014 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-7f61d55f-06c9-409b-aaba-b77917b725f1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:47.327939 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-7f61d55f-06c9-409b-aaba-b77917b725f1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:47.333799 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7f61d55f-06c9-409b-aaba-b77917b725f1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:47.334254 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7f61d55f-06c9-409b-aaba-b77917b725f1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:47.335010 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7f61d55f-06c9-409b-aaba-b77917b725f1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:47.335443 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7f61d55f-06c9-409b-aaba-b77917b725f1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:47.362581 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-7f61d55f-06c9-409b-aaba-b77917b725f1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039576 Apr 08 11:24:47.363116 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 646/1286] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:47 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:47.680576 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e52f9d41-f08e-45f3-b063-a46e9bcacefa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:47.681187 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e52f9d41-f08e-45f3-b063-a46e9bcacefa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:47.687522 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e52f9d41-f08e-45f3-b063-a46e9bcacefa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:47.687967 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e52f9d41-f08e-45f3-b063-a46e9bcacefa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:47.688724 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e52f9d41-f08e-45f3-b063-a46e9bcacefa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:47.689157 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e52f9d41-f08e-45f3-b063-a46e9bcacefa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:47.756915 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e52f9d41-f08e-45f3-b063-a46e9bcacefa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:47.758029 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e52f9d41-f08e-45f3-b063-a46e9bcacefa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081954 Apr 08 11:24:47.758598 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 641/1287] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:47 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:47.831326 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-149182b8-08d6-45c9-8ecd-4365981f0ad5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:47.831944 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-149182b8-08d6-45c9-8ecd-4365981f0ad5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:47.841959 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-149182b8-08d6-45c9-8ecd-4365981f0ad5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:47.842452 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-149182b8-08d6-45c9-8ecd-4365981f0ad5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:47.843245 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-149182b8-08d6-45c9-8ecd-4365981f0ad5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:47.843688 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-149182b8-08d6-45c9-8ecd-4365981f0ad5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:47.975455 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b610c749-fd53-4f16-a715-b296ab96a942 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:47.976150 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b610c749-fd53-4f16-a715-b296ab96a942 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:47.977126 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-149182b8-08d6-45c9-8ecd-4365981f0ad5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:47.982682 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b610c749-fd53-4f16-a715-b296ab96a942 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:47.983129 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b610c749-fd53-4f16-a715-b296ab96a942 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:47.984336 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b610c749-fd53-4f16-a715-b296ab96a942 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:47.984336 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b610c749-fd53-4f16-a715-b296ab96a942 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:47.988511 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-149182b8-08d6-45c9-8ecd-4365981f0ad5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.160971 Apr 08 11:24:47.989095 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 647/1288] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:47 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:48.122570 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b610c749-fd53-4f16-a715-b296ab96a942 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:48.130849 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b610c749-fd53-4f16-a715-b296ab96a942 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:48.132366 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b610c749-fd53-4f16-a715-b296ab96a942 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:48.133522 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b610c749-fd53-4f16-a715-b296ab96a942 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.162653 Apr 08 11:24:48.134131 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 642/1289] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:47 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:24:48.374761 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-af1f5cc9-09df-470b-b6d8-e9d566970579 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:48.375724 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-af1f5cc9-09df-470b-b6d8-e9d566970579 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:48.382098 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-af1f5cc9-09df-470b-b6d8-e9d566970579 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:48.382551 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-af1f5cc9-09df-470b-b6d8-e9d566970579 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:48.383309 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-af1f5cc9-09df-470b-b6d8-e9d566970579 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:48.383744 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-af1f5cc9-09df-470b-b6d8-e9d566970579 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:48.414736 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-af1f5cc9-09df-470b-b6d8-e9d566970579 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042305 Apr 08 11:24:48.414736 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 648/1290] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:48 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:48.774737 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-29a778ba-2bc0-4ce0-9767-11794a36031b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:48.775355 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-29a778ba-2bc0-4ce0-9767-11794a36031b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:48.781855 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-29a778ba-2bc0-4ce0-9767-11794a36031b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:48.782313 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-29a778ba-2bc0-4ce0-9767-11794a36031b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:48.783090 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-29a778ba-2bc0-4ce0-9767-11794a36031b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:48.783532 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-29a778ba-2bc0-4ce0-9767-11794a36031b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:48.843088 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-29a778ba-2bc0-4ce0-9767-11794a36031b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:48.850679 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-29a778ba-2bc0-4ce0-9767-11794a36031b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080388 Apr 08 11:24:48.851256 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 643/1291] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:48 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:49.007498 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e1a9e727-c66c-470d-b248-b552733fa5d3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:49.008156 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e1a9e727-c66c-470d-b248-b552733fa5d3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:49.014463 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e1a9e727-c66c-470d-b248-b552733fa5d3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:49.014919 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e1a9e727-c66c-470d-b248-b552733fa5d3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:49.015689 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e1a9e727-c66c-470d-b248-b552733fa5d3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:49.016130 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e1a9e727-c66c-470d-b248-b552733fa5d3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:49.149884 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e1a9e727-c66c-470d-b248-b552733fa5d3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:49.150804 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8609dd8c-8371-4b4e-b2c8-31c2705cfcba tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:49.151444 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8609dd8c-8371-4b4e-b2c8-31c2705cfcba tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:49.157424 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e1a9e727-c66c-470d-b248-b552733fa5d3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.154309 Apr 08 11:24:49.157693 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8609dd8c-8371-4b4e-b2c8-31c2705cfcba tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:49.157942 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8609dd8c-8371-4b4e-b2c8-31c2705cfcba tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:49.158061 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 649/1292] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:49 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:49.158728 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8609dd8c-8371-4b4e-b2c8-31c2705cfcba tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:49.159173 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8609dd8c-8371-4b4e-b2c8-31c2705cfcba tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:49.190561 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 11:24:49.190788 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: Fri Apr 8 11:24:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 11:24:49.297268 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8609dd8c-8371-4b4e-b2c8-31c2705cfcba tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:49.305988 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8609dd8c-8371-4b4e-b2c8-31c2705cfcba tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:49.307492 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8609dd8c-8371-4b4e-b2c8-31c2705cfcba tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:49.308663 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8609dd8c-8371-4b4e-b2c8-31c2705cfcba tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.161791 Apr 08 11:24:49.309216 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 644/1293] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:49 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:24:49.424671 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-6dabe4a0-1a8c-46bc-94b8-658ece40e63d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:49.425597 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-6dabe4a0-1a8c-46bc-94b8-658ece40e63d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:49.431982 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6dabe4a0-1a8c-46bc-94b8-658ece40e63d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:49.432436 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6dabe4a0-1a8c-46bc-94b8-658ece40e63d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:49.433203 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6dabe4a0-1a8c-46bc-94b8-658ece40e63d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:49.433642 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6dabe4a0-1a8c-46bc-94b8-658ece40e63d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:49.461255 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-6dabe4a0-1a8c-46bc-94b8-658ece40e63d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040623 Apr 08 11:24:49.461825 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 650/1294] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:49 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:49.868082 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b17bc0f0-a972-4bf7-aab0-337e162ab079 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:49.868699 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b17bc0f0-a972-4bf7-aab0-337e162ab079 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:49.875532 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b17bc0f0-a972-4bf7-aab0-337e162ab079 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:49.875985 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b17bc0f0-a972-4bf7-aab0-337e162ab079 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:49.876795 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b17bc0f0-a972-4bf7-aab0-337e162ab079 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:49.877866 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b17bc0f0-a972-4bf7-aab0-337e162ab079 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:49.936745 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b17bc0f0-a972-4bf7-aab0-337e162ab079 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:49.944591 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b17bc0f0-a972-4bf7-aab0-337e162ab079 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080864 Apr 08 11:24:49.945161 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 645/1295] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:49 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:50.175127 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-8ac8357d-6df9-4e06-97de-4452f237ea31 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:50.175757 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-8ac8357d-6df9-4e06-97de-4452f237ea31 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:50.181755 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8ac8357d-6df9-4e06-97de-4452f237ea31 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:50.182223 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8ac8357d-6df9-4e06-97de-4452f237ea31 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:50.182977 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8ac8357d-6df9-4e06-97de-4452f237ea31 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:50.183411 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8ac8357d-6df9-4e06-97de-4452f237ea31 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:50.320026 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-8ac8357d-6df9-4e06-97de-4452f237ea31 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:50.326722 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5ed2639d-ac21-49f2-90af-599950553c92 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:50.327461 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5ed2639d-ac21-49f2-90af-599950553c92 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:50.327581 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-8ac8357d-6df9-4e06-97de-4452f237ea31 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.156269 Apr 08 11:24:50.328137 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 651/1296] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:50 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:50.333458 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5ed2639d-ac21-49f2-90af-599950553c92 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:50.334110 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5ed2639d-ac21-49f2-90af-599950553c92 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:50.334950 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5ed2639d-ac21-49f2-90af-599950553c92 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:50.335502 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5ed2639d-ac21-49f2-90af-599950553c92 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:50.468129 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5ed2639d-ac21-49f2-90af-599950553c92 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:50.472550 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-78e992f6-aeb4-4232-8b35-38d3ae5bba1c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:50.473484 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-78e992f6-aeb4-4232-8b35-38d3ae5bba1c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:50.476672 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5ed2639d-ac21-49f2-90af-599950553c92 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:50.478214 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5ed2639d-ac21-49f2-90af-599950553c92 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:50.479306 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-78e992f6-aeb4-4232-8b35-38d3ae5bba1c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:50.479490 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5ed2639d-ac21-49f2-90af-599950553c92 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.156595 Apr 08 11:24:50.479754 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-78e992f6-aeb4-4232-8b35-38d3ae5bba1c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:50.480063 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 646/1297] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:50 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:24:50.480532 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-78e992f6-aeb4-4232-8b35-38d3ae5bba1c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:50.480971 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-78e992f6-aeb4-4232-8b35-38d3ae5bba1c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:50.510734 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-78e992f6-aeb4-4232-8b35-38d3ae5bba1c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042022 Apr 08 11:24:50.511297 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 652/1298] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:50 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:50.961293 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e1143f13-bd82-4441-b756-ca64f639e175 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:50.961873 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e1143f13-bd82-4441-b756-ca64f639e175 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:50.968179 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e1143f13-bd82-4441-b756-ca64f639e175 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:50.968633 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e1143f13-bd82-4441-b756-ca64f639e175 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:50.969408 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e1143f13-bd82-4441-b756-ca64f639e175 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:50.969878 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e1143f13-bd82-4441-b756-ca64f639e175 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:51.029914 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e1143f13-bd82-4441-b756-ca64f639e175 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:51.038608 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e1143f13-bd82-4441-b756-ca64f639e175 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080149 Apr 08 11:24:51.038608 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 647/1299] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:50 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:51.345094 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-0a3a494b-dde4-4664-8707-efb99bdd40e0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:51.345702 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-0a3a494b-dde4-4664-8707-efb99bdd40e0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:51.353079 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0a3a494b-dde4-4664-8707-efb99bdd40e0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:51.353561 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0a3a494b-dde4-4664-8707-efb99bdd40e0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:51.354375 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0a3a494b-dde4-4664-8707-efb99bdd40e0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:51.354812 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0a3a494b-dde4-4664-8707-efb99bdd40e0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:51.497699 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-0a3a494b-dde4-4664-8707-efb99bdd40e0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:51.498040 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-fc1bdeed-0efb-4ef4-8cf6-e8b6a49e707f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:51.498659 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-fc1bdeed-0efb-4ef4-8cf6-e8b6a49e707f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:51.505255 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-0a3a494b-dde4-4664-8707-efb99bdd40e0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.164042 Apr 08 11:24:51.506385 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 653/1300] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:51 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:51.506523 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fc1bdeed-0efb-4ef4-8cf6-e8b6a49e707f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:51.507204 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fc1bdeed-0efb-4ef4-8cf6-e8b6a49e707f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:51.508043 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fc1bdeed-0efb-4ef4-8cf6-e8b6a49e707f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:51.508521 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fc1bdeed-0efb-4ef4-8cf6-e8b6a49e707f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:51.522812 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2b895a5a-1f02-477a-ad92-e5a70ef475a2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:51.523740 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-2b895a5a-1f02-477a-ad92-e5a70ef475a2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:51.533060 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2b895a5a-1f02-477a-ad92-e5a70ef475a2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:51.533060 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2b895a5a-1f02-477a-ad92-e5a70ef475a2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:51.533060 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2b895a5a-1f02-477a-ad92-e5a70ef475a2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:51.533060 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2b895a5a-1f02-477a-ad92-e5a70ef475a2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:51.563323 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-2b895a5a-1f02-477a-ad92-e5a70ef475a2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044628 Apr 08 11:24:51.564317 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 654/1301] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:51 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:24:51.659058 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-fc1bdeed-0efb-4ef4-8cf6-e8b6a49e707f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:51.667357 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-fc1bdeed-0efb-4ef4-8cf6-e8b6a49e707f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:51.668879 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-fc1bdeed-0efb-4ef4-8cf6-e8b6a49e707f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:51.670258 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-fc1bdeed-0efb-4ef4-8cf6-e8b6a49e707f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.176224 Apr 08 11:24:51.672088 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 648/1302] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:51 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:24:52.055063 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-4c612ec7-2022-4daf-b058-ea00587398dc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:52.055708 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-4c612ec7-2022-4daf-b058-ea00587398dc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:52.064344 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4c612ec7-2022-4daf-b058-ea00587398dc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:52.064792 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4c612ec7-2022-4daf-b058-ea00587398dc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:52.065575 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4c612ec7-2022-4daf-b058-ea00587398dc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:52.066042 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4c612ec7-2022-4daf-b058-ea00587398dc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:52.133970 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-4c612ec7-2022-4daf-b058-ea00587398dc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:52.142510 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-4c612ec7-2022-4daf-b058-ea00587398dc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.091750 Apr 08 11:24:52.143098 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 655/1303] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:52 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:52.525469 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-04b411ed-3fbb-43ed-a153-e56c8fd0e87b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:52.526091 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-04b411ed-3fbb-43ed-a153-e56c8fd0e87b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:52.532391 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-04b411ed-3fbb-43ed-a153-e56c8fd0e87b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:52.532836 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-04b411ed-3fbb-43ed-a153-e56c8fd0e87b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:52.533599 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-04b411ed-3fbb-43ed-a153-e56c8fd0e87b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:52.534067 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-04b411ed-3fbb-43ed-a153-e56c8fd0e87b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:52.575428 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a85812fa-5278-4eb5-9f83-b8688f6fa5af tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:52.576515 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a85812fa-5278-4eb5-9f83-b8688f6fa5af tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:52.583006 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a85812fa-5278-4eb5-9f83-b8688f6fa5af tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:52.583453 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a85812fa-5278-4eb5-9f83-b8688f6fa5af tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:52.584757 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a85812fa-5278-4eb5-9f83-b8688f6fa5af tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:52.585189 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a85812fa-5278-4eb5-9f83-b8688f6fa5af tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:52.615380 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a85812fa-5278-4eb5-9f83-b8688f6fa5af tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044070 Apr 08 11:24:52.616198 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 656/1304] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:52 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:52.678731 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-04b411ed-3fbb-43ed-a153-e56c8fd0e87b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:52.686549 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-04b411ed-3fbb-43ed-a153-e56c8fd0e87b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.165717 Apr 08 11:24:52.687145 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 649/1305] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:52 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:52.689068 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-f36d9106-93f4-427a-b165-59c788c80a08 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:52.689687 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-f36d9106-93f4-427a-b165-59c788c80a08 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:52.695798 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f36d9106-93f4-427a-b165-59c788c80a08 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:52.696256 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f36d9106-93f4-427a-b165-59c788c80a08 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:52.697041 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f36d9106-93f4-427a-b165-59c788c80a08 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:52.697483 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f36d9106-93f4-427a-b165-59c788c80a08 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:52.834589 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f36d9106-93f4-427a-b165-59c788c80a08 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:52.843446 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f36d9106-93f4-427a-b165-59c788c80a08 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:52.844951 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f36d9106-93f4-427a-b165-59c788c80a08 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:52.846264 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-f36d9106-93f4-427a-b165-59c788c80a08 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.161013 Apr 08 11:24:52.846916 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 657/1306] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:52 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:24:53.159462 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-476078d8-f16b-4a5a-a3d6-d64b21e41f32 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:53.160003 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-476078d8-f16b-4a5a-a3d6-d64b21e41f32 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:53.166009 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-476078d8-f16b-4a5a-a3d6-d64b21e41f32 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:53.166466 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-476078d8-f16b-4a5a-a3d6-d64b21e41f32 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:53.167241 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-476078d8-f16b-4a5a-a3d6-d64b21e41f32 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:53.167682 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-476078d8-f16b-4a5a-a3d6-d64b21e41f32 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:53.226962 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-476078d8-f16b-4a5a-a3d6-d64b21e41f32 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:53.234465 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-476078d8-f16b-4a5a-a3d6-d64b21e41f32 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079073 Apr 08 11:24:53.235043 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 650/1307] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:53 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:53.627199 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-9e621471-22d8-40bf-be50-914b2a08a974 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:53.628154 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-9e621471-22d8-40bf-be50-914b2a08a974 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:53.635230 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9e621471-22d8-40bf-be50-914b2a08a974 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:53.635672 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9e621471-22d8-40bf-be50-914b2a08a974 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:53.636462 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9e621471-22d8-40bf-be50-914b2a08a974 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:53.636892 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9e621471-22d8-40bf-be50-914b2a08a974 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:53.666301 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-9e621471-22d8-40bf-be50-914b2a08a974 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042996 Apr 08 11:24:53.666867 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 658/1308] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:53 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:53.703501 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e737b03e-aeb2-4ef2-a692-9e55fd660545 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:53.704110 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e737b03e-aeb2-4ef2-a692-9e55fd660545 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:53.710619 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e737b03e-aeb2-4ef2-a692-9e55fd660545 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:53.711067 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e737b03e-aeb2-4ef2-a692-9e55fd660545 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:53.711829 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e737b03e-aeb2-4ef2-a692-9e55fd660545 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:53.712262 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e737b03e-aeb2-4ef2-a692-9e55fd660545 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:53.847568 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e737b03e-aeb2-4ef2-a692-9e55fd660545 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:53.855361 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e737b03e-aeb2-4ef2-a692-9e55fd660545 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.155795 Apr 08 11:24:53.855923 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 651/1309] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:53 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:53.864383 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-0db70cb7-5844-4051-b00b-a6be6cc3abea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:53.865636 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-0db70cb7-5844-4051-b00b-a6be6cc3abea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:53.871793 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0db70cb7-5844-4051-b00b-a6be6cc3abea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:53.872382 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0db70cb7-5844-4051-b00b-a6be6cc3abea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:53.873159 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0db70cb7-5844-4051-b00b-a6be6cc3abea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:53.873601 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0db70cb7-5844-4051-b00b-a6be6cc3abea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:54.013869 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-0db70cb7-5844-4051-b00b-a6be6cc3abea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:54.022551 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-0db70cb7-5844-4051-b00b-a6be6cc3abea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:54.024061 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-0db70cb7-5844-4051-b00b-a6be6cc3abea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:54.025217 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-0db70cb7-5844-4051-b00b-a6be6cc3abea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.164709 Apr 08 11:24:54.025796 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 659/1310] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:53 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:24:54.251584 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6e3e4a96-7d2b-4606-aeb0-afba40c63760 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:54.252141 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6e3e4a96-7d2b-4606-aeb0-afba40c63760 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:54.258168 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6e3e4a96-7d2b-4606-aeb0-afba40c63760 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:54.258624 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6e3e4a96-7d2b-4606-aeb0-afba40c63760 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:54.259398 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6e3e4a96-7d2b-4606-aeb0-afba40c63760 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:54.259855 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6e3e4a96-7d2b-4606-aeb0-afba40c63760 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:54.321929 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6e3e4a96-7d2b-4606-aeb0-afba40c63760 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:54.329401 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6e3e4a96-7d2b-4606-aeb0-afba40c63760 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081845 Apr 08 11:24:54.330002 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 652/1311] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:54 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:54.678717 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-08fc7f03-b335-4555-94a3-79415e98a060 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:54.679655 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-08fc7f03-b335-4555-94a3-79415e98a060 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:54.686173 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-08fc7f03-b335-4555-94a3-79415e98a060 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:54.686629 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-08fc7f03-b335-4555-94a3-79415e98a060 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:54.687406 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-08fc7f03-b335-4555-94a3-79415e98a060 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:54.687848 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-08fc7f03-b335-4555-94a3-79415e98a060 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:54.716091 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-08fc7f03-b335-4555-94a3-79415e98a060 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042025 Apr 08 11:24:54.716659 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 660/1312] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:54 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:54.872696 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-161d274c-17b1-4916-8b74-95a1ff4c7890 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:54.873310 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-161d274c-17b1-4916-8b74-95a1ff4c7890 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:54.879834 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-161d274c-17b1-4916-8b74-95a1ff4c7890 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:54.880281 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-161d274c-17b1-4916-8b74-95a1ff4c7890 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:54.881054 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-161d274c-17b1-4916-8b74-95a1ff4c7890 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:54.881486 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-161d274c-17b1-4916-8b74-95a1ff4c7890 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:55.014026 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-161d274c-17b1-4916-8b74-95a1ff4c7890 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:55.021917 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-161d274c-17b1-4916-8b74-95a1ff4c7890 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.152574 Apr 08 11:24:55.022485 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 653/1313] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:54 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:55.043751 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2304bcbf-2a33-4b3d-9eb9-5bf7bbe70355 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:55.044371 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-2304bcbf-2a33-4b3d-9eb9-5bf7bbe70355 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:55.050277 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2304bcbf-2a33-4b3d-9eb9-5bf7bbe70355 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:55.050734 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2304bcbf-2a33-4b3d-9eb9-5bf7bbe70355 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:55.051509 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2304bcbf-2a33-4b3d-9eb9-5bf7bbe70355 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:55.051952 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2304bcbf-2a33-4b3d-9eb9-5bf7bbe70355 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:55.180711 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2304bcbf-2a33-4b3d-9eb9-5bf7bbe70355 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:55.188994 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2304bcbf-2a33-4b3d-9eb9-5bf7bbe70355 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:55.190535 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2304bcbf-2a33-4b3d-9eb9-5bf7bbe70355 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:55.191694 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-2304bcbf-2a33-4b3d-9eb9-5bf7bbe70355 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.151826 Apr 08 11:24:55.192259 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 661/1314] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:55 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:24:55.346605 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2056cf4b-326d-48f8-9532-8da2f42afadd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:55.347217 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2056cf4b-326d-48f8-9532-8da2f42afadd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:55.353092 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2056cf4b-326d-48f8-9532-8da2f42afadd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:55.353536 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2056cf4b-326d-48f8-9532-8da2f42afadd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:55.354326 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2056cf4b-326d-48f8-9532-8da2f42afadd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:55.354790 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2056cf4b-326d-48f8-9532-8da2f42afadd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:55.416175 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2056cf4b-326d-48f8-9532-8da2f42afadd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:55.423454 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2056cf4b-326d-48f8-9532-8da2f42afadd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080711 Apr 08 11:24:55.424019 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 654/1315] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:55 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:55.728294 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-32c78d4d-0222-41ad-a856-76b629ebade5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:55.729227 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-32c78d4d-0222-41ad-a856-76b629ebade5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:55.735642 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-32c78d4d-0222-41ad-a856-76b629ebade5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:55.736094 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-32c78d4d-0222-41ad-a856-76b629ebade5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:55.736911 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-32c78d4d-0222-41ad-a856-76b629ebade5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:55.737357 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-32c78d4d-0222-41ad-a856-76b629ebade5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:55.767272 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-32c78d4d-0222-41ad-a856-76b629ebade5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043058 Apr 08 11:24:55.767829 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 662/1316] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:55 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:56.039408 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d137850e-9161-48c7-a4bb-3f0e920854be tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:56.040030 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d137850e-9161-48c7-a4bb-3f0e920854be tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:56.046389 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d137850e-9161-48c7-a4bb-3f0e920854be tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:56.046843 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d137850e-9161-48c7-a4bb-3f0e920854be tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:56.047613 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d137850e-9161-48c7-a4bb-3f0e920854be tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:56.048057 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d137850e-9161-48c7-a4bb-3f0e920854be tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:56.185268 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d137850e-9161-48c7-a4bb-3f0e920854be tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:56.192710 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d137850e-9161-48c7-a4bb-3f0e920854be tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.157686 Apr 08 11:24:56.193271 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 655/1317] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:56 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:56.210430 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-f7706bbe-eb79-49ec-bd06-7f66156f656c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:56.211051 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-f7706bbe-eb79-49ec-bd06-7f66156f656c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:56.216847 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f7706bbe-eb79-49ec-bd06-7f66156f656c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:56.217298 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f7706bbe-eb79-49ec-bd06-7f66156f656c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:56.218102 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f7706bbe-eb79-49ec-bd06-7f66156f656c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:56.218542 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f7706bbe-eb79-49ec-bd06-7f66156f656c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:56.348273 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f7706bbe-eb79-49ec-bd06-7f66156f656c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:56.357139 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f7706bbe-eb79-49ec-bd06-7f66156f656c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:56.358673 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f7706bbe-eb79-49ec-bd06-7f66156f656c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:56.359819 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-f7706bbe-eb79-49ec-bd06-7f66156f656c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.153689 Apr 08 11:24:56.360374 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 663/1318] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:56 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:24:56.442330 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2593d7a2-a760-4aa6-8745-2567f5a73ce4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:56.443032 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2593d7a2-a760-4aa6-8745-2567f5a73ce4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:56.450566 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2593d7a2-a760-4aa6-8745-2567f5a73ce4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:56.451022 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2593d7a2-a760-4aa6-8745-2567f5a73ce4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:56.451803 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2593d7a2-a760-4aa6-8745-2567f5a73ce4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:56.452249 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2593d7a2-a760-4aa6-8745-2567f5a73ce4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:56.515292 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2593d7a2-a760-4aa6-8745-2567f5a73ce4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:56.523273 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2593d7a2-a760-4aa6-8745-2567f5a73ce4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.086630 Apr 08 11:24:56.523844 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 656/1319] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:56 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:56.779517 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-3cc70c29-2a3d-4039-a37a-71ef2ff52d75 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:56.780571 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-3cc70c29-2a3d-4039-a37a-71ef2ff52d75 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:56.787385 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3cc70c29-2a3d-4039-a37a-71ef2ff52d75 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:56.787837 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3cc70c29-2a3d-4039-a37a-71ef2ff52d75 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:56.788634 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3cc70c29-2a3d-4039-a37a-71ef2ff52d75 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:56.789079 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3cc70c29-2a3d-4039-a37a-71ef2ff52d75 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:56.824818 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-3cc70c29-2a3d-4039-a37a-71ef2ff52d75 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049271 Apr 08 11:24:56.825392 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 664/1320] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:56 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:57.209592 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-58137419-278e-4ef6-b885-2984ecffda6d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:57.210218 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-58137419-278e-4ef6-b885-2984ecffda6d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:57.216502 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-58137419-278e-4ef6-b885-2984ecffda6d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:57.216957 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-58137419-278e-4ef6-b885-2984ecffda6d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:57.217734 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-58137419-278e-4ef6-b885-2984ecffda6d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:57.218197 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-58137419-278e-4ef6-b885-2984ecffda6d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:57.350072 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-58137419-278e-4ef6-b885-2984ecffda6d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:57.357973 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-58137419-278e-4ef6-b885-2984ecffda6d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.152180 Apr 08 11:24:57.358541 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 657/1321] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:57 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:57.377829 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-d8178b91-66a8-45ae-9fcc-3f886f6ca3e3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:57.378442 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-d8178b91-66a8-45ae-9fcc-3f886f6ca3e3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:57.384370 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d8178b91-66a8-45ae-9fcc-3f886f6ca3e3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:57.388287 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d8178b91-66a8-45ae-9fcc-3f886f6ca3e3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:57.389221 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d8178b91-66a8-45ae-9fcc-3f886f6ca3e3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:57.390426 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d8178b91-66a8-45ae-9fcc-3f886f6ca3e3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:57.524757 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d8178b91-66a8-45ae-9fcc-3f886f6ca3e3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:57.533143 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d8178b91-66a8-45ae-9fcc-3f886f6ca3e3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:57.534708 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d8178b91-66a8-45ae-9fcc-3f886f6ca3e3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:57.536733 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-d8178b91-66a8-45ae-9fcc-3f886f6ca3e3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.162713 Apr 08 11:24:57.537308 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 665/1322] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:57 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:24:57.540176 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-527dacf9-541c-4b65-b96a-99d94f9be3a5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:57.545923 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-527dacf9-541c-4b65-b96a-99d94f9be3a5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:57.546953 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-527dacf9-541c-4b65-b96a-99d94f9be3a5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:57.547460 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-527dacf9-541c-4b65-b96a-99d94f9be3a5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:57.548246 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-527dacf9-541c-4b65-b96a-99d94f9be3a5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:57.548688 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-527dacf9-541c-4b65-b96a-99d94f9be3a5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:57.611603 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-527dacf9-541c-4b65-b96a-99d94f9be3a5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:57.620043 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-527dacf9-541c-4b65-b96a-99d94f9be3a5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.084162 Apr 08 11:24:57.620616 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 658/1323] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:57 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:24:57.837127 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-5af3031f-cf1c-412b-be8e-d8249dc6fe1e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:57.838092 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-5af3031f-cf1c-412b-be8e-d8249dc6fe1e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:57.844518 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5af3031f-cf1c-412b-be8e-d8249dc6fe1e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:57.844973 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5af3031f-cf1c-412b-be8e-d8249dc6fe1e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:57.845748 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5af3031f-cf1c-412b-be8e-d8249dc6fe1e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:57.846219 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5af3031f-cf1c-412b-be8e-d8249dc6fe1e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:57.875553 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-5af3031f-cf1c-412b-be8e-d8249dc6fe1e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042891 Apr 08 11:24:57.876107 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 666/1324] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:57 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:24:58.375973 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bffe4c9e-afc6-45f2-bf39-1ea17d78de98 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:58.376651 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-bffe4c9e-afc6-45f2-bf39-1ea17d78de98 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:58.383994 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bffe4c9e-afc6-45f2-bf39-1ea17d78de98 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:58.384437 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bffe4c9e-afc6-45f2-bf39-1ea17d78de98 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:58.385221 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bffe4c9e-afc6-45f2-bf39-1ea17d78de98 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:58.385661 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bffe4c9e-afc6-45f2-bf39-1ea17d78de98 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:58.519351 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-bffe4c9e-afc6-45f2-bf39-1ea17d78de98 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:58.527850 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-bffe4c9e-afc6-45f2-bf39-1ea17d78de98 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.155735 Apr 08 11:24:58.528425 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 659/1325] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:58 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:58.562984 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-243dd97d-d617-4d12-bed7-04676a6d0f12 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:58.563621 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-243dd97d-d617-4d12-bed7-04676a6d0f12 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:58.570446 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-243dd97d-d617-4d12-bed7-04676a6d0f12 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:58.570910 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-243dd97d-d617-4d12-bed7-04676a6d0f12 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:58.571695 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-243dd97d-d617-4d12-bed7-04676a6d0f12 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:58.572137 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-243dd97d-d617-4d12-bed7-04676a6d0f12 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:58.637861 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6721a3e6-0cb6-4cbf-be59-0db835dcac66 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:58.638380 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6721a3e6-0cb6-4cbf-be59-0db835dcac66 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:58.644615 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6721a3e6-0cb6-4cbf-be59-0db835dcac66 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:58.645093 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6721a3e6-0cb6-4cbf-be59-0db835dcac66 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:58.645873 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6721a3e6-0cb6-4cbf-be59-0db835dcac66 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:58.646314 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6721a3e6-0cb6-4cbf-be59-0db835dcac66 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:58.721790 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6721a3e6-0cb6-4cbf-be59-0db835dcac66 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:58.729064 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6721a3e6-0cb6-4cbf-be59-0db835dcac66 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.095279 Apr 08 11:24:58.729637 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 660/1326] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:58 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:24:58.738017 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-243dd97d-d617-4d12-bed7-04676a6d0f12 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:58.747310 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-243dd97d-d617-4d12-bed7-04676a6d0f12 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:58.748856 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-243dd97d-d617-4d12-bed7-04676a6d0f12 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:58.750087 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-243dd97d-d617-4d12-bed7-04676a6d0f12 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.191124 Apr 08 11:24:58.750644 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 667/1327] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:58 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:24:58.887134 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-cda3e1a1-e796-46cd-b355-b3a96402ca97 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:58.888112 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-cda3e1a1-e796-46cd-b355-b3a96402ca97 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:58.893946 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cda3e1a1-e796-46cd-b355-b3a96402ca97 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:58.894401 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cda3e1a1-e796-46cd-b355-b3a96402ca97 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:58.895151 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cda3e1a1-e796-46cd-b355-b3a96402ca97 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:58.895587 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cda3e1a1-e796-46cd-b355-b3a96402ca97 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:58.923401 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-cda3e1a1-e796-46cd-b355-b3a96402ca97 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040218 Apr 08 11:24:58.923950 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 661/1328] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:58 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:24:59.544856 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-67b54a3b-f24d-4802-81a8-ad9c0d0ce550 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:59.545468 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-67b54a3b-f24d-4802-81a8-ad9c0d0ce550 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:59.551814 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-67b54a3b-f24d-4802-81a8-ad9c0d0ce550 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:59.552265 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-67b54a3b-f24d-4802-81a8-ad9c0d0ce550 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:59.553031 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-67b54a3b-f24d-4802-81a8-ad9c0d0ce550 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:59.553469 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-67b54a3b-f24d-4802-81a8-ad9c0d0ce550 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:59.687667 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-67b54a3b-f24d-4802-81a8-ad9c0d0ce550 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:59.695649 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-67b54a3b-f24d-4802-81a8-ad9c0d0ce550 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.154578 Apr 08 11:24:59.696222 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 668/1329] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:59 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:59.746185 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4c8a6291-78af-469d-a982-74738ed25e38 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:59.746805 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4c8a6291-78af-469d-a982-74738ed25e38 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:59.753301 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4c8a6291-78af-469d-a982-74738ed25e38 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:59.753759 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4c8a6291-78af-469d-a982-74738ed25e38 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:59.754559 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4c8a6291-78af-469d-a982-74738ed25e38 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:59.755001 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4c8a6291-78af-469d-a982-74738ed25e38 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:59.770659 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-c42b856a-8376-457d-b341-9b431d57cf97 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:59.771557 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-c42b856a-8376-457d-b341-9b431d57cf97 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:59.778325 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c42b856a-8376-457d-b341-9b431d57cf97 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:59.778785 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c42b856a-8376-457d-b341-9b431d57cf97 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:59.779570 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c42b856a-8376-457d-b341-9b431d57cf97 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:59.780013 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c42b856a-8376-457d-b341-9b431d57cf97 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:59.817897 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4c8a6291-78af-469d-a982-74738ed25e38 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:59.826021 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4c8a6291-78af-469d-a982-74738ed25e38 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.083992 Apr 08 11:24:59.826617 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 662/1330] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:24:59 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:24:59.919883 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-c42b856a-8376-457d-b341-9b431d57cf97 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:59.928141 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-c42b856a-8376-457d-b341-9b431d57cf97 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:59.929820 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-c42b856a-8376-457d-b341-9b431d57cf97 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:24:59.930993 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-c42b856a-8376-457d-b341-9b431d57cf97 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.165682 Apr 08 11:24:59.931552 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 669/1331] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:24:59 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:24:59.935310 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-15ef3ae3-daf0-41e5-a89b-786226c4a0e9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:24:59.936292 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-15ef3ae3-daf0-41e5-a89b-786226c4a0e9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:24:59.942227 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-15ef3ae3-daf0-41e5-a89b-786226c4a0e9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:59.942687 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-15ef3ae3-daf0-41e5-a89b-786226c4a0e9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:59.943460 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-15ef3ae3-daf0-41e5-a89b-786226c4a0e9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:24:59.943901 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-15ef3ae3-daf0-41e5-a89b-786226c4a0e9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:24:59.983037 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-15ef3ae3-daf0-41e5-a89b-786226c4a0e9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051779 Apr 08 11:24:59.983592 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 663/1332] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:24:59 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:25:00.712857 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-ad1824f5-9394-455d-8679-074f552fe736 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:00.713475 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-ad1824f5-9394-455d-8679-074f552fe736 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:00.719831 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ad1824f5-9394-455d-8679-074f552fe736 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:00.720279 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ad1824f5-9394-455d-8679-074f552fe736 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:00.721046 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ad1824f5-9394-455d-8679-074f552fe736 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:00.721484 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ad1824f5-9394-455d-8679-074f552fe736 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:00.842527 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0a960628-b86d-422e-bb50-d6d353e5382f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:00.843147 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0a960628-b86d-422e-bb50-d6d353e5382f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:00.849423 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0a960628-b86d-422e-bb50-d6d353e5382f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:00.849912 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0a960628-b86d-422e-bb50-d6d353e5382f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:00.850695 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0a960628-b86d-422e-bb50-d6d353e5382f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:00.851769 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0a960628-b86d-422e-bb50-d6d353e5382f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:00.863991 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-ad1824f5-9394-455d-8679-074f552fe736 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:00.871713 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-ad1824f5-9394-455d-8679-074f552fe736 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.163166 Apr 08 11:25:00.872311 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 670/1333] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:00 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:00.915997 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0a960628-b86d-422e-bb50-d6d353e5382f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:00.920151 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0a960628-b86d-422e-bb50-d6d353e5382f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081508 Apr 08 11:25:00.920723 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 664/1334] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:00 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:25:00.948094 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e3cc356a-9824-41cd-9298-1dd68c72e91e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:00.949952 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e3cc356a-9824-41cd-9298-1dd68c72e91e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:00.954716 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e3cc356a-9824-41cd-9298-1dd68c72e91e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:00.955171 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e3cc356a-9824-41cd-9298-1dd68c72e91e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:00.955941 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e3cc356a-9824-41cd-9298-1dd68c72e91e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:00.956396 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e3cc356a-9824-41cd-9298-1dd68c72e91e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:00.994882 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d9933cb9-39be-44f2-8d5b-e63f748e1c5c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:00.995819 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d9933cb9-39be-44f2-8d5b-e63f748e1c5c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:01.001745 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d9933cb9-39be-44f2-8d5b-e63f748e1c5c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:01.002309 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d9933cb9-39be-44f2-8d5b-e63f748e1c5c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:01.003094 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d9933cb9-39be-44f2-8d5b-e63f748e1c5c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:01.003540 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d9933cb9-39be-44f2-8d5b-e63f748e1c5c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:01.033164 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d9933cb9-39be-44f2-8d5b-e63f748e1c5c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042534 Apr 08 11:25:01.033737 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 665/1335] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:00 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:25:01.091083 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e3cc356a-9824-41cd-9298-1dd68c72e91e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:01.099310 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e3cc356a-9824-41cd-9298-1dd68c72e91e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:01.100888 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e3cc356a-9824-41cd-9298-1dd68c72e91e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:01.102614 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e3cc356a-9824-41cd-9298-1dd68c72e91e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.158480 Apr 08 11:25:01.103177 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 671/1336] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:25:00 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:25:01.888968 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a3761895-84b6-40ab-b202-abff474fe824 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:01.889787 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a3761895-84b6-40ab-b202-abff474fe824 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:01.896231 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a3761895-84b6-40ab-b202-abff474fe824 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:01.896621 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a3761895-84b6-40ab-b202-abff474fe824 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:01.897392 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a3761895-84b6-40ab-b202-abff474fe824 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:01.897889 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a3761895-84b6-40ab-b202-abff474fe824 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:01.936261 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-de5e52c5-2482-4f75-a2ec-f03461f1c20c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:01.937028 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-de5e52c5-2482-4f75-a2ec-f03461f1c20c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:01.943370 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-de5e52c5-2482-4f75-a2ec-f03461f1c20c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:01.943823 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-de5e52c5-2482-4f75-a2ec-f03461f1c20c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:01.944603 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-de5e52c5-2482-4f75-a2ec-f03461f1c20c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:01.945042 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-de5e52c5-2482-4f75-a2ec-f03461f1c20c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:02.015693 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-de5e52c5-2482-4f75-a2ec-f03461f1c20c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:02.023147 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-de5e52c5-2482-4f75-a2ec-f03461f1c20c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.090617 Apr 08 11:25:02.023730 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 672/1337] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:01 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:25:02.044823 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-20933537-9d67-480d-9a8b-7dd8821528e0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:02.045783 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-20933537-9d67-480d-9a8b-7dd8821528e0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:02.051580 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-20933537-9d67-480d-9a8b-7dd8821528e0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:02.051882 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a3761895-84b6-40ab-b202-abff474fe824 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:02.052029 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-20933537-9d67-480d-9a8b-7dd8821528e0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:02.052805 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-20933537-9d67-480d-9a8b-7dd8821528e0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:02.053249 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-20933537-9d67-480d-9a8b-7dd8821528e0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:02.060181 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a3761895-84b6-40ab-b202-abff474fe824 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.175055 Apr 08 11:25:02.060670 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 666/1338] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:01 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:02.082533 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-20933537-9d67-480d-9a8b-7dd8821528e0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041515 Apr 08 11:25:02.083090 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 673/1339] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:02 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:25:02.121555 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e6dc942e-e58c-47a6-ba4c-e36de4ddad71 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:02.122205 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e6dc942e-e58c-47a6-ba4c-e36de4ddad71 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:02.128834 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e6dc942e-e58c-47a6-ba4c-e36de4ddad71 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:02.129292 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e6dc942e-e58c-47a6-ba4c-e36de4ddad71 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:02.130099 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e6dc942e-e58c-47a6-ba4c-e36de4ddad71 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:02.130582 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e6dc942e-e58c-47a6-ba4c-e36de4ddad71 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:02.265173 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e6dc942e-e58c-47a6-ba4c-e36de4ddad71 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:02.273904 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e6dc942e-e58c-47a6-ba4c-e36de4ddad71 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:02.275413 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e6dc942e-e58c-47a6-ba4c-e36de4ddad71 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:02.276557 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e6dc942e-e58c-47a6-ba4c-e36de4ddad71 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.159939 Apr 08 11:25:02.277119 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 667/1340] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:25:02 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:25:03.040293 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-09c7a863-c8a7-4d7f-b9bf-fadbd289c1fa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:03.040960 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-09c7a863-c8a7-4d7f-b9bf-fadbd289c1fa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:03.047395 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-09c7a863-c8a7-4d7f-b9bf-fadbd289c1fa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:03.047842 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-09c7a863-c8a7-4d7f-b9bf-fadbd289c1fa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:03.048607 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-09c7a863-c8a7-4d7f-b9bf-fadbd289c1fa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:03.049041 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-09c7a863-c8a7-4d7f-b9bf-fadbd289c1fa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:03.077206 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1a069727-2c3b-4dd6-91b3-4a2bfce1c993 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:03.077983 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1a069727-2c3b-4dd6-91b3-4a2bfce1c993 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:03.086019 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1a069727-2c3b-4dd6-91b3-4a2bfce1c993 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:03.086471 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1a069727-2c3b-4dd6-91b3-4a2bfce1c993 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:03.087259 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1a069727-2c3b-4dd6-91b3-4a2bfce1c993 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:03.089302 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1a069727-2c3b-4dd6-91b3-4a2bfce1c993 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:03.113571 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-09c7a863-c8a7-4d7f-b9bf-fadbd289c1fa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:03.122468 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-09c7a863-c8a7-4d7f-b9bf-fadbd289c1fa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.086326 Apr 08 11:25:03.123134 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 674/1341] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:03 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:03.127786 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-0eb4ca2b-bc18-4cee-b207-bebef7d54fc4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:03.128714 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-0eb4ca2b-bc18-4cee-b207-bebef7d54fc4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:03.135652 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0eb4ca2b-bc18-4cee-b207-bebef7d54fc4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:03.136970 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0eb4ca2b-bc18-4cee-b207-bebef7d54fc4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:03.136970 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0eb4ca2b-bc18-4cee-b207-bebef7d54fc4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:03.137287 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0eb4ca2b-bc18-4cee-b207-bebef7d54fc4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:03.167242 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-0eb4ca2b-bc18-4cee-b207-bebef7d54fc4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043053 Apr 08 11:25:03.168056 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 675/1342] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:03 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:03.232223 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1a069727-2c3b-4dd6-91b3-4a2bfce1c993 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:03.239967 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1a069727-2c3b-4dd6-91b3-4a2bfce1c993 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.166682 Apr 08 11:25:03.240543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 668/1343] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:03 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:25:03.295034 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-50277b15-1dc0-44e8-8a45-df70ae459d84 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:03.295593 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-50277b15-1dc0-44e8-8a45-df70ae459d84 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:03.301672 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-50277b15-1dc0-44e8-8a45-df70ae459d84 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:03.302155 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-50277b15-1dc0-44e8-8a45-df70ae459d84 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:03.302932 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-50277b15-1dc0-44e8-8a45-df70ae459d84 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:03.303373 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-50277b15-1dc0-44e8-8a45-df70ae459d84 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:03.439190 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-50277b15-1dc0-44e8-8a45-df70ae459d84 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:03.447872 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-50277b15-1dc0-44e8-8a45-df70ae459d84 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:03.449377 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-50277b15-1dc0-44e8-8a45-df70ae459d84 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:03.450562 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-50277b15-1dc0-44e8-8a45-df70ae459d84 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.159589 Apr 08 11:25:03.451129 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 676/1344] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:25:03 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:25:04.142803 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f903401f-7ee4-49c9-9d89-603b3e20b36a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:04.143346 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f903401f-7ee4-49c9-9d89-603b3e20b36a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:04.150324 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f903401f-7ee4-49c9-9d89-603b3e20b36a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:04.150785 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f903401f-7ee4-49c9-9d89-603b3e20b36a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:04.151568 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f903401f-7ee4-49c9-9d89-603b3e20b36a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:04.152014 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f903401f-7ee4-49c9-9d89-603b3e20b36a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:04.179186 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-3295b9b6-a6b9-4e92-81a5-405c5a2175c7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:04.180128 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-3295b9b6-a6b9-4e92-81a5-405c5a2175c7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:04.186588 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3295b9b6-a6b9-4e92-81a5-405c5a2175c7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:04.187041 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3295b9b6-a6b9-4e92-81a5-405c5a2175c7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:04.187818 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3295b9b6-a6b9-4e92-81a5-405c5a2175c7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:04.188285 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3295b9b6-a6b9-4e92-81a5-405c5a2175c7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:04.215391 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f903401f-7ee4-49c9-9d89-603b3e20b36a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:04.221014 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-3295b9b6-a6b9-4e92-81a5-405c5a2175c7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045958 Apr 08 11:25:04.221832 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 677/1345] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:04 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:25:04.223049 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f903401f-7ee4-49c9-9d89-603b3e20b36a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.086460 Apr 08 11:25:04.223857 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 669/1346] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:04 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:04.258565 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-f0df4fd1-6a5a-4246-89c6-5d2fa06235fc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:04.259314 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-f0df4fd1-6a5a-4246-89c6-5d2fa06235fc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:04.265210 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f0df4fd1-6a5a-4246-89c6-5d2fa06235fc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:04.265651 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f0df4fd1-6a5a-4246-89c6-5d2fa06235fc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:04.266439 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f0df4fd1-6a5a-4246-89c6-5d2fa06235fc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:04.266872 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f0df4fd1-6a5a-4246-89c6-5d2fa06235fc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:04.402150 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f0df4fd1-6a5a-4246-89c6-5d2fa06235fc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:04.409611 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-f0df4fd1-6a5a-4246-89c6-5d2fa06235fc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.155463 Apr 08 11:25:04.410253 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 678/1347] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:04 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:04.468345 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-58217c4d-c955-4ebb-bd30-66b5a7412378 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:04.469090 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-58217c4d-c955-4ebb-bd30-66b5a7412378 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:04.475240 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-58217c4d-c955-4ebb-bd30-66b5a7412378 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:04.475686 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-58217c4d-c955-4ebb-bd30-66b5a7412378 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:04.476523 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-58217c4d-c955-4ebb-bd30-66b5a7412378 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:04.476968 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-58217c4d-c955-4ebb-bd30-66b5a7412378 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:04.608285 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-58217c4d-c955-4ebb-bd30-66b5a7412378 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:04.616602 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-58217c4d-c955-4ebb-bd30-66b5a7412378 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:04.618901 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-58217c4d-c955-4ebb-bd30-66b5a7412378 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:04.620128 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-58217c4d-c955-4ebb-bd30-66b5a7412378 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.155715 Apr 08 11:25:04.620630 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 670/1348] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:25:04 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:25:05.233174 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-3e5f537e-1e2b-4914-b722-8f5a22ee6d2d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:05.234131 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-3e5f537e-1e2b-4914-b722-8f5a22ee6d2d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:05.239422 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-34ce4051-6470-4c3c-a53d-f143f17cf459 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:05.240034 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-34ce4051-6470-4c3c-a53d-f143f17cf459 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:05.240686 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3e5f537e-1e2b-4914-b722-8f5a22ee6d2d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:05.241144 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3e5f537e-1e2b-4914-b722-8f5a22ee6d2d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:05.241948 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3e5f537e-1e2b-4914-b722-8f5a22ee6d2d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:05.242660 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3e5f537e-1e2b-4914-b722-8f5a22ee6d2d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:05.246963 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-34ce4051-6470-4c3c-a53d-f143f17cf459 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:05.247423 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-34ce4051-6470-4c3c-a53d-f143f17cf459 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:05.248211 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-34ce4051-6470-4c3c-a53d-f143f17cf459 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:05.248652 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-34ce4051-6470-4c3c-a53d-f143f17cf459 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:05.271317 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-3e5f537e-1e2b-4914-b722-8f5a22ee6d2d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042094 Apr 08 11:25:05.271880 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 679/1349] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:05 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:05.307718 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-34ce4051-6470-4c3c-a53d-f143f17cf459 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:05.314976 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-34ce4051-6470-4c3c-a53d-f143f17cf459 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079406 Apr 08 11:25:05.315546 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 671/1350] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:05 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:25:05.426947 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-efbd49c4-1dc9-4f1c-9b22-13511c2c986d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:05.427567 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-efbd49c4-1dc9-4f1c-9b22-13511c2c986d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:05.433448 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-efbd49c4-1dc9-4f1c-9b22-13511c2c986d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:05.433943 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-efbd49c4-1dc9-4f1c-9b22-13511c2c986d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:05.434715 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-efbd49c4-1dc9-4f1c-9b22-13511c2c986d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:05.435154 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-efbd49c4-1dc9-4f1c-9b22-13511c2c986d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:05.569190 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-efbd49c4-1dc9-4f1c-9b22-13511c2c986d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:05.577495 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-efbd49c4-1dc9-4f1c-9b22-13511c2c986d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.154341 Apr 08 11:25:05.578116 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 680/1351] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:05 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:05.638973 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ad8da91b-a7b0-4244-965d-739a3e8639a0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:05.639776 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ad8da91b-a7b0-4244-965d-739a3e8639a0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:05.645854 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ad8da91b-a7b0-4244-965d-739a3e8639a0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:05.646317 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ad8da91b-a7b0-4244-965d-739a3e8639a0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:05.647092 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ad8da91b-a7b0-4244-965d-739a3e8639a0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:05.647537 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ad8da91b-a7b0-4244-965d-739a3e8639a0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:05.782040 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ad8da91b-a7b0-4244-965d-739a3e8639a0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:05.791010 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ad8da91b-a7b0-4244-965d-739a3e8639a0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:05.792545 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ad8da91b-a7b0-4244-965d-739a3e8639a0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:05.793719 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ad8da91b-a7b0-4244-965d-739a3e8639a0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.159253 Apr 08 11:25:05.794552 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 672/1352] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:25:05 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:25:06.283490 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-c3f49f5a-ff7a-463d-9a20-af05b502b512 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:06.284423 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-c3f49f5a-ff7a-463d-9a20-af05b502b512 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:06.291422 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c3f49f5a-ff7a-463d-9a20-af05b502b512 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:06.291873 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c3f49f5a-ff7a-463d-9a20-af05b502b512 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:06.292635 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c3f49f5a-ff7a-463d-9a20-af05b502b512 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:06.293080 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c3f49f5a-ff7a-463d-9a20-af05b502b512 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:06.320636 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-c3f49f5a-ff7a-463d-9a20-af05b502b512 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041069 Apr 08 11:25:06.321195 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 681/1353] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:06 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:06.331511 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7016c6c9-8cc6-42a7-a3f5-1f7e38b4b3d3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:06.332137 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7016c6c9-8cc6-42a7-a3f5-1f7e38b4b3d3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:06.339089 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7016c6c9-8cc6-42a7-a3f5-1f7e38b4b3d3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:06.339546 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7016c6c9-8cc6-42a7-a3f5-1f7e38b4b3d3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:06.340326 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7016c6c9-8cc6-42a7-a3f5-1f7e38b4b3d3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:06.340764 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7016c6c9-8cc6-42a7-a3f5-1f7e38b4b3d3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:06.400471 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7016c6c9-8cc6-42a7-a3f5-1f7e38b4b3d3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:06.408175 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7016c6c9-8cc6-42a7-a3f5-1f7e38b4b3d3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080483 Apr 08 11:25:06.408764 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 673/1354] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:06 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:06.594998 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-6ec7043f-7221-49c3-b9a9-03b359d04cf3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:06.595563 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-6ec7043f-7221-49c3-b9a9-03b359d04cf3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:06.601462 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6ec7043f-7221-49c3-b9a9-03b359d04cf3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:06.601954 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6ec7043f-7221-49c3-b9a9-03b359d04cf3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:06.602724 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6ec7043f-7221-49c3-b9a9-03b359d04cf3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:06.603200 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6ec7043f-7221-49c3-b9a9-03b359d04cf3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:06.737408 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6ec7043f-7221-49c3-b9a9-03b359d04cf3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:06.745509 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-6ec7043f-7221-49c3-b9a9-03b359d04cf3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.154673 Apr 08 11:25:06.746109 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 682/1355] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:06 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:06.812568 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-21e042b0-58c6-4abe-9732-fc688a71fff9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:06.813185 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-21e042b0-58c6-4abe-9732-fc688a71fff9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:06.819085 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-21e042b0-58c6-4abe-9732-fc688a71fff9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:06.819536 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-21e042b0-58c6-4abe-9732-fc688a71fff9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:06.820307 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-21e042b0-58c6-4abe-9732-fc688a71fff9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:06.820749 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-21e042b0-58c6-4abe-9732-fc688a71fff9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:06.950701 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-21e042b0-58c6-4abe-9732-fc688a71fff9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:06.958748 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-21e042b0-58c6-4abe-9732-fc688a71fff9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:06.960244 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-21e042b0-58c6-4abe-9732-fc688a71fff9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:06.961388 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-21e042b0-58c6-4abe-9732-fc688a71fff9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.152783 Apr 08 11:25:06.961986 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 674/1356] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:25:06 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:25:07.331933 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-674de657-a066-40c8-ae87-06a9d08c5797 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:07.332891 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-674de657-a066-40c8-ae87-06a9d08c5797 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:07.339178 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-674de657-a066-40c8-ae87-06a9d08c5797 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:07.339619 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-674de657-a066-40c8-ae87-06a9d08c5797 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:07.340379 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-674de657-a066-40c8-ae87-06a9d08c5797 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:07.340811 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-674de657-a066-40c8-ae87-06a9d08c5797 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:07.370703 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-674de657-a066-40c8-ae87-06a9d08c5797 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042654 Apr 08 11:25:07.371253 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 683/1357] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:07 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:07.425065 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6e979b65-1c0b-4ca2-a9f1-ce5aa5ab4884 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:07.425681 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6e979b65-1c0b-4ca2-a9f1-ce5aa5ab4884 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:07.432014 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6e979b65-1c0b-4ca2-a9f1-ce5aa5ab4884 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:07.432472 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6e979b65-1c0b-4ca2-a9f1-ce5aa5ab4884 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:07.433275 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6e979b65-1c0b-4ca2-a9f1-ce5aa5ab4884 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:07.433717 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6e979b65-1c0b-4ca2-a9f1-ce5aa5ab4884 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:07.492847 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6e979b65-1c0b-4ca2-a9f1-ce5aa5ab4884 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:07.500321 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6e979b65-1c0b-4ca2-a9f1-ce5aa5ab4884 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079085 Apr 08 11:25:07.500894 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 675/1358] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:07 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:07.762172 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-925cefcb-b44d-45e8-9908-ca990f9f3880 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:07.762792 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-925cefcb-b44d-45e8-9908-ca990f9f3880 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:07.768694 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-925cefcb-b44d-45e8-9908-ca990f9f3880 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:07.769148 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-925cefcb-b44d-45e8-9908-ca990f9f3880 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:07.770067 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-925cefcb-b44d-45e8-9908-ca990f9f3880 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:07.770443 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-925cefcb-b44d-45e8-9908-ca990f9f3880 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:07.909416 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-925cefcb-b44d-45e8-9908-ca990f9f3880 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:07.916690 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-925cefcb-b44d-45e8-9908-ca990f9f3880 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.158740 Apr 08 11:25:07.917252 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 684/1359] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:07 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:07.978559 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2fb214cf-168f-4d45-aeab-308851984347 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:07.979175 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2fb214cf-168f-4d45-aeab-308851984347 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:07.985123 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2fb214cf-168f-4d45-aeab-308851984347 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:07.985596 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2fb214cf-168f-4d45-aeab-308851984347 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:07.986380 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2fb214cf-168f-4d45-aeab-308851984347 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:07.986823 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2fb214cf-168f-4d45-aeab-308851984347 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:08.125119 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2fb214cf-168f-4d45-aeab-308851984347 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:08.133438 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2fb214cf-168f-4d45-aeab-308851984347 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:08.135530 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2fb214cf-168f-4d45-aeab-308851984347 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:08.136696 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2fb214cf-168f-4d45-aeab-308851984347 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.162086 Apr 08 11:25:08.137264 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 676/1360] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:25:07 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:25:08.382413 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-38bb8084-4d00-4ada-bb35-72843e16899b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:08.383351 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-38bb8084-4d00-4ada-bb35-72843e16899b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:08.390310 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-38bb8084-4d00-4ada-bb35-72843e16899b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:08.390764 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-38bb8084-4d00-4ada-bb35-72843e16899b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:08.391548 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-38bb8084-4d00-4ada-bb35-72843e16899b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:08.391991 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-38bb8084-4d00-4ada-bb35-72843e16899b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:08.419809 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-38bb8084-4d00-4ada-bb35-72843e16899b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041438 Apr 08 11:25:08.420438 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 685/1361] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:08 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:08.516678 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-539a6f9e-1c53-4ba9-88e4-698dcf1d0ce4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:08.517296 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-539a6f9e-1c53-4ba9-88e4-698dcf1d0ce4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:08.523616 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-539a6f9e-1c53-4ba9-88e4-698dcf1d0ce4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:08.524073 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-539a6f9e-1c53-4ba9-88e4-698dcf1d0ce4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:08.524851 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-539a6f9e-1c53-4ba9-88e4-698dcf1d0ce4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:08.525294 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-539a6f9e-1c53-4ba9-88e4-698dcf1d0ce4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:08.583464 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-539a6f9e-1c53-4ba9-88e4-698dcf1d0ce4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:08.590830 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-539a6f9e-1c53-4ba9-88e4-698dcf1d0ce4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078093 Apr 08 11:25:08.591402 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 677/1362] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:08 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:08.934045 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-1f064715-c9cc-4e78-9731-ab26ebe31ea8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:08.934646 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-1f064715-c9cc-4e78-9731-ab26ebe31ea8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:08.940791 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1f064715-c9cc-4e78-9731-ab26ebe31ea8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:08.941247 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1f064715-c9cc-4e78-9731-ab26ebe31ea8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:08.942046 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1f064715-c9cc-4e78-9731-ab26ebe31ea8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:08.942490 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1f064715-c9cc-4e78-9731-ab26ebe31ea8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:09.076370 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1f064715-c9cc-4e78-9731-ab26ebe31ea8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:09.083682 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-1f064715-c9cc-4e78-9731-ab26ebe31ea8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.153567 Apr 08 11:25:09.084257 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 686/1363] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:08 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:09.155754 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-35a79c78-2d9c-4997-9ff7-dd4517461134 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:09.156397 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-35a79c78-2d9c-4997-9ff7-dd4517461134 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:09.162289 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-35a79c78-2d9c-4997-9ff7-dd4517461134 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:09.162775 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-35a79c78-2d9c-4997-9ff7-dd4517461134 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:09.163551 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-35a79c78-2d9c-4997-9ff7-dd4517461134 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:09.163989 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-35a79c78-2d9c-4997-9ff7-dd4517461134 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:09.294050 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-35a79c78-2d9c-4997-9ff7-dd4517461134 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:09.302246 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-35a79c78-2d9c-4997-9ff7-dd4517461134 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:09.303755 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-35a79c78-2d9c-4997-9ff7-dd4517461134 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:09.304923 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-35a79c78-2d9c-4997-9ff7-dd4517461134 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.153239 Apr 08 11:25:09.305486 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 678/1364] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:25:09 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:25:09.431576 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-8cc8d62a-7866-4b0d-8709-bd54da6f60a8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:09.432509 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-8cc8d62a-7866-4b0d-8709-bd54da6f60a8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:09.438886 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8cc8d62a-7866-4b0d-8709-bd54da6f60a8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:09.439341 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8cc8d62a-7866-4b0d-8709-bd54da6f60a8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:09.440113 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8cc8d62a-7866-4b0d-8709-bd54da6f60a8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:09.440556 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8cc8d62a-7866-4b0d-8709-bd54da6f60a8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:09.469794 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-8cc8d62a-7866-4b0d-8709-bd54da6f60a8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042217 Apr 08 11:25:09.470355 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 687/1365] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:09 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:09.607463 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-fab87a68-5444-4838-b7b1-3cdac4f447c9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:09.608080 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-fab87a68-5444-4838-b7b1-3cdac4f447c9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:09.614564 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fab87a68-5444-4838-b7b1-3cdac4f447c9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:09.615019 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fab87a68-5444-4838-b7b1-3cdac4f447c9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:09.615789 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fab87a68-5444-4838-b7b1-3cdac4f447c9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:09.616227 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fab87a68-5444-4838-b7b1-3cdac4f447c9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:09.675494 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-fab87a68-5444-4838-b7b1-3cdac4f447c9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:09.683460 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-fab87a68-5444-4838-b7b1-3cdac4f447c9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079911 Apr 08 11:25:09.684046 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 679/1366] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:09 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:10.101168 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2d7b6dea-2a0f-4937-8580-fd3ae3e61b08 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:10.101795 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-2d7b6dea-2a0f-4937-8580-fd3ae3e61b08 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:10.108239 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2d7b6dea-2a0f-4937-8580-fd3ae3e61b08 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:10.108684 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2d7b6dea-2a0f-4937-8580-fd3ae3e61b08 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:10.109441 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2d7b6dea-2a0f-4937-8580-fd3ae3e61b08 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:10.109907 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2d7b6dea-2a0f-4937-8580-fd3ae3e61b08 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:10.253777 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2d7b6dea-2a0f-4937-8580-fd3ae3e61b08 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:10.261071 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-2d7b6dea-2a0f-4937-8580-fd3ae3e61b08 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.163812 Apr 08 11:25:10.261626 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 688/1367] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:10 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:10.322919 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a36cf0ed-caf9-465f-b195-112e9e5061f9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:10.323541 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a36cf0ed-caf9-465f-b195-112e9e5061f9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:10.329353 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a36cf0ed-caf9-465f-b195-112e9e5061f9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:10.329825 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a36cf0ed-caf9-465f-b195-112e9e5061f9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:10.330597 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a36cf0ed-caf9-465f-b195-112e9e5061f9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:10.331031 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a36cf0ed-caf9-465f-b195-112e9e5061f9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:10.460105 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a36cf0ed-caf9-465f-b195-112e9e5061f9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:10.468810 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a36cf0ed-caf9-465f-b195-112e9e5061f9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:10.470346 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a36cf0ed-caf9-465f-b195-112e9e5061f9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:10.471497 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a36cf0ed-caf9-465f-b195-112e9e5061f9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.152472 Apr 08 11:25:10.472059 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 680/1368] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:25:10 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:25:10.481571 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-cf8f1842-b2b3-4ebe-a258-51b8f57bcf32 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:10.482524 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-cf8f1842-b2b3-4ebe-a258-51b8f57bcf32 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:10.488939 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cf8f1842-b2b3-4ebe-a258-51b8f57bcf32 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:10.489398 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cf8f1842-b2b3-4ebe-a258-51b8f57bcf32 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:10.490312 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cf8f1842-b2b3-4ebe-a258-51b8f57bcf32 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:10.490740 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cf8f1842-b2b3-4ebe-a258-51b8f57bcf32 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:10.519257 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-cf8f1842-b2b3-4ebe-a258-51b8f57bcf32 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042239 Apr 08 11:25:10.519815 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 689/1369] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:10 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:10.700021 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d57ff1e0-3fb7-4520-800f-290d275c771d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:10.700627 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d57ff1e0-3fb7-4520-800f-290d275c771d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:10.707193 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d57ff1e0-3fb7-4520-800f-290d275c771d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:10.707700 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d57ff1e0-3fb7-4520-800f-290d275c771d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:10.708443 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d57ff1e0-3fb7-4520-800f-290d275c771d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:10.708883 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d57ff1e0-3fb7-4520-800f-290d275c771d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:10.771975 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d57ff1e0-3fb7-4520-800f-290d275c771d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:10.780249 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d57ff1e0-3fb7-4520-800f-290d275c771d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.084193 Apr 08 11:25:10.780827 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 681/1370] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:10 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:25:11.278054 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e0e513b2-6e2e-4115-aa95-9fde5f1c2718 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:11.278691 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e0e513b2-6e2e-4115-aa95-9fde5f1c2718 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:11.284624 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e0e513b2-6e2e-4115-aa95-9fde5f1c2718 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:11.285071 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e0e513b2-6e2e-4115-aa95-9fde5f1c2718 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:11.285864 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e0e513b2-6e2e-4115-aa95-9fde5f1c2718 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:11.286304 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e0e513b2-6e2e-4115-aa95-9fde5f1c2718 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:11.416295 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e0e513b2-6e2e-4115-aa95-9fde5f1c2718 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:11.423600 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e0e513b2-6e2e-4115-aa95-9fde5f1c2718 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.149381 Apr 08 11:25:11.424186 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 690/1371] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:11 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:11.490002 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d0d2c195-b1c1-41ed-9109-24adfd6b78f7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:11.490614 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d0d2c195-b1c1-41ed-9109-24adfd6b78f7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:11.497427 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d0d2c195-b1c1-41ed-9109-24adfd6b78f7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:11.497896 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d0d2c195-b1c1-41ed-9109-24adfd6b78f7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:11.498659 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d0d2c195-b1c1-41ed-9109-24adfd6b78f7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:11.499089 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d0d2c195-b1c1-41ed-9109-24adfd6b78f7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:11.530997 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-af738df6-3108-4c4a-8a32-e64691bf55a2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:11.531948 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-af738df6-3108-4c4a-8a32-e64691bf55a2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:11.538400 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-af738df6-3108-4c4a-8a32-e64691bf55a2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:11.538935 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-af738df6-3108-4c4a-8a32-e64691bf55a2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:11.539726 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-af738df6-3108-4c4a-8a32-e64691bf55a2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:11.540168 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-af738df6-3108-4c4a-8a32-e64691bf55a2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:11.569624 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-af738df6-3108-4c4a-8a32-e64691bf55a2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042518 Apr 08 11:25:11.570220 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 691/1372] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:11 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:25:11.630558 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d0d2c195-b1c1-41ed-9109-24adfd6b78f7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:11.638885 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d0d2c195-b1c1-41ed-9109-24adfd6b78f7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:11.640397 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d0d2c195-b1c1-41ed-9109-24adfd6b78f7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:11.641564 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d0d2c195-b1c1-41ed-9109-24adfd6b78f7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.155540 Apr 08 11:25:11.642159 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 682/1373] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:25:11 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:25:11.797367 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-7807f55a-09c8-4e45-8d90-fdde316f978a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:11.797918 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-7807f55a-09c8-4e45-8d90-fdde316f978a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:11.803783 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7807f55a-09c8-4e45-8d90-fdde316f978a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:11.804228 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7807f55a-09c8-4e45-8d90-fdde316f978a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:11.804984 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7807f55a-09c8-4e45-8d90-fdde316f978a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:11.805416 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7807f55a-09c8-4e45-8d90-fdde316f978a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:11.865633 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-7807f55a-09c8-4e45-8d90-fdde316f978a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:11.873871 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-7807f55a-09c8-4e45-8d90-fdde316f978a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080384 Apr 08 11:25:11.874439 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 692/1374] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:11 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:12.441019 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b39bf6e1-91ec-4ab4-ad0c-ad6fc0fb980b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:12.442320 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b39bf6e1-91ec-4ab4-ad0c-ad6fc0fb980b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:12.447962 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b39bf6e1-91ec-4ab4-ad0c-ad6fc0fb980b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:12.448415 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b39bf6e1-91ec-4ab4-ad0c-ad6fc0fb980b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:12.449720 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b39bf6e1-91ec-4ab4-ad0c-ad6fc0fb980b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:12.450178 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b39bf6e1-91ec-4ab4-ad0c-ad6fc0fb980b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:12.581085 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a9665378-768b-4641-8c7c-2a925c534c1a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:12.582039 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a9665378-768b-4641-8c7c-2a925c534c1a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:12.588274 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a9665378-768b-4641-8c7c-2a925c534c1a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:12.588709 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b39bf6e1-91ec-4ab4-ad0c-ad6fc0fb980b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:12.588847 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a9665378-768b-4641-8c7c-2a925c534c1a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:12.590042 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a9665378-768b-4641-8c7c-2a925c534c1a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:12.590478 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a9665378-768b-4641-8c7c-2a925c534c1a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:12.596888 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b39bf6e1-91ec-4ab4-ad0c-ad6fc0fb980b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.159718 Apr 08 11:25:12.597470 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 683/1375] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:12 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:12.619419 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a9665378-768b-4641-8c7c-2a925c534c1a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042334 Apr 08 11:25:12.619974 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 693/1376] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:12 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:25:12.660156 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-11c846db-e75f-4980-935b-243322903091 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:12.660765 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-11c846db-e75f-4980-935b-243322903091 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:12.666742 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-11c846db-e75f-4980-935b-243322903091 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:12.667222 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-11c846db-e75f-4980-935b-243322903091 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:12.667995 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-11c846db-e75f-4980-935b-243322903091 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:12.668432 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-11c846db-e75f-4980-935b-243322903091 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:12.799122 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-11c846db-e75f-4980-935b-243322903091 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:12.807437 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-11c846db-e75f-4980-935b-243322903091 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:12.809457 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-11c846db-e75f-4980-935b-243322903091 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:12.810639 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-11c846db-e75f-4980-935b-243322903091 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.154478 Apr 08 11:25:12.811208 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 684/1377] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:25:12 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:25:12.893498 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-055da789-ba2b-4bdd-a4c7-ea4b16a59369 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:12.894118 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-055da789-ba2b-4bdd-a4c7-ea4b16a59369 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:12.899992 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-055da789-ba2b-4bdd-a4c7-ea4b16a59369 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:12.900464 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-055da789-ba2b-4bdd-a4c7-ea4b16a59369 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:12.901199 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-055da789-ba2b-4bdd-a4c7-ea4b16a59369 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:12.901640 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-055da789-ba2b-4bdd-a4c7-ea4b16a59369 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:12.963010 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-055da789-ba2b-4bdd-a4c7-ea4b16a59369 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:12.970463 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-055da789-ba2b-4bdd-a4c7-ea4b16a59369 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080916 Apr 08 11:25:12.971031 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 694/1378] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:12 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:13.613914 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bb24e860-0c0a-4cdf-97c0-b6ff2ac04dfb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:13.614523 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-bb24e860-0c0a-4cdf-97c0-b6ff2ac04dfb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:13.621190 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bb24e860-0c0a-4cdf-97c0-b6ff2ac04dfb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:13.621643 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bb24e860-0c0a-4cdf-97c0-b6ff2ac04dfb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:13.622450 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bb24e860-0c0a-4cdf-97c0-b6ff2ac04dfb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:13.622896 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bb24e860-0c0a-4cdf-97c0-b6ff2ac04dfb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:13.631435 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-f0ea9f43-3c4b-4ade-a54f-6a066c7ac885 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:13.632358 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-f0ea9f43-3c4b-4ade-a54f-6a066c7ac885 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:13.638821 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f0ea9f43-3c4b-4ade-a54f-6a066c7ac885 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:13.639271 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f0ea9f43-3c4b-4ade-a54f-6a066c7ac885 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:13.640053 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f0ea9f43-3c4b-4ade-a54f-6a066c7ac885 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:13.640484 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f0ea9f43-3c4b-4ade-a54f-6a066c7ac885 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:13.670767 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-f0ea9f43-3c4b-4ade-a54f-6a066c7ac885 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043151 Apr 08 11:25:13.671598 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 695/1379] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:13 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:25:13.829199 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-06d55707-1f55-4632-a750-1db5d70953ef tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:13.830025 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-06d55707-1f55-4632-a750-1db5d70953ef tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:13.836279 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-06d55707-1f55-4632-a750-1db5d70953ef tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:13.836736 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-06d55707-1f55-4632-a750-1db5d70953ef tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:13.837525 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-06d55707-1f55-4632-a750-1db5d70953ef tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:13.838012 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-06d55707-1f55-4632-a750-1db5d70953ef tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:14.064223 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-bb24e860-0c0a-4cdf-97c0-b6ff2ac04dfb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:14.068677 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-06d55707-1f55-4632-a750-1db5d70953ef tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:14.071778 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-bb24e860-0c0a-4cdf-97c0-b6ff2ac04dfb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.461738 Apr 08 11:25:14.072702 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 685/1380] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:13 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:14.077671 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-017542b1-8f9f-4d01-8b8e-f404c0b3b00e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:14.077962 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-06d55707-1f55-4632-a750-1db5d70953ef tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:14.078308 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-017542b1-8f9f-4d01-8b8e-f404c0b3b00e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:14.079215 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-06d55707-1f55-4632-a750-1db5d70953ef tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:14.080359 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-06d55707-1f55-4632-a750-1db5d70953ef tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.255211 Apr 08 11:25:14.080898 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 696/1381] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:25:13 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:25:14.084101 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-017542b1-8f9f-4d01-8b8e-f404c0b3b00e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:14.084553 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-017542b1-8f9f-4d01-8b8e-f404c0b3b00e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:14.085325 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-017542b1-8f9f-4d01-8b8e-f404c0b3b00e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:14.085781 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-017542b1-8f9f-4d01-8b8e-f404c0b3b00e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:14.148897 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-017542b1-8f9f-4d01-8b8e-f404c0b3b00e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:14.156285 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-017542b1-8f9f-4d01-8b8e-f404c0b3b00e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082636 Apr 08 11:25:14.156854 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 686/1382] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:14 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:14.682523 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-fd3e3fe2-a74c-4b6b-87fa-dec53185141e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:14.683457 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-fd3e3fe2-a74c-4b6b-87fa-dec53185141e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:14.690468 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fd3e3fe2-a74c-4b6b-87fa-dec53185141e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:14.690926 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fd3e3fe2-a74c-4b6b-87fa-dec53185141e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:14.691712 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fd3e3fe2-a74c-4b6b-87fa-dec53185141e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:14.692153 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fd3e3fe2-a74c-4b6b-87fa-dec53185141e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:14.720238 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-fd3e3fe2-a74c-4b6b-87fa-dec53185141e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041726 Apr 08 11:25:14.720793 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 697/1383] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:14 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:15.089618 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e477e5cd-8e7c-4296-af66-2b1505ae60fb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:15.090748 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e477e5cd-8e7c-4296-af66-2b1505ae60fb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:15.097999 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e477e5cd-8e7c-4296-af66-2b1505ae60fb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:15.098457 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e477e5cd-8e7c-4296-af66-2b1505ae60fb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:15.098623 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-649699d0-8d2d-4e25-a37a-0a4ae1e16945 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:15.099207 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-649699d0-8d2d-4e25-a37a-0a4ae1e16945 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:15.099329 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e477e5cd-8e7c-4296-af66-2b1505ae60fb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:15.099696 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e477e5cd-8e7c-4296-af66-2b1505ae60fb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:15.105073 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-649699d0-8d2d-4e25-a37a-0a4ae1e16945 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:15.106127 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-649699d0-8d2d-4e25-a37a-0a4ae1e16945 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:15.106904 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-649699d0-8d2d-4e25-a37a-0a4ae1e16945 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:15.107341 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-649699d0-8d2d-4e25-a37a-0a4ae1e16945 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:15.296381 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e477e5cd-8e7c-4296-af66-2b1505ae60fb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:15.300177 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-649699d0-8d2d-4e25-a37a-0a4ae1e16945 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:15.303929 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e477e5cd-8e7c-4296-af66-2b1505ae60fb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.218120 Apr 08 11:25:15.304514 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 687/1384] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:15 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:15.308502 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-649699d0-8d2d-4e25-a37a-0a4ae1e16945 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:15.308940 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1ebb1cc0-0fb3-451a-b121-38c6719aaaa6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:15.309554 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1ebb1cc0-0fb3-451a-b121-38c6719aaaa6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:15.310338 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-649699d0-8d2d-4e25-a37a-0a4ae1e16945 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:15.311502 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-649699d0-8d2d-4e25-a37a-0a4ae1e16945 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.216707 Apr 08 11:25:15.312054 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 698/1385] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:25:15 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:25:15.321845 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ebb1cc0-0fb3-451a-b121-38c6719aaaa6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:15.322298 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ebb1cc0-0fb3-451a-b121-38c6719aaaa6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:15.323070 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ebb1cc0-0fb3-451a-b121-38c6719aaaa6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:15.323502 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ebb1cc0-0fb3-451a-b121-38c6719aaaa6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:15.382230 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1ebb1cc0-0fb3-451a-b121-38c6719aaaa6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:15.389996 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1ebb1cc0-0fb3-451a-b121-38c6719aaaa6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.084513 Apr 08 11:25:15.390562 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 688/1386] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:15 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:15.731708 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-825a5703-b0da-4b16-b221-56a3f16b4f3a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:15.732633 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-825a5703-b0da-4b16-b221-56a3f16b4f3a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:15.738839 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-825a5703-b0da-4b16-b221-56a3f16b4f3a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:15.739289 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-825a5703-b0da-4b16-b221-56a3f16b4f3a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:15.740046 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-825a5703-b0da-4b16-b221-56a3f16b4f3a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:15.740476 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-825a5703-b0da-4b16-b221-56a3f16b4f3a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:15.769414 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-825a5703-b0da-4b16-b221-56a3f16b4f3a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041626 Apr 08 11:25:15.769989 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 699/1387] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:15 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:16.320876 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ffc86550-bb9b-4b23-9097-7fb700e2ae74 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:16.321494 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ffc86550-bb9b-4b23-9097-7fb700e2ae74 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:16.328155 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ffc86550-bb9b-4b23-9097-7fb700e2ae74 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:16.328361 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-04e1f430-34f6-4d34-831f-9169d172ec4e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:16.328617 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ffc86550-bb9b-4b23-9097-7fb700e2ae74 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:16.328935 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-04e1f430-34f6-4d34-831f-9169d172ec4e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:16.329430 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ffc86550-bb9b-4b23-9097-7fb700e2ae74 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:16.329965 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ffc86550-bb9b-4b23-9097-7fb700e2ae74 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:16.334715 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-04e1f430-34f6-4d34-831f-9169d172ec4e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:16.335173 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-04e1f430-34f6-4d34-831f-9169d172ec4e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:16.335990 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-04e1f430-34f6-4d34-831f-9169d172ec4e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:16.336432 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-04e1f430-34f6-4d34-831f-9169d172ec4e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:16.532106 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ffc86550-bb9b-4b23-9097-7fb700e2ae74 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:16.535451 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-04e1f430-34f6-4d34-831f-9169d172ec4e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:16.539710 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ffc86550-bb9b-4b23-9097-7fb700e2ae74 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.222725 Apr 08 11:25:16.540255 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 689/1388] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:16 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:16.544841 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bca5d6a1-6335-4818-bc0d-46441b29293c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:16.545450 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-bca5d6a1-6335-4818-bc0d-46441b29293c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:16.545808 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-04e1f430-34f6-4d34-831f-9169d172ec4e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:16.547338 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-04e1f430-34f6-4d34-831f-9169d172ec4e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:16.548509 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-04e1f430-34f6-4d34-831f-9169d172ec4e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.224133 Apr 08 11:25:16.549945 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 700/1389] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:25:16 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:25:16.551361 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bca5d6a1-6335-4818-bc0d-46441b29293c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:16.551814 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bca5d6a1-6335-4818-bc0d-46441b29293c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:16.552592 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bca5d6a1-6335-4818-bc0d-46441b29293c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:16.553027 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bca5d6a1-6335-4818-bc0d-46441b29293c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:16.615881 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-bca5d6a1-6335-4818-bc0d-46441b29293c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:16.624068 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-bca5d6a1-6335-4818-bc0d-46441b29293c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082778 Apr 08 11:25:16.624647 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 690/1390] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:16 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:16.781075 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2de79110-ffaa-468f-9d57-44b68bd14dbd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:16.782042 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-2de79110-ffaa-468f-9d57-44b68bd14dbd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:16.788367 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2de79110-ffaa-468f-9d57-44b68bd14dbd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:16.788823 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2de79110-ffaa-468f-9d57-44b68bd14dbd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:16.789592 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2de79110-ffaa-468f-9d57-44b68bd14dbd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:16.790062 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2de79110-ffaa-468f-9d57-44b68bd14dbd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:16.819077 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-2de79110-ffaa-468f-9d57-44b68bd14dbd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041939 Apr 08 11:25:16.819637 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 701/1391] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:16 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:17.556812 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4414e33b-9c2f-4ee7-a24e-9d003f078988 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:17.559045 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4414e33b-9c2f-4ee7-a24e-9d003f078988 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:17.564174 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4414e33b-9c2f-4ee7-a24e-9d003f078988 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:17.564629 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4414e33b-9c2f-4ee7-a24e-9d003f078988 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:17.565691 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4414e33b-9c2f-4ee7-a24e-9d003f078988 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:17.565928 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4414e33b-9c2f-4ee7-a24e-9d003f078988 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:17.569935 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-163aed15-8028-4501-a425-4c44f39120f4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:17.570567 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-163aed15-8028-4501-a425-4c44f39120f4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:17.577013 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-163aed15-8028-4501-a425-4c44f39120f4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:17.577475 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-163aed15-8028-4501-a425-4c44f39120f4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:17.578284 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-163aed15-8028-4501-a425-4c44f39120f4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:17.578747 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-163aed15-8028-4501-a425-4c44f39120f4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:17.775419 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4414e33b-9c2f-4ee7-a24e-9d003f078988 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:17.779957 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-163aed15-8028-4501-a425-4c44f39120f4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:17.783685 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4414e33b-9c2f-4ee7-a24e-9d003f078988 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.230726 Apr 08 11:25:17.784274 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 691/1392] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:17 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:17.788664 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-163aed15-8028-4501-a425-4c44f39120f4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:17.789164 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-97032e91-3e39-43fc-bc30-c1a8d1367b10 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:17.789390 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-97032e91-3e39-43fc-bc30-c1a8d1367b10 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:17.790216 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-163aed15-8028-4501-a425-4c44f39120f4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:17.791386 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-163aed15-8028-4501-a425-4c44f39120f4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.227839 Apr 08 11:25:17.792207 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 702/1393] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:25:17 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:25:17.795860 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-97032e91-3e39-43fc-bc30-c1a8d1367b10 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:17.796385 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-97032e91-3e39-43fc-bc30-c1a8d1367b10 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:17.797170 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-97032e91-3e39-43fc-bc30-c1a8d1367b10 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:17.797605 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-97032e91-3e39-43fc-bc30-c1a8d1367b10 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:17.831318 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-212ca606-03aa-4410-8a58-0d170b3ef5e0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:17.832237 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-212ca606-03aa-4410-8a58-0d170b3ef5e0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:17.838513 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-212ca606-03aa-4410-8a58-0d170b3ef5e0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:17.838969 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-212ca606-03aa-4410-8a58-0d170b3ef5e0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:17.840294 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-212ca606-03aa-4410-8a58-0d170b3ef5e0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:17.840745 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-212ca606-03aa-4410-8a58-0d170b3ef5e0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:17.856802 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-97032e91-3e39-43fc-bc30-c1a8d1367b10 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:17.864291 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-97032e91-3e39-43fc-bc30-c1a8d1367b10 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079052 Apr 08 11:25:17.864866 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 692/1394] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:17 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:17.870686 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-212ca606-03aa-4410-8a58-0d170b3ef5e0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043289 Apr 08 11:25:17.871853 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 703/1395] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:17 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:25:18.800877 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-137f83e0-9a31-4a5a-b3c1-74ab75e21ecc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:18.801494 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-137f83e0-9a31-4a5a-b3c1-74ab75e21ecc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:18.807945 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-137f83e0-9a31-4a5a-b3c1-74ab75e21ecc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:18.808213 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-94e80de4-06be-45a4-b088-793d02d8ecc2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:18.809130 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-137f83e0-9a31-4a5a-b3c1-74ab75e21ecc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:18.809322 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-94e80de4-06be-45a4-b088-793d02d8ecc2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:18.809668 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-137f83e0-9a31-4a5a-b3c1-74ab75e21ecc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:18.810135 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-137f83e0-9a31-4a5a-b3c1-74ab75e21ecc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:18.815247 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-94e80de4-06be-45a4-b088-793d02d8ecc2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:18.815695 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-94e80de4-06be-45a4-b088-793d02d8ecc2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:18.816454 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-94e80de4-06be-45a4-b088-793d02d8ecc2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:18.816886 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-94e80de4-06be-45a4-b088-793d02d8ecc2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:19.001836 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-137f83e0-9a31-4a5a-b3c1-74ab75e21ecc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:19.009347 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-137f83e0-9a31-4a5a-b3c1-74ab75e21ecc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.212328 Apr 08 11:25:19.012496 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-94e80de4-06be-45a4-b088-793d02d8ecc2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:19.013915 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 693/1396] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:18 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:19.019015 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0553d44b-0ae5-4672-a2d6-89e25fedca2f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:19.020027 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0553d44b-0ae5-4672-a2d6-89e25fedca2f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:19.020784 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-94e80de4-06be-45a4-b088-793d02d8ecc2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:19.022293 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-94e80de4-06be-45a4-b088-793d02d8ecc2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:19.023442 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-94e80de4-06be-45a4-b088-793d02d8ecc2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.219087 Apr 08 11:25:19.023990 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 704/1397] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:25:18 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:25:19.026282 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0553d44b-0ae5-4672-a2d6-89e25fedca2f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:19.026740 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0553d44b-0ae5-4672-a2d6-89e25fedca2f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:19.027515 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0553d44b-0ae5-4672-a2d6-89e25fedca2f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:19.027958 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0553d44b-0ae5-4672-a2d6-89e25fedca2f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:19.028282 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2602212a-681d-49ea-a045-d8e4b8533c7a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:19.028882 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-2602212a-681d-49ea-a045-d8e4b8533c7a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:19.034562 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2602212a-681d-49ea-a045-d8e4b8533c7a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:19.035009 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2602212a-681d-49ea-a045-d8e4b8533c7a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:19.035772 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2602212a-681d-49ea-a045-d8e4b8533c7a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:19.036206 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2602212a-681d-49ea-a045-d8e4b8533c7a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:19.058165 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0553d44b-0ae5-4672-a2d6-89e25fedca2f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042856 Apr 08 11:25:19.059345 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 694/1398] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:19 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:19.094672 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2602212a-681d-49ea-a045-d8e4b8533c7a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:19.101929 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-2602212a-681d-49ea-a045-d8e4b8533c7a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.076983 Apr 08 11:25:19.102492 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 705/1399] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:19 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:20.026199 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e5e1d395-de72-40c7-a38f-6cb86c867f0f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:20.026815 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e5e1d395-de72-40c7-a38f-6cb86c867f0f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:20.033752 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e5e1d395-de72-40c7-a38f-6cb86c867f0f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:20.034237 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e5e1d395-de72-40c7-a38f-6cb86c867f0f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:20.035015 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e5e1d395-de72-40c7-a38f-6cb86c867f0f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:20.035467 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e5e1d395-de72-40c7-a38f-6cb86c867f0f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:20.041521 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-93128f91-6072-404d-9c9e-5bc31b379255 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:20.042158 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-93128f91-6072-404d-9c9e-5bc31b379255 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:20.048169 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-93128f91-6072-404d-9c9e-5bc31b379255 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:20.048622 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-93128f91-6072-404d-9c9e-5bc31b379255 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:20.049390 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-93128f91-6072-404d-9c9e-5bc31b379255 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:20.049856 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-93128f91-6072-404d-9c9e-5bc31b379255 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:20.245463 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e5e1d395-de72-40c7-a38f-6cb86c867f0f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:20.249022 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-93128f91-6072-404d-9c9e-5bc31b379255 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:20.253440 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e5e1d395-de72-40c7-a38f-6cb86c867f0f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.231092 Apr 08 11:25:20.254154 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 695/1400] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:20 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:20.257292 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-93128f91-6072-404d-9c9e-5bc31b379255 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:20.258545 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-93b7c194-ece0-4d8d-a673-6631c366ec14 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:20.258913 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-93128f91-6072-404d-9c9e-5bc31b379255 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:20.259455 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-93b7c194-ece0-4d8d-a673-6631c366ec14 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:20.260074 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-93128f91-6072-404d-9c9e-5bc31b379255 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.222540 Apr 08 11:25:20.260830 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 706/1401] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:25:20 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:25:20.266628 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-93b7c194-ece0-4d8d-a673-6631c366ec14 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:20.267091 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-93b7c194-ece0-4d8d-a673-6631c366ec14 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:20.267879 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-93b7c194-ece0-4d8d-a673-6631c366ec14 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:20.268325 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-93b7c194-ece0-4d8d-a673-6631c366ec14 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:20.274558 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-c7b49ca8-82e7-4439-983b-572f1a0e7188 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:20.275164 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-c7b49ca8-82e7-4439-983b-572f1a0e7188 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:20.280831 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c7b49ca8-82e7-4439-983b-572f1a0e7188 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:20.281275 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c7b49ca8-82e7-4439-983b-572f1a0e7188 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:20.282057 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c7b49ca8-82e7-4439-983b-572f1a0e7188 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:20.282513 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c7b49ca8-82e7-4439-983b-572f1a0e7188 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:20.296542 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-93b7c194-ece0-4d8d-a673-6631c366ec14 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041480 Apr 08 11:25:20.297109 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 696/1402] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:20 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:20.345323 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-c7b49ca8-82e7-4439-983b-572f1a0e7188 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:20.352683 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-c7b49ca8-82e7-4439-983b-572f1a0e7188 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.089366 Apr 08 11:25:20.353254 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 707/1403] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:20 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:21.271073 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d1c8677e-5468-475b-b467-284fcbb2d1fd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:21.271695 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d1c8677e-5468-475b-b467-284fcbb2d1fd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:21.278116 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-1cf71f1c-8000-428b-914b-1cb2ee4887ee tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:21.278732 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d1c8677e-5468-475b-b467-284fcbb2d1fd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:21.278846 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-1cf71f1c-8000-428b-914b-1cb2ee4887ee tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:21.279190 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d1c8677e-5468-475b-b467-284fcbb2d1fd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:21.279970 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d1c8677e-5468-475b-b467-284fcbb2d1fd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:21.280413 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d1c8677e-5468-475b-b467-284fcbb2d1fd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:21.284984 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1cf71f1c-8000-428b-914b-1cb2ee4887ee tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:21.285441 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1cf71f1c-8000-428b-914b-1cb2ee4887ee tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:21.286233 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1cf71f1c-8000-428b-914b-1cb2ee4887ee tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:21.286669 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1cf71f1c-8000-428b-914b-1cb2ee4887ee tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:21.477652 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d1c8677e-5468-475b-b467-284fcbb2d1fd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:21.480748 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1cf71f1c-8000-428b-914b-1cb2ee4887ee tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:21.485154 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d1c8677e-5468-475b-b467-284fcbb2d1fd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.217949 Apr 08 11:25:21.485894 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 697/1404] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:21 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:25:21.489390 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1cf71f1c-8000-428b-914b-1cb2ee4887ee tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:21.490638 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-072c6fde-fef0-48c6-9761-4a08364d646e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:21.490916 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1cf71f1c-8000-428b-914b-1cb2ee4887ee tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:21.491718 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-072c6fde-fef0-48c6-9761-4a08364d646e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:21.492343 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-1cf71f1c-8000-428b-914b-1cb2ee4887ee tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.218498 Apr 08 11:25:21.493057 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 708/1405] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:25:21 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:25:21.497900 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-072c6fde-fef0-48c6-9761-4a08364d646e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:21.498444 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-072c6fde-fef0-48c6-9761-4a08364d646e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:21.499355 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-072c6fde-fef0-48c6-9761-4a08364d646e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:21.499870 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-072c6fde-fef0-48c6-9761-4a08364d646e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:21.499980 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-017d28e3-3ded-49db-84cc-74a5a0588b9e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:21.500512 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-017d28e3-3ded-49db-84cc-74a5a0588b9e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:21.506331 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-017d28e3-3ded-49db-84cc-74a5a0588b9e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:21.506787 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-017d28e3-3ded-49db-84cc-74a5a0588b9e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:21.507568 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-017d28e3-3ded-49db-84cc-74a5a0588b9e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:21.508012 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-017d28e3-3ded-49db-84cc-74a5a0588b9e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:21.530114 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-072c6fde-fef0-48c6-9761-4a08364d646e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042971 Apr 08 11:25:21.530609 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 698/1406] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:21 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:21.567469 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-017d28e3-3ded-49db-84cc-74a5a0588b9e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:21.575380 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-017d28e3-3ded-49db-84cc-74a5a0588b9e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079160 Apr 08 11:25:21.575953 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 709/1407] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:21 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:22.502980 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5d477747-ecdb-4f63-9273-1352715cb646 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:22.503630 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5d477747-ecdb-4f63-9273-1352715cb646 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:22.510100 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5d477747-ecdb-4f63-9273-1352715cb646 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:22.510290 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-fe776a61-28a8-4e7f-b204-73659fb627b6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:22.510733 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5d477747-ecdb-4f63-9273-1352715cb646 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:22.510836 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-fe776a61-28a8-4e7f-b204-73659fb627b6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:22.511314 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5d477747-ecdb-4f63-9273-1352715cb646 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:22.511752 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5d477747-ecdb-4f63-9273-1352715cb646 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:22.516914 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fe776a61-28a8-4e7f-b204-73659fb627b6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:22.517370 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fe776a61-28a8-4e7f-b204-73659fb627b6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:22.518179 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fe776a61-28a8-4e7f-b204-73659fb627b6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:22.518619 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fe776a61-28a8-4e7f-b204-73659fb627b6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:22.711792 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5d477747-ecdb-4f63-9273-1352715cb646 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:22.715319 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-fe776a61-28a8-4e7f-b204-73659fb627b6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:22.719959 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5d477747-ecdb-4f63-9273-1352715cb646 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.220858 Apr 08 11:25:22.720662 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 699/1408] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:22 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:22.723831 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-fe776a61-28a8-4e7f-b204-73659fb627b6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:22.725323 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-fe776a61-28a8-4e7f-b204-73659fb627b6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:22.725461 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-00d341d6-f91c-45ff-896e-b1a6c9192964 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:22.726449 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-00d341d6-f91c-45ff-896e-b1a6c9192964 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:22.726580 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-fe776a61-28a8-4e7f-b204-73659fb627b6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.220247 Apr 08 11:25:22.727177 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 710/1409] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:25:22 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:25:22.732897 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-00d341d6-f91c-45ff-896e-b1a6c9192964 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:22.733434 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-00d341d6-f91c-45ff-896e-b1a6c9192964 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:22.734329 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-00d341d6-f91c-45ff-896e-b1a6c9192964 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:22.734844 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-00d341d6-f91c-45ff-896e-b1a6c9192964 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:22.734967 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-42c276cb-4630-499d-aaa2-52ac9d214916 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:22.735634 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-42c276cb-4630-499d-aaa2-52ac9d214916 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:22.741549 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-42c276cb-4630-499d-aaa2-52ac9d214916 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:22.742316 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-42c276cb-4630-499d-aaa2-52ac9d214916 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:22.743094 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-42c276cb-4630-499d-aaa2-52ac9d214916 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:22.743537 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-42c276cb-4630-499d-aaa2-52ac9d214916 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:22.764001 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-00d341d6-f91c-45ff-896e-b1a6c9192964 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042273 Apr 08 11:25:22.764573 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 700/1410] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:22 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:22.802091 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-42c276cb-4630-499d-aaa2-52ac9d214916 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:22.809547 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-42c276cb-4630-499d-aaa2-52ac9d214916 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078297 Apr 08 11:25:22.810152 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 711/1411] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:22 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:23.737303 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7c92795c-8882-449a-be76-58cbb16b5386 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:23.738038 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7c92795c-8882-449a-be76-58cbb16b5386 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:23.744396 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-1782b42f-7cee-45c0-8cc7-acfb4483c9d0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:23.744915 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7c92795c-8882-449a-be76-58cbb16b5386 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:23.745029 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7c92795c-8882-449a-be76-58cbb16b5386 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:23.746446 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7c92795c-8882-449a-be76-58cbb16b5386 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:23.746580 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-1782b42f-7cee-45c0-8cc7-acfb4483c9d0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:23.746900 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7c92795c-8882-449a-be76-58cbb16b5386 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:23.752724 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1782b42f-7cee-45c0-8cc7-acfb4483c9d0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:23.753180 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1782b42f-7cee-45c0-8cc7-acfb4483c9d0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:23.754011 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1782b42f-7cee-45c0-8cc7-acfb4483c9d0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:23.754456 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1782b42f-7cee-45c0-8cc7-acfb4483c9d0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:23.943210 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7c92795c-8882-449a-be76-58cbb16b5386 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:23.947230 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1782b42f-7cee-45c0-8cc7-acfb4483c9d0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:23.950661 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7c92795c-8882-449a-be76-58cbb16b5386 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.217355 Apr 08 11:25:23.951246 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 701/1412] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:23 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:23.955677 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1782b42f-7cee-45c0-8cc7-acfb4483c9d0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:23.955857 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-944fb85a-6692-4c34-8f3a-7008afe4c6f1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:23.956683 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-944fb85a-6692-4c34-8f3a-7008afe4c6f1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:23.957190 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1782b42f-7cee-45c0-8cc7-acfb4483c9d0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:23.958384 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-1782b42f-7cee-45c0-8cc7-acfb4483c9d0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.218088 Apr 08 11:25:23.960629 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 712/1413] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:25:23 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:25:23.962533 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-944fb85a-6692-4c34-8f3a-7008afe4c6f1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:23.962987 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-944fb85a-6692-4c34-8f3a-7008afe4c6f1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:23.963683 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-c0c30e07-8ead-482f-9529-90c2e92e8a8c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:23.963820 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-944fb85a-6692-4c34-8f3a-7008afe4c6f1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:23.964186 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-944fb85a-6692-4c34-8f3a-7008afe4c6f1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:23.964819 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-c0c30e07-8ead-482f-9529-90c2e92e8a8c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:23.971349 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c0c30e07-8ead-482f-9529-90c2e92e8a8c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:23.971808 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c0c30e07-8ead-482f-9529-90c2e92e8a8c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:23.972621 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c0c30e07-8ead-482f-9529-90c2e92e8a8c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:23.973065 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c0c30e07-8ead-482f-9529-90c2e92e8a8c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:23.994541 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-944fb85a-6692-4c34-8f3a-7008afe4c6f1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042183 Apr 08 11:25:23.995035 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 702/1414] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:23 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:24.031754 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-c0c30e07-8ead-482f-9529-90c2e92e8a8c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:24.039797 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-c0c30e07-8ead-482f-9529-90c2e92e8a8c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079627 Apr 08 11:25:24.040367 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 713/1415] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:23 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:24.967665 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-cd3ac036-29b6-467a-b48f-35bd6a00ae15 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:24.968189 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-cd3ac036-29b6-467a-b48f-35bd6a00ae15 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:24.974675 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cd3ac036-29b6-467a-b48f-35bd6a00ae15 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:24.975130 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cd3ac036-29b6-467a-b48f-35bd6a00ae15 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:24.975906 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cd3ac036-29b6-467a-b48f-35bd6a00ae15 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:24.976191 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a0a39f62-2ac5-445d-ad7a-0fc1d7e7e5a1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:24.976601 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cd3ac036-29b6-467a-b48f-35bd6a00ae15 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:24.976831 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a0a39f62-2ac5-445d-ad7a-0fc1d7e7e5a1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:24.983998 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a0a39f62-2ac5-445d-ad7a-0fc1d7e7e5a1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:24.984457 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a0a39f62-2ac5-445d-ad7a-0fc1d7e7e5a1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:24.985228 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a0a39f62-2ac5-445d-ad7a-0fc1d7e7e5a1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:24.985668 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a0a39f62-2ac5-445d-ad7a-0fc1d7e7e5a1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:25.176470 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-cd3ac036-29b6-467a-b48f-35bd6a00ae15 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:25.179689 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a0a39f62-2ac5-445d-ad7a-0fc1d7e7e5a1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:25.184240 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-cd3ac036-29b6-467a-b48f-35bd6a00ae15 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.220950 Apr 08 11:25:25.184820 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 703/1416] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:24 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:25.189416 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0aa8edd9-fa90-41f9-9116-84ce74d7e915 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:25.190361 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0aa8edd9-fa90-41f9-9116-84ce74d7e915 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:25.194273 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a0a39f62-2ac5-445d-ad7a-0fc1d7e7e5a1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:25.195779 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a0a39f62-2ac5-445d-ad7a-0fc1d7e7e5a1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:25.195984 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0aa8edd9-fa90-41f9-9116-84ce74d7e915 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:25.196514 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0aa8edd9-fa90-41f9-9116-84ce74d7e915 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:25.197062 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a0a39f62-2ac5-445d-ad7a-0fc1d7e7e5a1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.224714 Apr 08 11:25:25.197227 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0aa8edd9-fa90-41f9-9116-84ce74d7e915 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:25.197660 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 714/1417] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:25:24 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:25:25.197837 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0aa8edd9-fa90-41f9-9116-84ce74d7e915 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:25.202588 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-1f1f1265-e49a-428c-9ac7-3f43ae0438d3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:25.203201 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-1f1f1265-e49a-428c-9ac7-3f43ae0438d3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:25.208848 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1f1f1265-e49a-428c-9ac7-3f43ae0438d3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:25.209297 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1f1f1265-e49a-428c-9ac7-3f43ae0438d3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:25.210098 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1f1f1265-e49a-428c-9ac7-3f43ae0438d3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:25.210535 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1f1f1265-e49a-428c-9ac7-3f43ae0438d3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:25.228939 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0aa8edd9-fa90-41f9-9116-84ce74d7e915 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042851 Apr 08 11:25:25.229292 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 704/1418] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:25 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:25.272760 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1f1f1265-e49a-428c-9ac7-3f43ae0438d3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:25.280762 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-1f1f1265-e49a-428c-9ac7-3f43ae0438d3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082144 Apr 08 11:25:25.281330 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 715/1419] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:25 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:26.201153 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-afa6dd35-1b03-4020-8f53-f7b14fa45432 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:26.201822 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-afa6dd35-1b03-4020-8f53-f7b14fa45432 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:26.207931 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-afa6dd35-1b03-4020-8f53-f7b14fa45432 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:26.208386 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-afa6dd35-1b03-4020-8f53-f7b14fa45432 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:26.209157 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-afa6dd35-1b03-4020-8f53-f7b14fa45432 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:26.209599 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-afa6dd35-1b03-4020-8f53-f7b14fa45432 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:26.215966 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-7f1edd41-671a-4596-890b-68b0284ea442 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:26.216580 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-7f1edd41-671a-4596-890b-68b0284ea442 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:26.222867 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7f1edd41-671a-4596-890b-68b0284ea442 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:26.223302 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7f1edd41-671a-4596-890b-68b0284ea442 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:26.224084 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7f1edd41-671a-4596-890b-68b0284ea442 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:26.224526 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7f1edd41-671a-4596-890b-68b0284ea442 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:26.429027 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-afa6dd35-1b03-4020-8f53-f7b14fa45432 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:26.432099 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-7f1edd41-671a-4596-890b-68b0284ea442 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:26.437151 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-afa6dd35-1b03-4020-8f53-f7b14fa45432 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.240482 Apr 08 11:25:26.437892 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 705/1420] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:26 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:26.441394 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-7f1edd41-671a-4596-890b-68b0284ea442 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:26.442334 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-07b131ab-60df-496a-8997-7bc850d129d7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:26.442932 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-7f1edd41-671a-4596-890b-68b0284ea442 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:26.443266 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-07b131ab-60df-496a-8997-7bc850d129d7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:26.444170 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-7f1edd41-671a-4596-890b-68b0284ea442 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.232199 Apr 08 11:25:26.445799 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 716/1421] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:25:26 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:25:26.450944 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-85201512-1380-431e-9295-f343de1461be tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:26.451112 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-07b131ab-60df-496a-8997-7bc850d129d7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:26.451501 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-07b131ab-60df-496a-8997-7bc850d129d7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:26.451633 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-85201512-1380-431e-9295-f343de1461be tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:26.452236 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-07b131ab-60df-496a-8997-7bc850d129d7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:26.452679 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-07b131ab-60df-496a-8997-7bc850d129d7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:26.457405 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-85201512-1380-431e-9295-f343de1461be tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:26.457896 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-85201512-1380-431e-9295-f343de1461be tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:26.458680 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-85201512-1380-431e-9295-f343de1461be tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:26.459124 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-85201512-1380-431e-9295-f343de1461be tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:26.482146 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-07b131ab-60df-496a-8997-7bc850d129d7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043319 Apr 08 11:25:26.482725 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 706/1422] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:26 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:26.521524 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-85201512-1380-431e-9295-f343de1461be tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:26.529015 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-85201512-1380-431e-9295-f343de1461be tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082270 Apr 08 11:25:26.529577 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 717/1423] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:26 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:27.455128 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-dd785c43-9cee-4974-a671-aa249ed06e52 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:27.455744 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-dd785c43-9cee-4974-a671-aa249ed06e52 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:27.461728 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-05c998b6-b3eb-46f3-bc6e-3ef81e694697 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:27.462264 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dd785c43-9cee-4974-a671-aa249ed06e52 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:27.462378 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-05c998b6-b3eb-46f3-bc6e-3ef81e694697 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:27.462538 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dd785c43-9cee-4974-a671-aa249ed06e52 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:27.463310 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dd785c43-9cee-4974-a671-aa249ed06e52 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:27.463775 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dd785c43-9cee-4974-a671-aa249ed06e52 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:27.469247 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-05c998b6-b3eb-46f3-bc6e-3ef81e694697 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:27.469701 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-05c998b6-b3eb-46f3-bc6e-3ef81e694697 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:27.470516 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-05c998b6-b3eb-46f3-bc6e-3ef81e694697 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:27.470960 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-05c998b6-b3eb-46f3-bc6e-3ef81e694697 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:27.670612 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-dd785c43-9cee-4974-a671-aa249ed06e52 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:27.674660 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-05c998b6-b3eb-46f3-bc6e-3ef81e694697 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:27.678445 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-dd785c43-9cee-4974-a671-aa249ed06e52 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.227134 Apr 08 11:25:27.679030 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 707/1424] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:27 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:27.683853 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-05c998b6-b3eb-46f3-bc6e-3ef81e694697 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:27.700757 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e99034d6-f4bd-47a3-90f2-889ee0863393 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:27.700757 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e99034d6-f4bd-47a3-90f2-889ee0863393 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:27.701118 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-05c998b6-b3eb-46f3-bc6e-3ef81e694697 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:27.701118 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-05c998b6-b3eb-46f3-bc6e-3ef81e694697 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.228707 Apr 08 11:25:27.701118 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 718/1425] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:25:27 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:25:27.701118 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-0d9a84d5-d6af-4599-ad0e-6bc7ddd09f50 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:27.701490 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e99034d6-f4bd-47a3-90f2-889ee0863393 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:27.701585 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-0d9a84d5-d6af-4599-ad0e-6bc7ddd09f50 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:27.701677 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e99034d6-f4bd-47a3-90f2-889ee0863393 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:27.701677 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e99034d6-f4bd-47a3-90f2-889ee0863393 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:27.701677 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e99034d6-f4bd-47a3-90f2-889ee0863393 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:27.701944 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0d9a84d5-d6af-4599-ad0e-6bc7ddd09f50 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:27.701944 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0d9a84d5-d6af-4599-ad0e-6bc7ddd09f50 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:27.701944 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0d9a84d5-d6af-4599-ad0e-6bc7ddd09f50 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:27.701944 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0d9a84d5-d6af-4599-ad0e-6bc7ddd09f50 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:27.726327 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e99034d6-f4bd-47a3-90f2-889ee0863393 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046117 Apr 08 11:25:27.726814 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 708/1426] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:27 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:27.763997 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-0d9a84d5-d6af-4599-ad0e-6bc7ddd09f50 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:27.775541 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-0d9a84d5-d6af-4599-ad0e-6bc7ddd09f50 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.087104 Apr 08 11:25:27.776134 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 719/1427] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:27 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:28.695586 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c6244d25-0ae3-495e-948c-349477dd5e15 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:28.696195 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c6244d25-0ae3-495e-948c-349477dd5e15 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:28.702691 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c6244d25-0ae3-495e-948c-349477dd5e15 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:28.703145 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c6244d25-0ae3-495e-948c-349477dd5e15 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:28.703922 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c6244d25-0ae3-495e-948c-349477dd5e15 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:28.704362 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c6244d25-0ae3-495e-948c-349477dd5e15 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:28.708284 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-9cf8abe8-cacd-4361-8c9c-d45a0f559696 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:28.708933 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-9cf8abe8-cacd-4361-8c9c-d45a0f559696 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:28.715711 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9cf8abe8-cacd-4361-8c9c-d45a0f559696 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:28.716168 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9cf8abe8-cacd-4361-8c9c-d45a0f559696 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:28.716953 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9cf8abe8-cacd-4361-8c9c-d45a0f559696 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:28.717400 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9cf8abe8-cacd-4361-8c9c-d45a0f559696 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:28.902163 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c6244d25-0ae3-495e-948c-349477dd5e15 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:28.909406 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-9cf8abe8-cacd-4361-8c9c-d45a0f559696 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:28.909736 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c6244d25-0ae3-495e-948c-349477dd5e15 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.217947 Apr 08 11:25:28.910359 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 709/1428] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:28 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:28.915454 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-78e95937-a763-4fc6-a590-e8ea33ee8449 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:28.916701 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-78e95937-a763-4fc6-a590-e8ea33ee8449 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:28.921191 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-9cf8abe8-cacd-4361-8c9c-d45a0f559696 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:28.922918 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-9cf8abe8-cacd-4361-8c9c-d45a0f559696 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:28.923366 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-78e95937-a763-4fc6-a590-e8ea33ee8449 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:28.923822 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-78e95937-a763-4fc6-a590-e8ea33ee8449 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:28.924424 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-9cf8abe8-cacd-4361-8c9c-d45a0f559696 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.219877 Apr 08 11:25:28.924606 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-78e95937-a763-4fc6-a590-e8ea33ee8449 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:28.925082 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-78e95937-a763-4fc6-a590-e8ea33ee8449 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:28.925212 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 720/1429] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:25:28 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:25:28.930722 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-01eb84df-265b-48fb-8d9d-8894c9a07096 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:28.931646 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-01eb84df-265b-48fb-8d9d-8894c9a07096 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:28.938263 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-01eb84df-265b-48fb-8d9d-8894c9a07096 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:28.938689 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-01eb84df-265b-48fb-8d9d-8894c9a07096 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:28.939557 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-01eb84df-265b-48fb-8d9d-8894c9a07096 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:28.940628 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-01eb84df-265b-48fb-8d9d-8894c9a07096 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:28.967507 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-78e95937-a763-4fc6-a590-e8ea33ee8449 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055734 Apr 08 11:25:28.968095 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 710/1430] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:28 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:29.001500 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-01eb84df-265b-48fb-8d9d-8894c9a07096 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:29.009126 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-01eb84df-265b-48fb-8d9d-8894c9a07096 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082804 Apr 08 11:25:29.009685 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 721/1431] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:28 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:29.927157 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-16226408-f097-4888-943f-4c17bb346278 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:29.927772 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-16226408-f097-4888-943f-4c17bb346278 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:29.934103 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-16226408-f097-4888-943f-4c17bb346278 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:29.934559 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-16226408-f097-4888-943f-4c17bb346278 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:29.935332 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-16226408-f097-4888-943f-4c17bb346278 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:29.935772 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-16226408-f097-4888-943f-4c17bb346278 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:29.945544 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-08208e76-2523-49c3-84b9-f916af96b65f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:29.946599 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-08208e76-2523-49c3-84b9-f916af96b65f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:29.956702 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-08208e76-2523-49c3-84b9-f916af96b65f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:29.957433 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-08208e76-2523-49c3-84b9-f916af96b65f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:29.958468 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-08208e76-2523-49c3-84b9-f916af96b65f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:29.958987 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-08208e76-2523-49c3-84b9-f916af96b65f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:30.133610 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-16226408-f097-4888-943f-4c17bb346278 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:30.141308 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-16226408-f097-4888-943f-4c17bb346278 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.217946 Apr 08 11:25:30.141918 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 711/1432] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:29 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:30.146750 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7d8f7e16-9c97-47e0-b723-2e08e741c7bb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:30.147683 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7d8f7e16-9c97-47e0-b723-2e08e741c7bb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:30.154099 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d8f7e16-9c97-47e0-b723-2e08e741c7bb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:30.154507 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d8f7e16-9c97-47e0-b723-2e08e741c7bb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:30.155297 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d8f7e16-9c97-47e0-b723-2e08e741c7bb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:30.155739 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d8f7e16-9c97-47e0-b723-2e08e741c7bb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:30.155862 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-08208e76-2523-49c3-84b9-f916af96b65f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:30.167999 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-08208e76-2523-49c3-84b9-f916af96b65f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:30.170753 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-08208e76-2523-49c3-84b9-f916af96b65f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:30.172738 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-08208e76-2523-49c3-84b9-f916af96b65f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.232864 Apr 08 11:25:30.173862 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 722/1433] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:25:29 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:25:30.180979 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-8a1d3e0b-13e3-4f28-973c-73b07ed3a9e7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:30.181797 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-8a1d3e0b-13e3-4f28-973c-73b07ed3a9e7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:30.190881 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8a1d3e0b-13e3-4f28-973c-73b07ed3a9e7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:30.191618 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8a1d3e0b-13e3-4f28-973c-73b07ed3a9e7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:30.192884 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8a1d3e0b-13e3-4f28-973c-73b07ed3a9e7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:30.193614 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8a1d3e0b-13e3-4f28-973c-73b07ed3a9e7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:30.201398 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7d8f7e16-9c97-47e0-b723-2e08e741c7bb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058306 Apr 08 11:25:30.202009 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 712/1434] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:30 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:30.256288 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-8a1d3e0b-13e3-4f28-973c-73b07ed3a9e7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:30.264148 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-8a1d3e0b-13e3-4f28-973c-73b07ed3a9e7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.089175 Apr 08 11:25:30.264715 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 723/1435] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:30 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:31.158530 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a1880b9a-852a-46b8-8070-84e0f523272e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:31.159146 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a1880b9a-852a-46b8-8070-84e0f523272e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:31.165556 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a1880b9a-852a-46b8-8070-84e0f523272e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:31.166049 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a1880b9a-852a-46b8-8070-84e0f523272e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:31.166849 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a1880b9a-852a-46b8-8070-84e0f523272e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:31.167291 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a1880b9a-852a-46b8-8070-84e0f523272e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:31.191945 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-de224f31-4e00-4bc5-8384-25f16c462223 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:31.193218 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-de224f31-4e00-4bc5-8384-25f16c462223 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:31.201249 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-de224f31-4e00-4bc5-8384-25f16c462223 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:31.201627 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-de224f31-4e00-4bc5-8384-25f16c462223 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:31.202449 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-de224f31-4e00-4bc5-8384-25f16c462223 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:31.203084 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-de224f31-4e00-4bc5-8384-25f16c462223 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:31.364795 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a1880b9a-852a-46b8-8070-84e0f523272e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:31.373296 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a1880b9a-852a-46b8-8070-84e0f523272e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.218560 Apr 08 11:25:31.373901 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 713/1436] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:31 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:31.378637 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-31ed2acf-b2b7-447a-ab24-064bb65e24cb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:31.379564 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-31ed2acf-b2b7-447a-ab24-064bb65e24cb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:31.385466 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-31ed2acf-b2b7-447a-ab24-064bb65e24cb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:31.386566 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-31ed2acf-b2b7-447a-ab24-064bb65e24cb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:31.387557 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-31ed2acf-b2b7-447a-ab24-064bb65e24cb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:31.388033 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-31ed2acf-b2b7-447a-ab24-064bb65e24cb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:31.401178 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-de224f31-4e00-4bc5-8384-25f16c462223 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:31.410132 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-de224f31-4e00-4bc5-8384-25f16c462223 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:31.411644 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-de224f31-4e00-4bc5-8384-25f16c462223 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:31.413004 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-de224f31-4e00-4bc5-8384-25f16c462223 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.225027 Apr 08 11:25:31.413576 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 724/1437] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:25:31 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:25:31.417910 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-31ed2acf-b2b7-447a-ab24-064bb65e24cb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042219 Apr 08 11:25:31.417910 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 714/1438] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:31 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:31.418239 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-6c182f8b-e0ef-41a4-9b1d-df221c737619 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:31.419049 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-6c182f8b-e0ef-41a4-9b1d-df221c737619 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:31.425167 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6c182f8b-e0ef-41a4-9b1d-df221c737619 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:31.425618 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6c182f8b-e0ef-41a4-9b1d-df221c737619 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:31.426431 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6c182f8b-e0ef-41a4-9b1d-df221c737619 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:31.426875 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6c182f8b-e0ef-41a4-9b1d-df221c737619 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:31.485667 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6c182f8b-e0ef-41a4-9b1d-df221c737619 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:31.493314 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-6c182f8b-e0ef-41a4-9b1d-df221c737619 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078769 Apr 08 11:25:31.493911 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 725/1439] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:31 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:32.389466 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-34837a2f-7f00-4f30-b1f1-e5d05d33d8ff tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:32.390138 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-34837a2f-7f00-4f30-b1f1-e5d05d33d8ff tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:32.396305 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-34837a2f-7f00-4f30-b1f1-e5d05d33d8ff tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:32.396752 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-34837a2f-7f00-4f30-b1f1-e5d05d33d8ff tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:32.397509 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-34837a2f-7f00-4f30-b1f1-e5d05d33d8ff tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:32.397977 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-34837a2f-7f00-4f30-b1f1-e5d05d33d8ff tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:32.428831 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2a228ad3-722f-4bf3-8a0b-a06346ca3a9b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:32.429928 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-2a228ad3-722f-4bf3-8a0b-a06346ca3a9b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:32.436296 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2a228ad3-722f-4bf3-8a0b-a06346ca3a9b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:32.436756 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2a228ad3-722f-4bf3-8a0b-a06346ca3a9b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:32.437542 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2a228ad3-722f-4bf3-8a0b-a06346ca3a9b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:32.438061 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2a228ad3-722f-4bf3-8a0b-a06346ca3a9b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:32.472025 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-2a228ad3-722f-4bf3-8a0b-a06346ca3a9b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047079 Apr 08 11:25:32.472619 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 726/1440] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:32 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:25:32.477250 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-4d933418-d862-4617-9117-63ae9dce8684 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:32.477890 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-4d933418-d862-4617-9117-63ae9dce8684 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:32.485025 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4d933418-d862-4617-9117-63ae9dce8684 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:32.489642 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4d933418-d862-4617-9117-63ae9dce8684 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:32.489642 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4d933418-d862-4617-9117-63ae9dce8684 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:32.489642 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4d933418-d862-4617-9117-63ae9dce8684 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:32.544739 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-34837a2f-7f00-4f30-b1f1-e5d05d33d8ff tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:32.552394 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-34837a2f-7f00-4f30-b1f1-e5d05d33d8ff tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.166782 Apr 08 11:25:32.553169 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 715/1441] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:32 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:32.557416 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f51af671-5dbf-478b-b28b-4159a5be0fce tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:32.558061 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f51af671-5dbf-478b-b28b-4159a5be0fce tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:32.564449 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f51af671-5dbf-478b-b28b-4159a5be0fce tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:32.564907 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f51af671-5dbf-478b-b28b-4159a5be0fce tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:32.565697 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f51af671-5dbf-478b-b28b-4159a5be0fce tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:32.566166 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f51af671-5dbf-478b-b28b-4159a5be0fce tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:32.637608 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f51af671-5dbf-478b-b28b-4159a5be0fce tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:32.648713 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f51af671-5dbf-478b-b28b-4159a5be0fce tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.094568 Apr 08 11:25:32.649910 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 716/1442] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:32 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:32.668748 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-4d933418-d862-4617-9117-63ae9dce8684 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:32.677250 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-4d933418-d862-4617-9117-63ae9dce8684 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:32.678846 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-4d933418-d862-4617-9117-63ae9dce8684 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:32.680004 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-4d933418-d862-4617-9117-63ae9dce8684 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.206469 Apr 08 11:25:32.680565 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 727/1443] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:25:32 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:25:33.484272 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0244fe4d-1927-4db4-9222-235af06ff98e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:33.485212 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0244fe4d-1927-4db4-9222-235af06ff98e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:33.491788 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0244fe4d-1927-4db4-9222-235af06ff98e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:33.492498 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0244fe4d-1927-4db4-9222-235af06ff98e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:33.493272 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0244fe4d-1927-4db4-9222-235af06ff98e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:33.493758 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0244fe4d-1927-4db4-9222-235af06ff98e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:33.522291 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0244fe4d-1927-4db4-9222-235af06ff98e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042527 Apr 08 11:25:33.522859 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 717/1444] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:33 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:33.569002 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-bf10aad0-05ed-4fb0-b443-2f1fad2b142a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:33.569592 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-bf10aad0-05ed-4fb0-b443-2f1fad2b142a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:33.575844 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bf10aad0-05ed-4fb0-b443-2f1fad2b142a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:33.576297 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bf10aad0-05ed-4fb0-b443-2f1fad2b142a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:33.577059 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bf10aad0-05ed-4fb0-b443-2f1fad2b142a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:33.577498 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bf10aad0-05ed-4fb0-b443-2f1fad2b142a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:33.666992 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-971195da-2179-4759-b610-4658b04650c7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:33.668154 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-971195da-2179-4759-b610-4658b04650c7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:33.674567 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-971195da-2179-4759-b610-4658b04650c7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:33.675025 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-971195da-2179-4759-b610-4658b04650c7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:33.675822 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-971195da-2179-4759-b610-4658b04650c7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:33.676261 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-971195da-2179-4759-b610-4658b04650c7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:33.716681 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-bf10aad0-05ed-4fb0-b443-2f1fad2b142a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:33.724390 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-bf10aad0-05ed-4fb0-b443-2f1fad2b142a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.159135 Apr 08 11:25:33.724954 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 728/1445] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:33 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:33.730248 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2c40d5c7-a5bd-43cf-80cb-aeaa0877c7b3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:33.730948 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-2c40d5c7-a5bd-43cf-80cb-aeaa0877c7b3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:33.736922 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2c40d5c7-a5bd-43cf-80cb-aeaa0877c7b3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:33.737307 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2c40d5c7-a5bd-43cf-80cb-aeaa0877c7b3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:33.738119 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2c40d5c7-a5bd-43cf-80cb-aeaa0877c7b3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:33.738557 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2c40d5c7-a5bd-43cf-80cb-aeaa0877c7b3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:33.748119 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-971195da-2179-4759-b610-4658b04650c7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:33.755566 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-971195da-2179-4759-b610-4658b04650c7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.092480 Apr 08 11:25:33.756149 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 718/1446] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:33 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:25:33.869354 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2c40d5c7-a5bd-43cf-80cb-aeaa0877c7b3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:33.877634 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2c40d5c7-a5bd-43cf-80cb-aeaa0877c7b3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:33.879161 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2c40d5c7-a5bd-43cf-80cb-aeaa0877c7b3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:33.880306 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-2c40d5c7-a5bd-43cf-80cb-aeaa0877c7b3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.154368 Apr 08 11:25:33.880865 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 729/1447] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:25:33 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:25:34.533146 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-68231be8-e73e-4cc8-9ecf-2fca499e4d46 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:34.534133 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-68231be8-e73e-4cc8-9ecf-2fca499e4d46 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:34.540449 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-68231be8-e73e-4cc8-9ecf-2fca499e4d46 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:34.540907 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-68231be8-e73e-4cc8-9ecf-2fca499e4d46 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:34.541688 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-68231be8-e73e-4cc8-9ecf-2fca499e4d46 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:34.542158 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-68231be8-e73e-4cc8-9ecf-2fca499e4d46 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:34.570928 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-68231be8-e73e-4cc8-9ecf-2fca499e4d46 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041826 Apr 08 11:25:34.571495 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 719/1448] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:34 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:34.742377 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-79c969b7-92d7-44f9-9068-038181f1add5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:34.742987 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-79c969b7-92d7-44f9-9068-038181f1add5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:34.750011 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-79c969b7-92d7-44f9-9068-038181f1add5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:34.750471 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-79c969b7-92d7-44f9-9068-038181f1add5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:34.751246 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-79c969b7-92d7-44f9-9068-038181f1add5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:34.751690 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-79c969b7-92d7-44f9-9068-038181f1add5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:34.773221 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2dff6e09-f51d-41af-aa40-a5da407947d9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:34.773890 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2dff6e09-f51d-41af-aa40-a5da407947d9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:34.779869 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2dff6e09-f51d-41af-aa40-a5da407947d9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:34.780385 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2dff6e09-f51d-41af-aa40-a5da407947d9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:34.781172 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2dff6e09-f51d-41af-aa40-a5da407947d9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:34.781672 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2dff6e09-f51d-41af-aa40-a5da407947d9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:34.848546 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2dff6e09-f51d-41af-aa40-a5da407947d9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:34.856485 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2dff6e09-f51d-41af-aa40-a5da407947d9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.088305 Apr 08 11:25:34.857071 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 720/1449] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:34 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:25:34.897699 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-44c76f5f-767f-4e75-9709-e11d1a1777ec tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:34.898384 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-44c76f5f-767f-4e75-9709-e11d1a1777ec tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:34.904405 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-44c76f5f-767f-4e75-9709-e11d1a1777ec tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:34.904856 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-44c76f5f-767f-4e75-9709-e11d1a1777ec tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:34.905731 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-44c76f5f-767f-4e75-9709-e11d1a1777ec tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:34.906189 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-44c76f5f-767f-4e75-9709-e11d1a1777ec tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:34.912027 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-79c969b7-92d7-44f9-9068-038181f1add5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:34.919630 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-79c969b7-92d7-44f9-9068-038181f1add5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.181362 Apr 08 11:25:34.920194 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 730/1450] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:34 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:35.041100 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-44c76f5f-767f-4e75-9709-e11d1a1777ec tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:35.049860 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-44c76f5f-767f-4e75-9709-e11d1a1777ec tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:35.051377 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-44c76f5f-767f-4e75-9709-e11d1a1777ec tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:35.052531 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-44c76f5f-767f-4e75-9709-e11d1a1777ec tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.158861 Apr 08 11:25:35.053110 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 721/1451] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:25:34 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:25:35.583159 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e6c68fa1-6077-4493-897f-3ec92233e40b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:35.584110 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e6c68fa1-6077-4493-897f-3ec92233e40b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:35.590592 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e6c68fa1-6077-4493-897f-3ec92233e40b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:35.591035 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e6c68fa1-6077-4493-897f-3ec92233e40b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:35.591790 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e6c68fa1-6077-4493-897f-3ec92233e40b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:35.592223 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e6c68fa1-6077-4493-897f-3ec92233e40b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:35.619561 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e6c68fa1-6077-4493-897f-3ec92233e40b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040348 Apr 08 11:25:35.620116 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 731/1452] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:35 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:35.873438 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-75187e10-7242-4812-a676-aecbcd191a5a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:35.874016 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-75187e10-7242-4812-a676-aecbcd191a5a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:35.880787 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-75187e10-7242-4812-a676-aecbcd191a5a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:35.881243 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-75187e10-7242-4812-a676-aecbcd191a5a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:35.882056 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-75187e10-7242-4812-a676-aecbcd191a5a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:35.882503 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-75187e10-7242-4812-a676-aecbcd191a5a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:35.936819 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-198a7abd-391f-46e6-883a-50d158935df0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:35.937532 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-198a7abd-391f-46e6-883a-50d158935df0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:35.942371 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-75187e10-7242-4812-a676-aecbcd191a5a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:35.943836 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-198a7abd-391f-46e6-883a-50d158935df0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:35.944297 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-198a7abd-391f-46e6-883a-50d158935df0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:35.945067 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-198a7abd-391f-46e6-883a-50d158935df0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:35.945505 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-198a7abd-391f-46e6-883a-50d158935df0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:35.950629 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-75187e10-7242-4812-a676-aecbcd191a5a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081650 Apr 08 11:25:35.951212 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 722/1453] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:35 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:25:36.071161 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c503ba94-b7c7-41f3-9010-ccf1e7163ae3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:36.071837 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c503ba94-b7c7-41f3-9010-ccf1e7163ae3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:36.078362 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c503ba94-b7c7-41f3-9010-ccf1e7163ae3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:36.078817 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c503ba94-b7c7-41f3-9010-ccf1e7163ae3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:36.079597 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c503ba94-b7c7-41f3-9010-ccf1e7163ae3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:36.080036 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c503ba94-b7c7-41f3-9010-ccf1e7163ae3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:36.083764 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-198a7abd-391f-46e6-883a-50d158935df0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:36.091074 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-198a7abd-391f-46e6-883a-50d158935df0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.158581 Apr 08 11:25:36.091649 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 732/1454] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:35 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:25:36.210547 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c503ba94-b7c7-41f3-9010-ccf1e7163ae3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:36.218748 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c503ba94-b7c7-41f3-9010-ccf1e7163ae3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:36.220439 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c503ba94-b7c7-41f3-9010-ccf1e7163ae3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:36.221605 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c503ba94-b7c7-41f3-9010-ccf1e7163ae3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.154415 Apr 08 11:25:36.222211 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 723/1455] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:25:36 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:25:36.630504 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-84949735-4f03-4378-be41-b95880624e7c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:36.631438 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-84949735-4f03-4378-be41-b95880624e7c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:36.637363 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-84949735-4f03-4378-be41-b95880624e7c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:36.637848 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-84949735-4f03-4378-be41-b95880624e7c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:36.638621 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-84949735-4f03-4378-be41-b95880624e7c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:36.639062 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-84949735-4f03-4378-be41-b95880624e7c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:36.668434 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-84949735-4f03-4378-be41-b95880624e7c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041833 Apr 08 11:25:36.668988 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 733/1456] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:36 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:25:36.967713 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-fa8f521b-6750-40b8-b4ce-7cd7a0c25695 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:36.968268 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-fa8f521b-6750-40b8-b4ce-7cd7a0c25695 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:36.974557 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fa8f521b-6750-40b8-b4ce-7cd7a0c25695 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:36.975009 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fa8f521b-6750-40b8-b4ce-7cd7a0c25695 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:36.975785 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fa8f521b-6750-40b8-b4ce-7cd7a0c25695 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:36.976225 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fa8f521b-6750-40b8-b4ce-7cd7a0c25695 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:37.036667 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-fa8f521b-6750-40b8-b4ce-7cd7a0c25695 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:37.044003 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-fa8f521b-6750-40b8-b4ce-7cd7a0c25695 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080779 Apr 08 11:25:37.044568 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 724/1457] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:36 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:37.107910 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-bdff54b5-a0d0-4d84-810c-831d4169e478 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:37.108519 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-bdff54b5-a0d0-4d84-810c-831d4169e478 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:37.114765 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bdff54b5-a0d0-4d84-810c-831d4169e478 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:37.115215 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bdff54b5-a0d0-4d84-810c-831d4169e478 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:37.115976 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bdff54b5-a0d0-4d84-810c-831d4169e478 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:37.116412 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bdff54b5-a0d0-4d84-810c-831d4169e478 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:37.240470 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-644a579f-264b-499b-b7f0-042ad71806fb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:37.241008 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-644a579f-264b-499b-b7f0-042ad71806fb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:37.247187 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-644a579f-264b-499b-b7f0-042ad71806fb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:37.247656 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-644a579f-264b-499b-b7f0-042ad71806fb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:37.248457 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-644a579f-264b-499b-b7f0-042ad71806fb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:37.248882 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-644a579f-264b-499b-b7f0-042ad71806fb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:37.253045 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-bdff54b5-a0d0-4d84-810c-831d4169e478 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:37.260893 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-bdff54b5-a0d0-4d84-810c-831d4169e478 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.156305 Apr 08 11:25:37.261474 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 734/1458] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:37 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:37.388407 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-644a579f-264b-499b-b7f0-042ad71806fb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:37.396670 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-644a579f-264b-499b-b7f0-042ad71806fb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:37.398203 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-644a579f-264b-499b-b7f0-042ad71806fb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:37.399395 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-644a579f-264b-499b-b7f0-042ad71806fb tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.162968 Apr 08 11:25:37.399958 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 725/1459] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:25:37 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:25:37.679158 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-8c4ac270-da0d-42db-a5af-33d1606150de tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:37.680074 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-8c4ac270-da0d-42db-a5af-33d1606150de tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:37.686103 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8c4ac270-da0d-42db-a5af-33d1606150de tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:37.686549 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8c4ac270-da0d-42db-a5af-33d1606150de tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:37.687305 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8c4ac270-da0d-42db-a5af-33d1606150de tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:37.687741 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8c4ac270-da0d-42db-a5af-33d1606150de tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:37.716244 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-8c4ac270-da0d-42db-a5af-33d1606150de tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041046 Apr 08 11:25:37.716800 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 735/1460] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:37 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:38.060411 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8b9189e2-5cff-400d-8261-f1d799723f11 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:38.061053 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8b9189e2-5cff-400d-8261-f1d799723f11 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:38.067387 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8b9189e2-5cff-400d-8261-f1d799723f11 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:38.067844 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8b9189e2-5cff-400d-8261-f1d799723f11 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:38.068620 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8b9189e2-5cff-400d-8261-f1d799723f11 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:38.069064 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8b9189e2-5cff-400d-8261-f1d799723f11 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:38.132621 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8b9189e2-5cff-400d-8261-f1d799723f11 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:38.140790 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8b9189e2-5cff-400d-8261-f1d799723f11 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.084238 Apr 08 11:25:38.141369 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 726/1461] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:38 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:38.277651 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-68583ac4-f83f-479e-bad8-bebd9535496a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:38.278298 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-68583ac4-f83f-479e-bad8-bebd9535496a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:38.284641 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-68583ac4-f83f-479e-bad8-bebd9535496a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:38.285097 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-68583ac4-f83f-479e-bad8-bebd9535496a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:38.285904 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-68583ac4-f83f-479e-bad8-bebd9535496a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:38.286352 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-68583ac4-f83f-479e-bad8-bebd9535496a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:38.418918 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-45dfe0f4-15c6-4938-825b-cc070c80d8d0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:38.419774 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-45dfe0f4-15c6-4938-825b-cc070c80d8d0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:38.425406 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-68583ac4-f83f-479e-bad8-bebd9535496a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:38.425806 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-45dfe0f4-15c6-4938-825b-cc070c80d8d0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:38.426416 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-45dfe0f4-15c6-4938-825b-cc070c80d8d0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:38.434277 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-68583ac4-f83f-479e-bad8-bebd9535496a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.160377 Apr 08 11:25:38.434857 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 736/1462] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:38 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:38.435805 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-45dfe0f4-15c6-4938-825b-cc070c80d8d0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:38.436244 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-45dfe0f4-15c6-4938-825b-cc070c80d8d0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:38.568848 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-45dfe0f4-15c6-4938-825b-cc070c80d8d0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:38.577231 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-45dfe0f4-15c6-4938-825b-cc070c80d8d0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:38.578777 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-45dfe0f4-15c6-4938-825b-cc070c80d8d0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:38.579938 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-45dfe0f4-15c6-4938-825b-cc070c80d8d0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.165002 Apr 08 11:25:38.580506 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 727/1463] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:25:38 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:25:38.727954 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-81dece5f-0bb6-4bbe-a661-441d989e6ec7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:38.728888 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-81dece5f-0bb6-4bbe-a661-441d989e6ec7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:38.735279 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-81dece5f-0bb6-4bbe-a661-441d989e6ec7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:38.735731 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-81dece5f-0bb6-4bbe-a661-441d989e6ec7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:38.736496 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-81dece5f-0bb6-4bbe-a661-441d989e6ec7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:38.736988 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-81dece5f-0bb6-4bbe-a661-441d989e6ec7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:38.765158 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-81dece5f-0bb6-4bbe-a661-441d989e6ec7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041155 Apr 08 11:25:38.765717 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 737/1464] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:38 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:39.157967 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d94d9747-8a16-4395-95bd-efdf3ae6bde4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:39.158583 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d94d9747-8a16-4395-95bd-efdf3ae6bde4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:39.164849 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d94d9747-8a16-4395-95bd-efdf3ae6bde4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:39.165294 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d94d9747-8a16-4395-95bd-efdf3ae6bde4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:39.166153 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d94d9747-8a16-4395-95bd-efdf3ae6bde4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:39.166593 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d94d9747-8a16-4395-95bd-efdf3ae6bde4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:39.228140 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d94d9747-8a16-4395-95bd-efdf3ae6bde4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:39.236160 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d94d9747-8a16-4395-95bd-efdf3ae6bde4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082003 Apr 08 11:25:39.236742 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 728/1465] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:39 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:39.451984 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-8951fe49-d406-4af5-8486-ed44cf8cad36 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:39.452537 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-8951fe49-d406-4af5-8486-ed44cf8cad36 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:39.458890 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8951fe49-d406-4af5-8486-ed44cf8cad36 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:39.459344 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8951fe49-d406-4af5-8486-ed44cf8cad36 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:39.460172 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8951fe49-d406-4af5-8486-ed44cf8cad36 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:39.460543 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8951fe49-d406-4af5-8486-ed44cf8cad36 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:39.593643 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-8951fe49-d406-4af5-8486-ed44cf8cad36 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:39.597979 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a90e3e0d-f981-4119-9587-e7f1aa94268f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:39.598598 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a90e3e0d-f981-4119-9587-e7f1aa94268f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:39.601186 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-8951fe49-d406-4af5-8486-ed44cf8cad36 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.153202 Apr 08 11:25:39.601785 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 738/1466] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:39 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:39.604901 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a90e3e0d-f981-4119-9587-e7f1aa94268f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:39.605350 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a90e3e0d-f981-4119-9587-e7f1aa94268f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:39.606148 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a90e3e0d-f981-4119-9587-e7f1aa94268f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:39.606585 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a90e3e0d-f981-4119-9587-e7f1aa94268f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:39.737351 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a90e3e0d-f981-4119-9587-e7f1aa94268f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:39.746617 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a90e3e0d-f981-4119-9587-e7f1aa94268f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:39.748155 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a90e3e0d-f981-4119-9587-e7f1aa94268f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:39.749308 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a90e3e0d-f981-4119-9587-e7f1aa94268f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.155183 Apr 08 11:25:39.749890 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 729/1467] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:25:39 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:25:39.776481 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-7b6214ab-2b47-4381-bf1a-2e8916ca1c30 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:39.777408 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-7b6214ab-2b47-4381-bf1a-2e8916ca1c30 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:39.783380 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7b6214ab-2b47-4381-bf1a-2e8916ca1c30 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:39.783840 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7b6214ab-2b47-4381-bf1a-2e8916ca1c30 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:39.784626 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7b6214ab-2b47-4381-bf1a-2e8916ca1c30 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:39.785071 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7b6214ab-2b47-4381-bf1a-2e8916ca1c30 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:39.813242 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-7b6214ab-2b47-4381-bf1a-2e8916ca1c30 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040685 Apr 08 11:25:39.813836 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 739/1468] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:39 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:40.253730 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-fa72cf9d-5c30-44db-91e2-010f2faae4fb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:40.254405 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-fa72cf9d-5c30-44db-91e2-010f2faae4fb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:40.260779 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fa72cf9d-5c30-44db-91e2-010f2faae4fb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:40.261269 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fa72cf9d-5c30-44db-91e2-010f2faae4fb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:40.262088 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fa72cf9d-5c30-44db-91e2-010f2faae4fb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:40.262536 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fa72cf9d-5c30-44db-91e2-010f2faae4fb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:40.323499 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-fa72cf9d-5c30-44db-91e2-010f2faae4fb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:40.331069 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-fa72cf9d-5c30-44db-91e2-010f2faae4fb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081243 Apr 08 11:25:40.331651 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 730/1469] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:40 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:40.619260 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a5a77b78-0ecc-426e-8c64-ae3ac73a853f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:40.620478 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a5a77b78-0ecc-426e-8c64-ae3ac73a853f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:40.626792 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a5a77b78-0ecc-426e-8c64-ae3ac73a853f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:40.627244 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a5a77b78-0ecc-426e-8c64-ae3ac73a853f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:40.628038 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a5a77b78-0ecc-426e-8c64-ae3ac73a853f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:40.628484 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a5a77b78-0ecc-426e-8c64-ae3ac73a853f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:40.767674 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1ec53067-01bc-4b66-9c3c-180ea7e6aa4a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:40.767915 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a5a77b78-0ecc-426e-8c64-ae3ac73a853f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:40.768285 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1ec53067-01bc-4b66-9c3c-180ea7e6aa4a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:40.774571 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ec53067-01bc-4b66-9c3c-180ea7e6aa4a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:40.775019 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ec53067-01bc-4b66-9c3c-180ea7e6aa4a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:40.775652 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a5a77b78-0ecc-426e-8c64-ae3ac73a853f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.160405 Apr 08 11:25:40.775804 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ec53067-01bc-4b66-9c3c-180ea7e6aa4a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:40.776242 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ec53067-01bc-4b66-9c3c-180ea7e6aa4a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:40.776355 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 740/1470] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:40 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:40.824738 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-56b219dd-f11f-4be4-9f60-e33ec85ac188 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:40.825672 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-56b219dd-f11f-4be4-9f60-e33ec85ac188 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:40.831681 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-56b219dd-f11f-4be4-9f60-e33ec85ac188 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:40.832130 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-56b219dd-f11f-4be4-9f60-e33ec85ac188 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:40.832907 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-56b219dd-f11f-4be4-9f60-e33ec85ac188 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:40.833359 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-56b219dd-f11f-4be4-9f60-e33ec85ac188 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:40.864673 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-56b219dd-f11f-4be4-9f60-e33ec85ac188 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043650 Apr 08 11:25:40.865586 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 741/1471] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:40 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:25:40.912879 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1ec53067-01bc-4b66-9c3c-180ea7e6aa4a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:40.921680 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1ec53067-01bc-4b66-9c3c-180ea7e6aa4a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:40.923229 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1ec53067-01bc-4b66-9c3c-180ea7e6aa4a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:40.924401 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1ec53067-01bc-4b66-9c3c-180ea7e6aa4a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.160789 Apr 08 11:25:40.924965 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 731/1472] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:25:40 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:25:41.348377 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-c64eb3ca-43a4-4f31-8d3e-aaf1efec3827 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:41.349025 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-c64eb3ca-43a4-4f31-8d3e-aaf1efec3827 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:41.355725 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c64eb3ca-43a4-4f31-8d3e-aaf1efec3827 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:41.356262 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c64eb3ca-43a4-4f31-8d3e-aaf1efec3827 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:41.356959 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c64eb3ca-43a4-4f31-8d3e-aaf1efec3827 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:41.357403 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c64eb3ca-43a4-4f31-8d3e-aaf1efec3827 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:41.421563 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-c64eb3ca-43a4-4f31-8d3e-aaf1efec3827 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:41.429195 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-c64eb3ca-43a4-4f31-8d3e-aaf1efec3827 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.084849 Apr 08 11:25:41.429795 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 742/1473] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:41 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:41.792966 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-21225729-6484-4ae5-856a-65bf492ebfe9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:41.793579 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-21225729-6484-4ae5-856a-65bf492ebfe9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:41.800079 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-21225729-6484-4ae5-856a-65bf492ebfe9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:41.800531 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-21225729-6484-4ae5-856a-65bf492ebfe9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:41.801304 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-21225729-6484-4ae5-856a-65bf492ebfe9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:41.801743 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-21225729-6484-4ae5-856a-65bf492ebfe9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:41.877226 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e434eb80-1529-4895-9cb8-9ed549759fe4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:41.878217 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e434eb80-1529-4895-9cb8-9ed549759fe4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:41.884506 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e434eb80-1529-4895-9cb8-9ed549759fe4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:41.885050 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e434eb80-1529-4895-9cb8-9ed549759fe4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:41.886396 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e434eb80-1529-4895-9cb8-9ed549759fe4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:41.886835 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e434eb80-1529-4895-9cb8-9ed549759fe4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:41.925876 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e434eb80-1529-4895-9cb8-9ed549759fe4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052648 Apr 08 11:25:41.926468 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 743/1474] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:41 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:25:41.939864 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-21225729-6484-4ae5-856a-65bf492ebfe9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:41.943080 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-825c45cb-b66b-44bd-984b-de5baedac392 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:41.943694 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-825c45cb-b66b-44bd-984b-de5baedac392 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:41.950268 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-825c45cb-b66b-44bd-984b-de5baedac392 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:41.950723 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-825c45cb-b66b-44bd-984b-de5baedac392 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:41.950981 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-21225729-6484-4ae5-856a-65bf492ebfe9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.161869 Apr 08 11:25:41.951504 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-825c45cb-b66b-44bd-984b-de5baedac392 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:41.952152 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 732/1475] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:41 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:41.952301 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-825c45cb-b66b-44bd-984b-de5baedac392 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:42.083713 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-825c45cb-b66b-44bd-984b-de5baedac392 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:42.092043 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-825c45cb-b66b-44bd-984b-de5baedac392 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:42.093546 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-825c45cb-b66b-44bd-984b-de5baedac392 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:42.094729 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-825c45cb-b66b-44bd-984b-de5baedac392 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.155484 Apr 08 11:25:42.095346 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 744/1476] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:25:41 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:25:42.446366 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b88d82f5-4d1d-49f8-869b-20575004d721 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:42.446983 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b88d82f5-4d1d-49f8-869b-20575004d721 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:42.452818 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b88d82f5-4d1d-49f8-869b-20575004d721 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:42.455169 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b88d82f5-4d1d-49f8-869b-20575004d721 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:42.455169 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b88d82f5-4d1d-49f8-869b-20575004d721 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:42.455169 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b88d82f5-4d1d-49f8-869b-20575004d721 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:42.529746 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b88d82f5-4d1d-49f8-869b-20575004d721 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:42.537367 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b88d82f5-4d1d-49f8-869b-20575004d721 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.095162 Apr 08 11:25:42.537983 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 733/1477] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:42 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:42.937284 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-7ae4d92d-6a26-4142-9ffd-cb731630de2f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:42.942622 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-7ae4d92d-6a26-4142-9ffd-cb731630de2f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:42.944686 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7ae4d92d-6a26-4142-9ffd-cb731630de2f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:42.945142 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7ae4d92d-6a26-4142-9ffd-cb731630de2f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:42.945952 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7ae4d92d-6a26-4142-9ffd-cb731630de2f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:42.946398 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7ae4d92d-6a26-4142-9ffd-cb731630de2f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:42.968966 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f75cfff3-0680-4b94-9148-3136f230740e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:42.969622 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f75cfff3-0680-4b94-9148-3136f230740e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:42.975392 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-7ae4d92d-6a26-4142-9ffd-cb731630de2f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042136 Apr 08 11:25:42.977253 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f75cfff3-0680-4b94-9148-3136f230740e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:42.977367 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 745/1478] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:42 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:42.977484 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f75cfff3-0680-4b94-9148-3136f230740e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:42.977484 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f75cfff3-0680-4b94-9148-3136f230740e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:42.977691 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f75cfff3-0680-4b94-9148-3136f230740e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:43.112571 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-5a9f012f-aee3-47b7-a58c-d67d158605dd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:43.113188 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-5a9f012f-aee3-47b7-a58c-d67d158605dd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:43.119444 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5a9f012f-aee3-47b7-a58c-d67d158605dd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:43.119902 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5a9f012f-aee3-47b7-a58c-d67d158605dd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:43.120693 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5a9f012f-aee3-47b7-a58c-d67d158605dd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:43.121230 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5a9f012f-aee3-47b7-a58c-d67d158605dd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:43.124281 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f75cfff3-0680-4b94-9148-3136f230740e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:43.132081 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f75cfff3-0680-4b94-9148-3136f230740e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.166994 Apr 08 11:25:43.132805 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 734/1479] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:42 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:25:43.254899 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-5a9f012f-aee3-47b7-a58c-d67d158605dd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:43.263630 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-5a9f012f-aee3-47b7-a58c-d67d158605dd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:43.265139 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-5a9f012f-aee3-47b7-a58c-d67d158605dd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:43.266339 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-5a9f012f-aee3-47b7-a58c-d67d158605dd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.157837 Apr 08 11:25:43.266908 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 746/1480] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:25:43 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:25:43.554709 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-40551a65-6a75-44f8-941e-d16bb2db1ca3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:43.555320 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-40551a65-6a75-44f8-941e-d16bb2db1ca3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:43.561705 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-40551a65-6a75-44f8-941e-d16bb2db1ca3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:43.562179 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-40551a65-6a75-44f8-941e-d16bb2db1ca3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:43.562967 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-40551a65-6a75-44f8-941e-d16bb2db1ca3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:43.563399 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-40551a65-6a75-44f8-941e-d16bb2db1ca3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:43.626074 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-40551a65-6a75-44f8-941e-d16bb2db1ca3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:43.633459 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-40551a65-6a75-44f8-941e-d16bb2db1ca3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082596 Apr 08 11:25:43.634059 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 735/1481] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:43 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:43.987660 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-c40cd0fc-06e1-41b0-89f7-76e52f15998c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:43.988615 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-c40cd0fc-06e1-41b0-89f7-76e52f15998c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:43.995742 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c40cd0fc-06e1-41b0-89f7-76e52f15998c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:43.996182 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c40cd0fc-06e1-41b0-89f7-76e52f15998c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:43.996941 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c40cd0fc-06e1-41b0-89f7-76e52f15998c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:43.997369 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c40cd0fc-06e1-41b0-89f7-76e52f15998c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:44.024793 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-c40cd0fc-06e1-41b0-89f7-76e52f15998c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041147 Apr 08 11:25:44.025341 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 747/1482] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:43 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:44.149789 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e52cdfa0-b095-40fd-9257-dc768bc08f63 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:44.150423 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e52cdfa0-b095-40fd-9257-dc768bc08f63 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:44.157339 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e52cdfa0-b095-40fd-9257-dc768bc08f63 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:44.157819 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e52cdfa0-b095-40fd-9257-dc768bc08f63 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:44.158598 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e52cdfa0-b095-40fd-9257-dc768bc08f63 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:44.159042 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e52cdfa0-b095-40fd-9257-dc768bc08f63 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:44.285064 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-8857eaaa-60b4-4bd0-ade1-ef963a25b34a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:44.285667 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-8857eaaa-60b4-4bd0-ade1-ef963a25b34a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:44.292077 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8857eaaa-60b4-4bd0-ade1-ef963a25b34a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:44.292514 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8857eaaa-60b4-4bd0-ade1-ef963a25b34a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:44.293282 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8857eaaa-60b4-4bd0-ade1-ef963a25b34a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:44.293713 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8857eaaa-60b4-4bd0-ade1-ef963a25b34a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:44.294852 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e52cdfa0-b095-40fd-9257-dc768bc08f63 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:44.302446 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e52cdfa0-b095-40fd-9257-dc768bc08f63 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.156534 Apr 08 11:25:44.303114 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 736/1483] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:44 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:44.424831 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-8857eaaa-60b4-4bd0-ade1-ef963a25b34a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:44.433449 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-8857eaaa-60b4-4bd0-ade1-ef963a25b34a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:44.435044 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-8857eaaa-60b4-4bd0-ade1-ef963a25b34a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:44.436268 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-8857eaaa-60b4-4bd0-ade1-ef963a25b34a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.155154 Apr 08 11:25:44.436846 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 748/1484] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:25:44 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:25:44.651485 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e81e86b6-1cc6-4111-93d2-e9b0a023a1c0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:44.652101 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e81e86b6-1cc6-4111-93d2-e9b0a023a1c0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:44.658105 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e81e86b6-1cc6-4111-93d2-e9b0a023a1c0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:44.658555 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e81e86b6-1cc6-4111-93d2-e9b0a023a1c0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:44.659323 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e81e86b6-1cc6-4111-93d2-e9b0a023a1c0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:44.659780 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e81e86b6-1cc6-4111-93d2-e9b0a023a1c0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:44.722300 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e81e86b6-1cc6-4111-93d2-e9b0a023a1c0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:44.729796 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e81e86b6-1cc6-4111-93d2-e9b0a023a1c0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082855 Apr 08 11:25:44.730371 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 737/1485] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:44 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:45.036297 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-11354bff-6f10-4366-880a-028f6e2ecc19 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:45.037246 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-11354bff-6f10-4366-880a-028f6e2ecc19 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:45.043745 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-11354bff-6f10-4366-880a-028f6e2ecc19 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:45.044205 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-11354bff-6f10-4366-880a-028f6e2ecc19 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:45.044987 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-11354bff-6f10-4366-880a-028f6e2ecc19 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:45.045436 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-11354bff-6f10-4366-880a-028f6e2ecc19 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:45.075534 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-11354bff-6f10-4366-880a-028f6e2ecc19 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043325 Apr 08 11:25:45.076117 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 749/1486] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:45 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:45.320443 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-11cdc1bb-b766-45db-ae35-fc50a5775bbd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:45.321009 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-11cdc1bb-b766-45db-ae35-fc50a5775bbd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:45.327840 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-11cdc1bb-b766-45db-ae35-fc50a5775bbd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:45.328298 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-11cdc1bb-b766-45db-ae35-fc50a5775bbd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:45.329097 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-11cdc1bb-b766-45db-ae35-fc50a5775bbd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:45.329539 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-11cdc1bb-b766-45db-ae35-fc50a5775bbd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:45.454857 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-c6124b52-ba26-4802-aa3a-850979e44018 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:45.455479 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-c6124b52-ba26-4802-aa3a-850979e44018 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:45.461526 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c6124b52-ba26-4802-aa3a-850979e44018 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:45.462014 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c6124b52-ba26-4802-aa3a-850979e44018 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:45.462803 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c6124b52-ba26-4802-aa3a-850979e44018 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:45.463322 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c6124b52-ba26-4802-aa3a-850979e44018 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:45.470241 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-11cdc1bb-b766-45db-ae35-fc50a5775bbd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:45.477912 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-11cdc1bb-b766-45db-ae35-fc50a5775bbd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.161434 Apr 08 11:25:45.478500 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 738/1487] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:45 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:45.605013 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-c6124b52-ba26-4802-aa3a-850979e44018 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:45.613425 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-c6124b52-ba26-4802-aa3a-850979e44018 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:45.614942 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-c6124b52-ba26-4802-aa3a-850979e44018 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:45.616095 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-c6124b52-ba26-4802-aa3a-850979e44018 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.165189 Apr 08 11:25:45.616648 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 750/1488] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:25:45 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:25:45.747608 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a243145e-db31-437c-a038-06060e4a3c8f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:45.748227 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a243145e-db31-437c-a038-06060e4a3c8f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:45.754309 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a243145e-db31-437c-a038-06060e4a3c8f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:45.754761 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a243145e-db31-437c-a038-06060e4a3c8f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:45.755537 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a243145e-db31-437c-a038-06060e4a3c8f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:45.755968 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a243145e-db31-437c-a038-06060e4a3c8f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:45.818517 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a243145e-db31-437c-a038-06060e4a3c8f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:45.826110 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a243145e-db31-437c-a038-06060e4a3c8f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082666 Apr 08 11:25:45.826778 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 739/1489] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:45 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:46.086811 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-753d8e4f-060a-429a-a6a6-7702fc12aef4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:46.087750 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-753d8e4f-060a-429a-a6a6-7702fc12aef4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:46.095031 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-753d8e4f-060a-429a-a6a6-7702fc12aef4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:46.095519 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-753d8e4f-060a-429a-a6a6-7702fc12aef4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:46.096310 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-753d8e4f-060a-429a-a6a6-7702fc12aef4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:46.096749 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-753d8e4f-060a-429a-a6a6-7702fc12aef4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:46.126414 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-753d8e4f-060a-429a-a6a6-7702fc12aef4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043548 Apr 08 11:25:46.126998 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 751/1490] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:46 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:46.496473 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c030557a-86c3-4856-930c-b05f385eecb4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:46.497213 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c030557a-86c3-4856-930c-b05f385eecb4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:46.503548 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c030557a-86c3-4856-930c-b05f385eecb4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:46.503997 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c030557a-86c3-4856-930c-b05f385eecb4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:46.504771 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c030557a-86c3-4856-930c-b05f385eecb4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:46.505262 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c030557a-86c3-4856-930c-b05f385eecb4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:46.634428 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-bfc19edb-3cff-43e7-ba37-5515e0ff641f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:46.635639 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-bfc19edb-3cff-43e7-ba37-5515e0ff641f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:46.641950 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bfc19edb-3cff-43e7-ba37-5515e0ff641f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:46.642411 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bfc19edb-3cff-43e7-ba37-5515e0ff641f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:46.643204 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bfc19edb-3cff-43e7-ba37-5515e0ff641f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:46.643323 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c030557a-86c3-4856-930c-b05f385eecb4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:46.643643 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bfc19edb-3cff-43e7-ba37-5515e0ff641f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:46.651094 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c030557a-86c3-4856-930c-b05f385eecb4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.159248 Apr 08 11:25:46.651685 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 740/1491] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:46 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:46.775405 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-bfc19edb-3cff-43e7-ba37-5515e0ff641f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:46.787151 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-bfc19edb-3cff-43e7-ba37-5515e0ff641f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:46.788640 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-bfc19edb-3cff-43e7-ba37-5515e0ff641f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:46.789837 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-bfc19edb-3cff-43e7-ba37-5515e0ff641f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 200 len: 1746 microversion: 2.20 time: 0.159254 Apr 08 11:25:46.790414 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 752/1492] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:25:46 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:25:46.841815 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-cde95f28-5e90-4812-a8f5-6d50c53fa202 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:46.842432 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-cde95f28-5e90-4812-a8f5-6d50c53fa202 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:46.848543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cde95f28-5e90-4812-a8f5-6d50c53fa202 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:46.849002 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cde95f28-5e90-4812-a8f5-6d50c53fa202 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:46.849812 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cde95f28-5e90-4812-a8f5-6d50c53fa202 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:46.850255 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cde95f28-5e90-4812-a8f5-6d50c53fa202 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:46.913001 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-cde95f28-5e90-4812-a8f5-6d50c53fa202 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:46.921348 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-cde95f28-5e90-4812-a8f5-6d50c53fa202 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.083381 Apr 08 11:25:46.921951 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 741/1493] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:46 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:47.138436 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-c4d0255b-66f4-41cc-9cb9-216647ebb442 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:47.139284 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-c4d0255b-66f4-41cc-9cb9-216647ebb442 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:47.145826 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c4d0255b-66f4-41cc-9cb9-216647ebb442 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:47.146284 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c4d0255b-66f4-41cc-9cb9-216647ebb442 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:47.147065 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c4d0255b-66f4-41cc-9cb9-216647ebb442 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:47.147510 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c4d0255b-66f4-41cc-9cb9-216647ebb442 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:47.182174 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-c4d0255b-66f4-41cc-9cb9-216647ebb442 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047788 Apr 08 11:25:47.182742 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 753/1494] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:47 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:47.668072 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-110ff5e5-34a9-4365-8278-399270138f7f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:47.668691 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-110ff5e5-34a9-4365-8278-399270138f7f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:47.675206 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-110ff5e5-34a9-4365-8278-399270138f7f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:47.675657 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-110ff5e5-34a9-4365-8278-399270138f7f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:47.676436 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-110ff5e5-34a9-4365-8278-399270138f7f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:47.676873 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-110ff5e5-34a9-4365-8278-399270138f7f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:47.817402 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-110ff5e5-34a9-4365-8278-399270138f7f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:47.825673 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-110ff5e5-34a9-4365-8278-399270138f7f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.161479 Apr 08 11:25:47.826328 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 742/1495] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:47 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:25:47.938252 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-eaf7f147-8316-49f8-bf13-abb4c74e6ee4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:47.938861 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-eaf7f147-8316-49f8-bf13-abb4c74e6ee4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:47.944671 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-eaf7f147-8316-49f8-bf13-abb4c74e6ee4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:47.945116 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-eaf7f147-8316-49f8-bf13-abb4c74e6ee4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:47.945908 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-eaf7f147-8316-49f8-bf13-abb4c74e6ee4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:47.946342 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-eaf7f147-8316-49f8-bf13-abb4c74e6ee4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:48.005630 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-eaf7f147-8316-49f8-bf13-abb4c74e6ee4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:48.013795 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-eaf7f147-8316-49f8-bf13-abb4c74e6ee4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079344 Apr 08 11:25:48.014425 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 754/1496] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:47 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:48.194231 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3f53c0b0-ec36-4a2d-bc1c-30f0808483cf tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:48.195081 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3f53c0b0-ec36-4a2d-bc1c-30f0808483cf tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:48.201678 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3f53c0b0-ec36-4a2d-bc1c-30f0808483cf tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:48.202175 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3f53c0b0-ec36-4a2d-bc1c-30f0808483cf tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:48.202955 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3f53c0b0-ec36-4a2d-bc1c-30f0808483cf tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:48.203397 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3f53c0b0-ec36-4a2d-bc1c-30f0808483cf tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:48.232058 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3f53c0b0-ec36-4a2d-bc1c-30f0808483cf tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041969 Apr 08 11:25:48.232639 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 743/1497] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:48 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:48.846884 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-54900e98-55ff-4394-9203-e83b4e24e301 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:48.848032 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-54900e98-55ff-4394-9203-e83b4e24e301 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:48.855730 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-54900e98-55ff-4394-9203-e83b4e24e301 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:48.856166 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-54900e98-55ff-4394-9203-e83b4e24e301 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:48.856948 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-54900e98-55ff-4394-9203-e83b4e24e301 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:48.857391 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-54900e98-55ff-4394-9203-e83b4e24e301 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:48.998166 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-54900e98-55ff-4394-9203-e83b4e24e301 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:49.007294 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-54900e98-55ff-4394-9203-e83b4e24e301 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.166017 Apr 08 11:25:49.007880 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 755/1498] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:48 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:49.031233 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-fcc47646-3d82-464b-a30e-f6801bbb0df6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:49.031834 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-fcc47646-3d82-464b-a30e-f6801bbb0df6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:49.038303 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fcc47646-3d82-464b-a30e-f6801bbb0df6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:49.038759 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fcc47646-3d82-464b-a30e-f6801bbb0df6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:49.039542 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fcc47646-3d82-464b-a30e-f6801bbb0df6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:49.039988 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fcc47646-3d82-464b-a30e-f6801bbb0df6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:49.100089 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-fcc47646-3d82-464b-a30e-f6801bbb0df6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:49.107629 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-fcc47646-3d82-464b-a30e-f6801bbb0df6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080286 Apr 08 11:25:49.108213 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 744/1499] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:49 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:49.244238 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-8126b7f3-98de-422b-b677-5268a792d007 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:49.245118 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-8126b7f3-98de-422b-b677-5268a792d007 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:49.251057 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8126b7f3-98de-422b-b677-5268a792d007 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:49.251513 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8126b7f3-98de-422b-b677-5268a792d007 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:49.252280 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8126b7f3-98de-422b-b677-5268a792d007 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:49.252720 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8126b7f3-98de-422b-b677-5268a792d007 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:49.281083 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-8126b7f3-98de-422b-b677-5268a792d007 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041139 Apr 08 11:25:49.281633 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 756/1500] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:49 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:50.024295 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f0d3c6b8-1755-4494-bdb8-54d1276f49aa tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:50.024902 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f0d3c6b8-1755-4494-bdb8-54d1276f49aa tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:50.030775 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f0d3c6b8-1755-4494-bdb8-54d1276f49aa tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:50.031221 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f0d3c6b8-1755-4494-bdb8-54d1276f49aa tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:50.031982 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f0d3c6b8-1755-4494-bdb8-54d1276f49aa tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:50.032538 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f0d3c6b8-1755-4494-bdb8-54d1276f49aa tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:50.124611 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-d9bee1eb-fc8a-443b-bf19-845df02f58d3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:50.125344 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-d9bee1eb-fc8a-443b-bf19-845df02f58d3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:50.131438 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d9bee1eb-fc8a-443b-bf19-845df02f58d3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:50.131894 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d9bee1eb-fc8a-443b-bf19-845df02f58d3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:50.132674 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d9bee1eb-fc8a-443b-bf19-845df02f58d3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:50.133118 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d9bee1eb-fc8a-443b-bf19-845df02f58d3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:50.165596 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f0d3c6b8-1755-4494-bdb8-54d1276f49aa tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:50.173971 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f0d3c6b8-1755-4494-bdb8-54d1276f49aa tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.153388 Apr 08 11:25:50.174602 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 745/1501] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:50 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:50.192702 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d9bee1eb-fc8a-443b-bf19-845df02f58d3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:50.200179 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-d9bee1eb-fc8a-443b-bf19-845df02f58d3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079633 Apr 08 11:25:50.200747 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 757/1502] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:50 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:25:50.293431 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e2a44ba3-3f10-4412-b865-f01662e7ea3e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:50.294390 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e2a44ba3-3f10-4412-b865-f01662e7ea3e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:50.300350 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e2a44ba3-3f10-4412-b865-f01662e7ea3e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:50.300802 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e2a44ba3-3f10-4412-b865-f01662e7ea3e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:50.301573 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e2a44ba3-3f10-4412-b865-f01662e7ea3e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:50.302044 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e2a44ba3-3f10-4412-b865-f01662e7ea3e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:50.329306 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e2a44ba3-3f10-4412-b865-f01662e7ea3e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040488 Apr 08 11:25:50.329877 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 746/1503] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:50 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:51.190997 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-36e4e56c-ae59-4079-a54b-27ebbc4ded25 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:51.191668 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-36e4e56c-ae59-4079-a54b-27ebbc4ded25 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:51.198609 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-36e4e56c-ae59-4079-a54b-27ebbc4ded25 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:51.199057 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-36e4e56c-ae59-4079-a54b-27ebbc4ded25 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:51.199809 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-36e4e56c-ae59-4079-a54b-27ebbc4ded25 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:51.200240 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-36e4e56c-ae59-4079-a54b-27ebbc4ded25 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:51.216269 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b5189c2c-b414-446d-baf9-0b79c627edb1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:51.216919 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b5189c2c-b414-446d-baf9-0b79c627edb1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:51.223337 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b5189c2c-b414-446d-baf9-0b79c627edb1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:51.223791 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b5189c2c-b414-446d-baf9-0b79c627edb1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:51.224567 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b5189c2c-b414-446d-baf9-0b79c627edb1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:51.225006 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b5189c2c-b414-446d-baf9-0b79c627edb1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:51.292506 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b5189c2c-b414-446d-baf9-0b79c627edb1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:51.299941 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b5189c2c-b414-446d-baf9-0b79c627edb1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.087471 Apr 08 11:25:51.300739 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 747/1504] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:51 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:25:51.340739 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d976d13e-ca6d-4557-9dc2-cac459f966d0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:51.341673 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d976d13e-ca6d-4557-9dc2-cac459f966d0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:51.347630 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d976d13e-ca6d-4557-9dc2-cac459f966d0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:51.348084 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d976d13e-ca6d-4557-9dc2-cac459f966d0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:51.348858 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d976d13e-ca6d-4557-9dc2-cac459f966d0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:51.349296 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d976d13e-ca6d-4557-9dc2-cac459f966d0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:51.368529 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-36e4e56c-ae59-4079-a54b-27ebbc4ded25 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:51.376571 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-36e4e56c-ae59-4079-a54b-27ebbc4ded25 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.189389 Apr 08 11:25:51.377351 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 758/1505] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:51 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:51.380415 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d976d13e-ca6d-4557-9dc2-cac459f966d0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043632 Apr 08 11:25:51.380968 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 748/1506] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:51 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:25:52.317256 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-bd1c31b6-90d5-4bd8-8597-eed1de02e21b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:52.317904 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-bd1c31b6-90d5-4bd8-8597-eed1de02e21b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:52.324749 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bd1c31b6-90d5-4bd8-8597-eed1de02e21b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:52.325209 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bd1c31b6-90d5-4bd8-8597-eed1de02e21b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:52.326022 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bd1c31b6-90d5-4bd8-8597-eed1de02e21b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:52.326478 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bd1c31b6-90d5-4bd8-8597-eed1de02e21b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:52.385456 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-bd1c31b6-90d5-4bd8-8597-eed1de02e21b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:52.391893 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7b3c55a5-37f8-499b-ab60-0093da8a049f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:52.392905 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7b3c55a5-37f8-499b-ab60-0093da8a049f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:52.393015 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-bd1c31b6-90d5-4bd8-8597-eed1de02e21b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079500 Apr 08 11:25:52.394798 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 759/1507] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:52 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:52.398262 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-618221d4-65a6-4383-9638-7daecf13d9aa tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:52.398876 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-618221d4-65a6-4383-9638-7daecf13d9aa tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:52.399477 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7b3c55a5-37f8-499b-ab60-0093da8a049f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:52.399925 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7b3c55a5-37f8-499b-ab60-0093da8a049f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:52.400749 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7b3c55a5-37f8-499b-ab60-0093da8a049f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:52.401510 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7b3c55a5-37f8-499b-ab60-0093da8a049f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:52.404657 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-618221d4-65a6-4383-9638-7daecf13d9aa tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:52.405112 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-618221d4-65a6-4383-9638-7daecf13d9aa tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:52.405904 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-618221d4-65a6-4383-9638-7daecf13d9aa tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:52.406364 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-618221d4-65a6-4383-9638-7daecf13d9aa tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:52.429642 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7b3c55a5-37f8-499b-ab60-0093da8a049f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041495 Apr 08 11:25:52.430150 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 749/1508] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:52 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:52.543302 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-618221d4-65a6-4383-9638-7daecf13d9aa tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:52.551520 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-618221d4-65a6-4383-9638-7daecf13d9aa tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.156996 Apr 08 11:25:52.552368 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 760/1509] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:52 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:53.409815 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ce1bd2cb-f838-45a4-9b06-34316f5972c1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:53.414217 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ce1bd2cb-f838-45a4-9b06-34316f5972c1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:53.417277 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ce1bd2cb-f838-45a4-9b06-34316f5972c1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:53.417733 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ce1bd2cb-f838-45a4-9b06-34316f5972c1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:53.418530 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ce1bd2cb-f838-45a4-9b06-34316f5972c1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:53.419030 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ce1bd2cb-f838-45a4-9b06-34316f5972c1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:53.440751 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-9f4e945d-544b-4d86-864c-ff8ad9128b28 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:53.441708 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-9f4e945d-544b-4d86-864c-ff8ad9128b28 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:53.447988 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9f4e945d-544b-4d86-864c-ff8ad9128b28 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:53.448349 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9f4e945d-544b-4d86-864c-ff8ad9128b28 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:53.449120 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9f4e945d-544b-4d86-864c-ff8ad9128b28 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:53.449551 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9f4e945d-544b-4d86-864c-ff8ad9128b28 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:53.478121 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ce1bd2cb-f838-45a4-9b06-34316f5972c1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:53.480846 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-9f4e945d-544b-4d86-864c-ff8ad9128b28 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043978 Apr 08 11:25:53.481433 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 761/1510] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:53 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:25:53.486243 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ce1bd2cb-f838-45a4-9b06-34316f5972c1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080318 Apr 08 11:25:53.486820 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 750/1511] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:53 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:53.568174 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-4628efab-2a36-4641-bada-d8d9fd82f724 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:53.568779 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-4628efab-2a36-4641-bada-d8d9fd82f724 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:53.575141 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4628efab-2a36-4641-bada-d8d9fd82f724 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:53.575591 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4628efab-2a36-4641-bada-d8d9fd82f724 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:53.576343 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4628efab-2a36-4641-bada-d8d9fd82f724 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:53.576774 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4628efab-2a36-4641-bada-d8d9fd82f724 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:53.707908 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-4628efab-2a36-4641-bada-d8d9fd82f724 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:53.715934 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-4628efab-2a36-4641-bada-d8d9fd82f724 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.151500 Apr 08 11:25:53.716516 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 762/1512] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:53 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:54.492754 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ec38beb5-9dd8-4829-ac29-db7852bcc5da tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:54.493687 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ec38beb5-9dd8-4829-ac29-db7852bcc5da tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:54.500746 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ec38beb5-9dd8-4829-ac29-db7852bcc5da tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:54.501197 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ec38beb5-9dd8-4829-ac29-db7852bcc5da tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:54.501892 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-fe0efe83-8b84-4d69-ab43-2503c00d3974 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:54.502316 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ec38beb5-9dd8-4829-ac29-db7852bcc5da tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:54.502419 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ec38beb5-9dd8-4829-ac29-db7852bcc5da tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:54.502523 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-fe0efe83-8b84-4d69-ab43-2503c00d3974 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:54.508752 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fe0efe83-8b84-4d69-ab43-2503c00d3974 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:54.509203 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fe0efe83-8b84-4d69-ab43-2503c00d3974 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:54.509996 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fe0efe83-8b84-4d69-ab43-2503c00d3974 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:54.510434 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fe0efe83-8b84-4d69-ab43-2503c00d3974 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:54.530373 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ec38beb5-9dd8-4829-ac29-db7852bcc5da tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041850 Apr 08 11:25:54.530944 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 751/1513] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:54 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:54.573926 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-fe0efe83-8b84-4d69-ab43-2503c00d3974 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:54.581320 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-fe0efe83-8b84-4d69-ab43-2503c00d3974 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.083324 Apr 08 11:25:54.581914 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 763/1514] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:54 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:25:54.733055 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-72e414a3-9292-4c14-af98-b578520393ec tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:54.733738 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-72e414a3-9292-4c14-af98-b578520393ec tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:54.739894 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-72e414a3-9292-4c14-af98-b578520393ec tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:54.740336 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-72e414a3-9292-4c14-af98-b578520393ec tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:54.741091 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-72e414a3-9292-4c14-af98-b578520393ec tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:54.741523 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-72e414a3-9292-4c14-af98-b578520393ec tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:54.873033 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-72e414a3-9292-4c14-af98-b578520393ec tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:54.880381 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-72e414a3-9292-4c14-af98-b578520393ec tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.151869 Apr 08 11:25:54.880950 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 752/1515] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:54 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:55.541563 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-6657941b-4283-4eb0-88bc-3cdf76b6a693 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:55.542530 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-6657941b-4283-4eb0-88bc-3cdf76b6a693 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:55.548886 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6657941b-4283-4eb0-88bc-3cdf76b6a693 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:55.549331 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6657941b-4283-4eb0-88bc-3cdf76b6a693 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:55.550138 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6657941b-4283-4eb0-88bc-3cdf76b6a693 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:55.550570 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6657941b-4283-4eb0-88bc-3cdf76b6a693 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:55.581814 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-6657941b-4283-4eb0-88bc-3cdf76b6a693 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044068 Apr 08 11:25:55.590126 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 764/1516] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:55 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:55.598800 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bd7761fd-4880-4124-8a18-a240015f3df9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:55.599550 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-bd7761fd-4880-4124-8a18-a240015f3df9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:55.605965 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bd7761fd-4880-4124-8a18-a240015f3df9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:55.606421 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bd7761fd-4880-4124-8a18-a240015f3df9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:55.607205 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bd7761fd-4880-4124-8a18-a240015f3df9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:55.607646 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bd7761fd-4880-4124-8a18-a240015f3df9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:55.668055 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-bd7761fd-4880-4124-8a18-a240015f3df9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:55.675615 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-bd7761fd-4880-4124-8a18-a240015f3df9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081105 Apr 08 11:25:55.676189 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 753/1517] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:55 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:55.897250 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2605a132-83ac-4339-8552-d03de369eb46 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:55.897799 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-2605a132-83ac-4339-8552-d03de369eb46 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:55.904315 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2605a132-83ac-4339-8552-d03de369eb46 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:55.904765 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2605a132-83ac-4339-8552-d03de369eb46 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:55.905528 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2605a132-83ac-4339-8552-d03de369eb46 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:55.905996 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2605a132-83ac-4339-8552-d03de369eb46 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:56.038569 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2605a132-83ac-4339-8552-d03de369eb46 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:56.046042 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-2605a132-83ac-4339-8552-d03de369eb46 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.152555 Apr 08 11:25:56.046624 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 765/1518] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:55 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:56.599314 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d5352843-e861-4dd8-b2b9-40d269a3d357 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:56.600249 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d5352843-e861-4dd8-b2b9-40d269a3d357 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:56.606830 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d5352843-e861-4dd8-b2b9-40d269a3d357 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:56.607290 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d5352843-e861-4dd8-b2b9-40d269a3d357 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:56.608057 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d5352843-e861-4dd8-b2b9-40d269a3d357 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:56.608498 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d5352843-e861-4dd8-b2b9-40d269a3d357 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:56.638397 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d5352843-e861-4dd8-b2b9-40d269a3d357 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043008 Apr 08 11:25:56.638981 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 754/1519] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:56 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:56.692351 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-69490dcc-4f9a-475f-974e-ac34fdd2ef1c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:56.698700 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-69490dcc-4f9a-475f-974e-ac34fdd2ef1c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:56.699771 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-69490dcc-4f9a-475f-974e-ac34fdd2ef1c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:56.700231 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-69490dcc-4f9a-475f-974e-ac34fdd2ef1c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:56.701049 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-69490dcc-4f9a-475f-974e-ac34fdd2ef1c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:56.701506 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-69490dcc-4f9a-475f-974e-ac34fdd2ef1c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:56.769253 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-69490dcc-4f9a-475f-974e-ac34fdd2ef1c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:56.776820 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-69490dcc-4f9a-475f-974e-ac34fdd2ef1c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.088302 Apr 08 11:25:56.777436 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 766/1520] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:56 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:57.063044 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b942ee30-2b3b-40f2-9f0c-c741bc5f8893 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:57.063654 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b942ee30-2b3b-40f2-9f0c-c741bc5f8893 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:57.069482 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b942ee30-2b3b-40f2-9f0c-c741bc5f8893 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:57.069973 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b942ee30-2b3b-40f2-9f0c-c741bc5f8893 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:57.070732 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b942ee30-2b3b-40f2-9f0c-c741bc5f8893 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:57.071165 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b942ee30-2b3b-40f2-9f0c-c741bc5f8893 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:57.202515 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b942ee30-2b3b-40f2-9f0c-c741bc5f8893 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:57.209806 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b942ee30-2b3b-40f2-9f0c-c741bc5f8893 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.150625 Apr 08 11:25:57.210401 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 755/1521] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:57 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:57.650885 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-4dc3e318-c4e3-46e6-a1f0-e815286473b0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:57.651856 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-4dc3e318-c4e3-46e6-a1f0-e815286473b0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:57.658088 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4dc3e318-c4e3-46e6-a1f0-e815286473b0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:57.658551 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4dc3e318-c4e3-46e6-a1f0-e815286473b0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:57.659358 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4dc3e318-c4e3-46e6-a1f0-e815286473b0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:57.659816 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4dc3e318-c4e3-46e6-a1f0-e815286473b0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:57.688642 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-4dc3e318-c4e3-46e6-a1f0-e815286473b0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041819 Apr 08 11:25:57.689201 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 767/1522] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:57 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:57.794175 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3bcb8632-fdd4-461d-8b39-02db078b5d8e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:57.794778 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3bcb8632-fdd4-461d-8b39-02db078b5d8e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:57.801200 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3bcb8632-fdd4-461d-8b39-02db078b5d8e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:57.801651 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3bcb8632-fdd4-461d-8b39-02db078b5d8e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:57.802453 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3bcb8632-fdd4-461d-8b39-02db078b5d8e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:57.802893 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3bcb8632-fdd4-461d-8b39-02db078b5d8e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:57.866494 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3bcb8632-fdd4-461d-8b39-02db078b5d8e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:57.874900 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3bcb8632-fdd4-461d-8b39-02db078b5d8e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.084728 Apr 08 11:25:57.875485 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 756/1523] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:57 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:58.227093 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-92b002c0-202a-448d-9e67-b78a665339c0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:58.227662 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-92b002c0-202a-448d-9e67-b78a665339c0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:58.234222 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-92b002c0-202a-448d-9e67-b78a665339c0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:58.234673 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-92b002c0-202a-448d-9e67-b78a665339c0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:58.235448 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-92b002c0-202a-448d-9e67-b78a665339c0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:58.235887 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-92b002c0-202a-448d-9e67-b78a665339c0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:58.372102 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-92b002c0-202a-448d-9e67-b78a665339c0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:58.379626 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-92b002c0-202a-448d-9e67-b78a665339c0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.156552 Apr 08 11:25:58.380207 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 768/1524] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:58 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:58.699638 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-52bbb933-91ea-4c7f-b6c0-e5eb42a14621 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:58.700561 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-52bbb933-91ea-4c7f-b6c0-e5eb42a14621 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:58.706493 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-52bbb933-91ea-4c7f-b6c0-e5eb42a14621 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:58.706940 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-52bbb933-91ea-4c7f-b6c0-e5eb42a14621 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:58.707707 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-52bbb933-91ea-4c7f-b6c0-e5eb42a14621 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:58.708137 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-52bbb933-91ea-4c7f-b6c0-e5eb42a14621 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:58.737247 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-52bbb933-91ea-4c7f-b6c0-e5eb42a14621 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041637 Apr 08 11:25:58.737824 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 757/1525] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:58 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:25:58.891765 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-227993b5-de12-4ac1-ade6-e76234fe2709 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:58.892298 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-227993b5-de12-4ac1-ade6-e76234fe2709 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:58.898256 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-227993b5-de12-4ac1-ade6-e76234fe2709 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:58.898741 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-227993b5-de12-4ac1-ade6-e76234fe2709 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:58.899510 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-227993b5-de12-4ac1-ade6-e76234fe2709 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:58.900507 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-227993b5-de12-4ac1-ade6-e76234fe2709 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:58.961301 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-227993b5-de12-4ac1-ade6-e76234fe2709 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:58.969244 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-227993b5-de12-4ac1-ade6-e76234fe2709 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081484 Apr 08 11:25:58.969826 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 769/1526] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:58 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:59.396230 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-295840f5-f43e-456b-b4cd-b0e71d14683e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:59.396846 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-295840f5-f43e-456b-b4cd-b0e71d14683e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:59.403193 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-295840f5-f43e-456b-b4cd-b0e71d14683e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:59.403653 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-295840f5-f43e-456b-b4cd-b0e71d14683e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:59.404428 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-295840f5-f43e-456b-b4cd-b0e71d14683e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:59.404870 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-295840f5-f43e-456b-b4cd-b0e71d14683e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:59.540067 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-295840f5-f43e-456b-b4cd-b0e71d14683e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:25:59.548089 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-295840f5-f43e-456b-b4cd-b0e71d14683e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.155808 Apr 08 11:25:59.548666 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 758/1527] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:59 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:25:59.748828 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-593378ba-056b-42ce-b61f-6c522f5a4886 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:59.749703 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-593378ba-056b-42ce-b61f-6c522f5a4886 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:59.755995 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-593378ba-056b-42ce-b61f-6c522f5a4886 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:59.756451 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-593378ba-056b-42ce-b61f-6c522f5a4886 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:59.757220 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-593378ba-056b-42ce-b61f-6c522f5a4886 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:59.757654 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-593378ba-056b-42ce-b61f-6c522f5a4886 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:59.787582 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-593378ba-056b-42ce-b61f-6c522f5a4886 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042830 Apr 08 11:25:59.788144 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 770/1528] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:25:59 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:25:59.985646 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-63c504e8-c777-4ad5-b750-c5035ca746b9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:25:59.986282 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-63c504e8-c777-4ad5-b750-c5035ca746b9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:25:59.992392 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-63c504e8-c777-4ad5-b750-c5035ca746b9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:59.992837 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-63c504e8-c777-4ad5-b750-c5035ca746b9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:25:59.993627 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-63c504e8-c777-4ad5-b750-c5035ca746b9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:25:59.994088 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-63c504e8-c777-4ad5-b750-c5035ca746b9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:00.051691 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-63c504e8-c777-4ad5-b750-c5035ca746b9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:00.058982 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-63c504e8-c777-4ad5-b750-c5035ca746b9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077202 Apr 08 11:26:00.059546 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 759/1529] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:25:59 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:00.564863 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-6d3a3dfb-1265-404d-a5bc-c3f13d9b488a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:00.565472 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-6d3a3dfb-1265-404d-a5bc-c3f13d9b488a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:00.571623 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6d3a3dfb-1265-404d-a5bc-c3f13d9b488a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:00.572681 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6d3a3dfb-1265-404d-a5bc-c3f13d9b488a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:00.573495 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6d3a3dfb-1265-404d-a5bc-c3f13d9b488a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:00.573978 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6d3a3dfb-1265-404d-a5bc-c3f13d9b488a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:00.707263 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6d3a3dfb-1265-404d-a5bc-c3f13d9b488a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:00.714607 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-6d3a3dfb-1265-404d-a5bc-c3f13d9b488a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.153629 Apr 08 11:26:00.715179 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 771/1530] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:00 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:00.799773 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0f24e3f0-4735-426d-88f8-722cb96cb499 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:00.800702 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0f24e3f0-4735-426d-88f8-722cb96cb499 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:00.807587 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0f24e3f0-4735-426d-88f8-722cb96cb499 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:00.808030 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0f24e3f0-4735-426d-88f8-722cb96cb499 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:00.808793 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0f24e3f0-4735-426d-88f8-722cb96cb499 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:00.809225 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0f24e3f0-4735-426d-88f8-722cb96cb499 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:00.836789 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0f24e3f0-4735-426d-88f8-722cb96cb499 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040897 Apr 08 11:26:00.837269 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 760/1531] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:00 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:01.075435 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-0471ddb3-6891-4e6b-a728-f30ff4e1b3cc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:01.076060 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-0471ddb3-6891-4e6b-a728-f30ff4e1b3cc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:01.082437 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0471ddb3-6891-4e6b-a728-f30ff4e1b3cc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:01.082896 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0471ddb3-6891-4e6b-a728-f30ff4e1b3cc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:01.083670 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0471ddb3-6891-4e6b-a728-f30ff4e1b3cc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:01.084111 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0471ddb3-6891-4e6b-a728-f30ff4e1b3cc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:01.142784 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-0471ddb3-6891-4e6b-a728-f30ff4e1b3cc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:01.150659 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-0471ddb3-6891-4e6b-a728-f30ff4e1b3cc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078584 Apr 08 11:26:01.151234 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 772/1532] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:01 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:01.732293 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-74c23201-5632-485c-9645-6f48163dad28 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:01.732907 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-74c23201-5632-485c-9645-6f48163dad28 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:01.738988 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-74c23201-5632-485c-9645-6f48163dad28 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:01.739439 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-74c23201-5632-485c-9645-6f48163dad28 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:01.740226 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-74c23201-5632-485c-9645-6f48163dad28 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:01.740701 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-74c23201-5632-485c-9645-6f48163dad28 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:01.848360 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-564d5fd8-18c6-4d63-acf3-306b7e42dc6e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:01.849304 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-564d5fd8-18c6-4d63-acf3-306b7e42dc6e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:01.855937 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-564d5fd8-18c6-4d63-acf3-306b7e42dc6e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:01.856386 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-564d5fd8-18c6-4d63-acf3-306b7e42dc6e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:01.857158 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-564d5fd8-18c6-4d63-acf3-306b7e42dc6e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:01.857597 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-564d5fd8-18c6-4d63-acf3-306b7e42dc6e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:01.876540 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-74c23201-5632-485c-9645-6f48163dad28 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:01.884129 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-74c23201-5632-485c-9645-6f48163dad28 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.156272 Apr 08 11:26:01.884849 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 761/1533] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:01 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:01.886067 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-564d5fd8-18c6-4d63-acf3-306b7e42dc6e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041604 Apr 08 11:26:01.886635 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 773/1534] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:01 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:26:02.169000 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3bc7a929-bf85-4fd1-8adf-c353abf7e8bb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:02.169615 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3bc7a929-bf85-4fd1-8adf-c353abf7e8bb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:02.175908 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3bc7a929-bf85-4fd1-8adf-c353abf7e8bb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:02.176452 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3bc7a929-bf85-4fd1-8adf-c353abf7e8bb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:02.177221 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3bc7a929-bf85-4fd1-8adf-c353abf7e8bb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:02.177668 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3bc7a929-bf85-4fd1-8adf-c353abf7e8bb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:02.237910 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3bc7a929-bf85-4fd1-8adf-c353abf7e8bb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:02.245687 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3bc7a929-bf85-4fd1-8adf-c353abf7e8bb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082179 Apr 08 11:26:02.246301 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 762/1535] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:02 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:02.897639 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-b80e9fea-e47d-479d-a6a7-7917052a2e81 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:02.898526 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-b80e9fea-e47d-479d-a6a7-7917052a2e81 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:02.901665 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0c404264-deb6-433f-9f8a-b2e6fee2cebe tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:02.902311 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0c404264-deb6-433f-9f8a-b2e6fee2cebe tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:02.904895 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b80e9fea-e47d-479d-a6a7-7917052a2e81 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:02.905349 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b80e9fea-e47d-479d-a6a7-7917052a2e81 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:02.906155 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b80e9fea-e47d-479d-a6a7-7917052a2e81 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:02.906601 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b80e9fea-e47d-479d-a6a7-7917052a2e81 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:02.908573 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0c404264-deb6-433f-9f8a-b2e6fee2cebe tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:02.909036 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0c404264-deb6-433f-9f8a-b2e6fee2cebe tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:02.909835 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0c404264-deb6-433f-9f8a-b2e6fee2cebe tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:02.910281 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0c404264-deb6-433f-9f8a-b2e6fee2cebe tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:02.939371 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-b80e9fea-e47d-479d-a6a7-7917052a2e81 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045643 Apr 08 11:26:02.940308 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 774/1536] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:02 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:03.054588 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0c404264-deb6-433f-9f8a-b2e6fee2cebe tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:03.062584 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0c404264-deb6-433f-9f8a-b2e6fee2cebe tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.164826 Apr 08 11:26:03.063154 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 763/1537] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:02 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:26:03.262409 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-cbded75d-49e5-483a-812e-2fa9129aefed tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:03.263032 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-cbded75d-49e5-483a-812e-2fa9129aefed tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:03.269017 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cbded75d-49e5-483a-812e-2fa9129aefed tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:03.269471 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cbded75d-49e5-483a-812e-2fa9129aefed tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:03.270278 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cbded75d-49e5-483a-812e-2fa9129aefed tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:03.270724 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cbded75d-49e5-483a-812e-2fa9129aefed tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:03.334363 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-cbded75d-49e5-483a-812e-2fa9129aefed tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:03.342398 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-cbded75d-49e5-483a-812e-2fa9129aefed tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.083896 Apr 08 11:26:03.342976 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 775/1538] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:03 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:26:03.953093 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-eb4584dc-15cb-4f87-9edb-60e21a5485c5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:03.954061 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-eb4584dc-15cb-4f87-9edb-60e21a5485c5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:03.960485 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-eb4584dc-15cb-4f87-9edb-60e21a5485c5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:03.960941 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-eb4584dc-15cb-4f87-9edb-60e21a5485c5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:03.961718 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-eb4584dc-15cb-4f87-9edb-60e21a5485c5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:03.962838 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-eb4584dc-15cb-4f87-9edb-60e21a5485c5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:04.004315 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-eb4584dc-15cb-4f87-9edb-60e21a5485c5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055145 Apr 08 11:26:04.004881 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 764/1539] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:03 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:04.079364 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e1afbf77-cfd8-4736-9392-e50b40dc1ccb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:04.079963 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e1afbf77-cfd8-4736-9392-e50b40dc1ccb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:04.086255 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e1afbf77-cfd8-4736-9392-e50b40dc1ccb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:04.086708 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e1afbf77-cfd8-4736-9392-e50b40dc1ccb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:04.087473 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e1afbf77-cfd8-4736-9392-e50b40dc1ccb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:04.087909 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e1afbf77-cfd8-4736-9392-e50b40dc1ccb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:04.220385 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e1afbf77-cfd8-4736-9392-e50b40dc1ccb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:04.227681 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e1afbf77-cfd8-4736-9392-e50b40dc1ccb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.152167 Apr 08 11:26:04.228777 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 776/1540] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:04 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:04.359506 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-28783531-8a90-4c59-a775-655c2d64f44b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:04.360118 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-28783531-8a90-4c59-a775-655c2d64f44b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:04.366089 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-28783531-8a90-4c59-a775-655c2d64f44b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:04.366535 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-28783531-8a90-4c59-a775-655c2d64f44b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:04.367565 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-28783531-8a90-4c59-a775-655c2d64f44b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:04.368007 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-28783531-8a90-4c59-a775-655c2d64f44b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:04.427574 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-28783531-8a90-4c59-a775-655c2d64f44b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:04.435033 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-28783531-8a90-4c59-a775-655c2d64f44b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079376 Apr 08 11:26:04.435608 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 765/1541] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:04 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:05.016310 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-44df01ca-0ad5-424d-b8ca-88ad1550d961 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:05.017237 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-44df01ca-0ad5-424d-b8ca-88ad1550d961 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:05.023156 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-44df01ca-0ad5-424d-b8ca-88ad1550d961 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:05.023602 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-44df01ca-0ad5-424d-b8ca-88ad1550d961 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:05.024362 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-44df01ca-0ad5-424d-b8ca-88ad1550d961 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:05.025338 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-44df01ca-0ad5-424d-b8ca-88ad1550d961 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:05.052514 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-44df01ca-0ad5-424d-b8ca-88ad1550d961 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040150 Apr 08 11:26:05.053063 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 777/1542] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:05 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:05.246021 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0e5dd9f5-004f-43bb-8044-58bed1e017b7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:05.246646 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0e5dd9f5-004f-43bb-8044-58bed1e017b7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:05.253008 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0e5dd9f5-004f-43bb-8044-58bed1e017b7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:05.253465 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0e5dd9f5-004f-43bb-8044-58bed1e017b7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:05.254266 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0e5dd9f5-004f-43bb-8044-58bed1e017b7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:05.254712 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0e5dd9f5-004f-43bb-8044-58bed1e017b7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:05.391989 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0e5dd9f5-004f-43bb-8044-58bed1e017b7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:05.399316 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0e5dd9f5-004f-43bb-8044-58bed1e017b7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.157979 Apr 08 11:26:05.399916 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 766/1543] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:05 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:05.452016 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-ab8826cc-ffff-4603-996e-84fa953cd4ef tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:05.452696 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-ab8826cc-ffff-4603-996e-84fa953cd4ef tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:05.458909 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ab8826cc-ffff-4603-996e-84fa953cd4ef tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:05.459411 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ab8826cc-ffff-4603-996e-84fa953cd4ef tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:05.460185 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ab8826cc-ffff-4603-996e-84fa953cd4ef tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:05.460629 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ab8826cc-ffff-4603-996e-84fa953cd4ef tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:05.520137 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-ab8826cc-ffff-4603-996e-84fa953cd4ef tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:05.527617 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-ab8826cc-ffff-4603-996e-84fa953cd4ef tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079441 Apr 08 11:26:05.528298 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 778/1544] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:05 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:26:06.064317 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-78f29dd3-8db8-406d-a447-3d199406cd4f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:06.065251 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-78f29dd3-8db8-406d-a447-3d199406cd4f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:06.071259 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-78f29dd3-8db8-406d-a447-3d199406cd4f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:06.071714 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-78f29dd3-8db8-406d-a447-3d199406cd4f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:06.072482 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-78f29dd3-8db8-406d-a447-3d199406cd4f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:06.072924 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-78f29dd3-8db8-406d-a447-3d199406cd4f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:06.101169 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-78f29dd3-8db8-406d-a447-3d199406cd4f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040833 Apr 08 11:26:06.101729 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 767/1545] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:06 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:06.416587 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-bb377180-6bf8-4e52-898d-fd09bdb92200 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:06.417234 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-bb377180-6bf8-4e52-898d-fd09bdb92200 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:06.423178 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bb377180-6bf8-4e52-898d-fd09bdb92200 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:06.423630 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bb377180-6bf8-4e52-898d-fd09bdb92200 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:06.424407 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bb377180-6bf8-4e52-898d-fd09bdb92200 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:06.424845 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bb377180-6bf8-4e52-898d-fd09bdb92200 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:06.544217 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d0408919-ff98-4ab6-b478-43e546ea82ce tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:06.544829 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d0408919-ff98-4ab6-b478-43e546ea82ce tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:06.551072 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d0408919-ff98-4ab6-b478-43e546ea82ce tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:06.551518 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d0408919-ff98-4ab6-b478-43e546ea82ce tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:06.552288 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d0408919-ff98-4ab6-b478-43e546ea82ce tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:06.552743 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d0408919-ff98-4ab6-b478-43e546ea82ce tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:06.557870 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-bb377180-6bf8-4e52-898d-fd09bdb92200 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:06.565278 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-bb377180-6bf8-4e52-898d-fd09bdb92200 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.152583 Apr 08 11:26:06.565972 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 779/1546] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:06 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:06.614335 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d0408919-ff98-4ab6-b478-43e546ea82ce tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:06.622449 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d0408919-ff98-4ab6-b478-43e546ea82ce tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082074 Apr 08 11:26:06.623015 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 768/1547] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:06 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:26:07.113399 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a07b138f-04a8-4586-9ef5-0c9153c67270 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:07.114366 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a07b138f-04a8-4586-9ef5-0c9153c67270 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:07.121163 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a07b138f-04a8-4586-9ef5-0c9153c67270 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:07.121614 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a07b138f-04a8-4586-9ef5-0c9153c67270 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:07.122418 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a07b138f-04a8-4586-9ef5-0c9153c67270 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:07.122860 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a07b138f-04a8-4586-9ef5-0c9153c67270 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:07.150519 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a07b138f-04a8-4586-9ef5-0c9153c67270 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041108 Apr 08 11:26:07.151072 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 780/1548] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:07 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:07.582788 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-86fc908e-fe9a-4844-a4ce-c66de1b90ede tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:07.583392 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-86fc908e-fe9a-4844-a4ce-c66de1b90ede tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:07.590361 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-86fc908e-fe9a-4844-a4ce-c66de1b90ede tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:07.590838 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-86fc908e-fe9a-4844-a4ce-c66de1b90ede tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:07.591607 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-86fc908e-fe9a-4844-a4ce-c66de1b90ede tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:07.592044 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-86fc908e-fe9a-4844-a4ce-c66de1b90ede tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:07.639209 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-cedee750-4a71-4979-a55e-893d07ff85f4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:07.639974 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-cedee750-4a71-4979-a55e-893d07ff85f4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:07.646988 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cedee750-4a71-4979-a55e-893d07ff85f4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:07.647455 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cedee750-4a71-4979-a55e-893d07ff85f4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:07.649276 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cedee750-4a71-4979-a55e-893d07ff85f4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:07.650276 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cedee750-4a71-4979-a55e-893d07ff85f4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:07.719957 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-cedee750-4a71-4979-a55e-893d07ff85f4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:07.727575 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-cedee750-4a71-4979-a55e-893d07ff85f4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.092238 Apr 08 11:26:07.728667 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 781/1549] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:07 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:26:07.751486 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-86fc908e-fe9a-4844-a4ce-c66de1b90ede tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:07.759585 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-86fc908e-fe9a-4844-a4ce-c66de1b90ede tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.180251 Apr 08 11:26:07.760161 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 769/1550] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:07 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:08.162295 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-9dd4d9bc-3daa-41fe-a93e-de9b14e588a5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:08.163214 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-9dd4d9bc-3daa-41fe-a93e-de9b14e588a5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:08.169639 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9dd4d9bc-3daa-41fe-a93e-de9b14e588a5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:08.170109 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9dd4d9bc-3daa-41fe-a93e-de9b14e588a5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:08.170870 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9dd4d9bc-3daa-41fe-a93e-de9b14e588a5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:08.171300 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9dd4d9bc-3daa-41fe-a93e-de9b14e588a5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:08.198861 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-9dd4d9bc-3daa-41fe-a93e-de9b14e588a5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040652 Apr 08 11:26:08.199336 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 782/1551] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:08 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:08.745289 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-672b00b5-60d2-480f-8744-87435aa65272 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:08.745946 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-672b00b5-60d2-480f-8744-87435aa65272 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:08.751978 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-672b00b5-60d2-480f-8744-87435aa65272 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:08.752420 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-672b00b5-60d2-480f-8744-87435aa65272 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:08.753189 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-672b00b5-60d2-480f-8744-87435aa65272 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:08.753631 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-672b00b5-60d2-480f-8744-87435aa65272 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:08.778092 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-31d79628-ae5c-45fb-935f-f1ad3aebc461 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:08.778092 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-31d79628-ae5c-45fb-935f-f1ad3aebc461 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:08.792841 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-31d79628-ae5c-45fb-935f-f1ad3aebc461 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:08.793289 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-31d79628-ae5c-45fb-935f-f1ad3aebc461 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:08.794107 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-31d79628-ae5c-45fb-935f-f1ad3aebc461 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:08.794546 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-31d79628-ae5c-45fb-935f-f1ad3aebc461 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:08.820741 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-672b00b5-60d2-480f-8744-87435aa65272 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:08.828846 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-672b00b5-60d2-480f-8744-87435aa65272 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.088197 Apr 08 11:26:08.829519 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 770/1552] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:08 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:26:08.931318 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-31d79628-ae5c-45fb-935f-f1ad3aebc461 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:08.938686 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-31d79628-ae5c-45fb-935f-f1ad3aebc461 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.166157 Apr 08 11:26:08.939263 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 783/1553] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:08 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:26:09.210736 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f1e879c6-6123-4d88-bd61-0277c6b9f68d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:09.211523 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f1e879c6-6123-4d88-bd61-0277c6b9f68d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:09.217558 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f1e879c6-6123-4d88-bd61-0277c6b9f68d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:09.218051 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f1e879c6-6123-4d88-bd61-0277c6b9f68d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:09.218831 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f1e879c6-6123-4d88-bd61-0277c6b9f68d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:09.219275 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f1e879c6-6123-4d88-bd61-0277c6b9f68d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:09.248446 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f1e879c6-6123-4d88-bd61-0277c6b9f68d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041804 Apr 08 11:26:09.249026 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 771/1554] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:09 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:09.846195 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-545a51c8-2568-4765-a692-9f0ef7456a9e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:09.846810 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-545a51c8-2568-4765-a692-9f0ef7456a9e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:09.853787 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-545a51c8-2568-4765-a692-9f0ef7456a9e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:09.854310 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-545a51c8-2568-4765-a692-9f0ef7456a9e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:09.855091 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-545a51c8-2568-4765-a692-9f0ef7456a9e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:09.855533 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-545a51c8-2568-4765-a692-9f0ef7456a9e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:09.913374 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-545a51c8-2568-4765-a692-9f0ef7456a9e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:09.921352 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-545a51c8-2568-4765-a692-9f0ef7456a9e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079026 Apr 08 11:26:09.921947 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 784/1555] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:09 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:09.955507 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4c31d08e-3bbe-4286-9c2d-314ef52f6dbc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:09.956125 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4c31d08e-3bbe-4286-9c2d-314ef52f6dbc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:09.962975 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4c31d08e-3bbe-4286-9c2d-314ef52f6dbc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:09.963429 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4c31d08e-3bbe-4286-9c2d-314ef52f6dbc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:09.964204 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4c31d08e-3bbe-4286-9c2d-314ef52f6dbc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:09.964644 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4c31d08e-3bbe-4286-9c2d-314ef52f6dbc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:10.098514 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4c31d08e-3bbe-4286-9c2d-314ef52f6dbc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:10.106104 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4c31d08e-3bbe-4286-9c2d-314ef52f6dbc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.154361 Apr 08 11:26:10.106556 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 772/1556] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:09 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:10.260621 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-8fc5cc0b-e47a-4926-b138-304aa1f223ed tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:10.261624 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-8fc5cc0b-e47a-4926-b138-304aa1f223ed tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:10.267591 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8fc5cc0b-e47a-4926-b138-304aa1f223ed tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:10.268046 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8fc5cc0b-e47a-4926-b138-304aa1f223ed tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:10.268819 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8fc5cc0b-e47a-4926-b138-304aa1f223ed tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:10.269262 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8fc5cc0b-e47a-4926-b138-304aa1f223ed tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:10.297167 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-8fc5cc0b-e47a-4926-b138-304aa1f223ed tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041001 Apr 08 11:26:10.297723 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 785/1557] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:10 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:10.938112 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7f264d2a-9ccf-4bea-a15a-592cab8b4c0d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:10.938646 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7f264d2a-9ccf-4bea-a15a-592cab8b4c0d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:10.944524 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7f264d2a-9ccf-4bea-a15a-592cab8b4c0d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:10.944967 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7f264d2a-9ccf-4bea-a15a-592cab8b4c0d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:10.945725 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7f264d2a-9ccf-4bea-a15a-592cab8b4c0d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:10.946204 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7f264d2a-9ccf-4bea-a15a-592cab8b4c0d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:11.005886 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7f264d2a-9ccf-4bea-a15a-592cab8b4c0d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:11.013184 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7f264d2a-9ccf-4bea-a15a-592cab8b4c0d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079111 Apr 08 11:26:11.013744 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 773/1558] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:10 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:26:11.123698 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-fb85a8f4-8172-403a-a5a4-e0353980f01e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:11.124309 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-fb85a8f4-8172-403a-a5a4-e0353980f01e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:11.130630 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fb85a8f4-8172-403a-a5a4-e0353980f01e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:11.131087 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fb85a8f4-8172-403a-a5a4-e0353980f01e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:11.131855 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fb85a8f4-8172-403a-a5a4-e0353980f01e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:11.132296 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fb85a8f4-8172-403a-a5a4-e0353980f01e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:11.264057 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-fb85a8f4-8172-403a-a5a4-e0353980f01e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:11.271470 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-fb85a8f4-8172-403a-a5a4-e0353980f01e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.151619 Apr 08 11:26:11.272047 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 786/1559] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:11 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:11.308502 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f4524ee0-6f1d-424e-baca-fda988561207 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:11.309447 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f4524ee0-6f1d-424e-baca-fda988561207 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:11.315278 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f4524ee0-6f1d-424e-baca-fda988561207 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:11.315733 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f4524ee0-6f1d-424e-baca-fda988561207 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:11.316503 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f4524ee0-6f1d-424e-baca-fda988561207 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:11.316946 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f4524ee0-6f1d-424e-baca-fda988561207 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:11.344733 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f4524ee0-6f1d-424e-baca-fda988561207 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040118 Apr 08 11:26:11.345288 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 774/1560] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:11 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:11.883954 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 11:26:11.884210 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:26:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 11:26:12.030335 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-25fc17b9-0f40-42bb-8249-6d5e60591672 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:12.030981 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-25fc17b9-0f40-42bb-8249-6d5e60591672 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:12.036907 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-25fc17b9-0f40-42bb-8249-6d5e60591672 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:12.037358 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-25fc17b9-0f40-42bb-8249-6d5e60591672 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:12.038153 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-25fc17b9-0f40-42bb-8249-6d5e60591672 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:12.038604 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-25fc17b9-0f40-42bb-8249-6d5e60591672 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:12.099303 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-25fc17b9-0f40-42bb-8249-6d5e60591672 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:12.107227 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-25fc17b9-0f40-42bb-8249-6d5e60591672 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080865 Apr 08 11:26:12.107788 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 787/1561] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:12 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:12.288923 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7c4602ea-1502-4aab-b9dd-804948c6d01d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:12.289536 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7c4602ea-1502-4aab-b9dd-804948c6d01d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:12.295803 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7c4602ea-1502-4aab-b9dd-804948c6d01d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:12.296252 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7c4602ea-1502-4aab-b9dd-804948c6d01d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:12.297015 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7c4602ea-1502-4aab-b9dd-804948c6d01d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:12.297452 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7c4602ea-1502-4aab-b9dd-804948c6d01d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:12.356288 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-aa2e49a2-55e4-4a10-a212-dd4ad5f41462 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:12.357267 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-aa2e49a2-55e4-4a10-a212-dd4ad5f41462 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:12.363850 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-aa2e49a2-55e4-4a10-a212-dd4ad5f41462 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:12.364300 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-aa2e49a2-55e4-4a10-a212-dd4ad5f41462 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:12.365085 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-aa2e49a2-55e4-4a10-a212-dd4ad5f41462 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:12.365521 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-aa2e49a2-55e4-4a10-a212-dd4ad5f41462 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:12.396746 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-aa2e49a2-55e4-4a10-a212-dd4ad5f41462 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044350 Apr 08 11:26:12.397333 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 788/1562] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:12 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:26:12.677051 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7c4602ea-1502-4aab-b9dd-804948c6d01d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:12.685510 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7c4602ea-1502-4aab-b9dd-804948c6d01d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.400342 Apr 08 11:26:12.686133 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 775/1563] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:12 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:13.124377 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-1fe5df48-278d-4ff9-bf47-926048b1f7e9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:13.125025 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-1fe5df48-278d-4ff9-bf47-926048b1f7e9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:13.131457 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1fe5df48-278d-4ff9-bf47-926048b1f7e9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:13.131913 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1fe5df48-278d-4ff9-bf47-926048b1f7e9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:13.132687 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1fe5df48-278d-4ff9-bf47-926048b1f7e9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:13.133127 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1fe5df48-278d-4ff9-bf47-926048b1f7e9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:13.191379 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1fe5df48-278d-4ff9-bf47-926048b1f7e9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:13.198686 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-1fe5df48-278d-4ff9-bf47-926048b1f7e9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078295 Apr 08 11:26:13.199239 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 789/1564] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:13 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:13.409120 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-15962650-370e-45d6-aa40-aced4e45f13b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:13.409988 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-15962650-370e-45d6-aa40-aced4e45f13b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:13.416811 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-15962650-370e-45d6-aa40-aced4e45f13b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:13.417267 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-15962650-370e-45d6-aa40-aced4e45f13b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:13.418095 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-15962650-370e-45d6-aa40-aced4e45f13b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:13.418534 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-15962650-370e-45d6-aa40-aced4e45f13b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:13.446172 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-15962650-370e-45d6-aa40-aced4e45f13b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040921 Apr 08 11:26:13.446729 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 776/1565] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:13 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:13.702649 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-b0174d43-9bdc-4979-a0c3-a06f3ddc0520 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:13.703203 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-b0174d43-9bdc-4979-a0c3-a06f3ddc0520 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:13.709514 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b0174d43-9bdc-4979-a0c3-a06f3ddc0520 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:13.710003 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b0174d43-9bdc-4979-a0c3-a06f3ddc0520 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:13.710779 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b0174d43-9bdc-4979-a0c3-a06f3ddc0520 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:13.711224 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b0174d43-9bdc-4979-a0c3-a06f3ddc0520 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:13.850341 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b0174d43-9bdc-4979-a0c3-a06f3ddc0520 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:13.857803 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-b0174d43-9bdc-4979-a0c3-a06f3ddc0520 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.159055 Apr 08 11:26:13.858366 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 790/1566] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:13 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:14.215723 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ab2b5123-a93d-4bbe-b637-5d9f04fb8c38 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:14.216350 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ab2b5123-a93d-4bbe-b637-5d9f04fb8c38 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:14.222397 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ab2b5123-a93d-4bbe-b637-5d9f04fb8c38 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:14.222853 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ab2b5123-a93d-4bbe-b637-5d9f04fb8c38 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:14.223631 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ab2b5123-a93d-4bbe-b637-5d9f04fb8c38 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:14.224080 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ab2b5123-a93d-4bbe-b637-5d9f04fb8c38 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:14.283577 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ab2b5123-a93d-4bbe-b637-5d9f04fb8c38 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:14.291301 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ab2b5123-a93d-4bbe-b637-5d9f04fb8c38 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079794 Apr 08 11:26:14.291866 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 777/1567] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:14 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:14.457976 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-46ab71b5-9a13-445d-9d83-11eae899a26c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:14.458943 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-46ab71b5-9a13-445d-9d83-11eae899a26c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:14.464808 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-46ab71b5-9a13-445d-9d83-11eae899a26c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:14.465271 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-46ab71b5-9a13-445d-9d83-11eae899a26c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:14.466115 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-46ab71b5-9a13-445d-9d83-11eae899a26c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:14.466515 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-46ab71b5-9a13-445d-9d83-11eae899a26c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:14.494833 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-46ab71b5-9a13-445d-9d83-11eae899a26c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040883 Apr 08 11:26:14.495394 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 791/1568] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:14 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:14.875198 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-05e50e06-6e0f-457c-92fc-399439c5442a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:14.875826 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-05e50e06-6e0f-457c-92fc-399439c5442a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:14.882160 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-05e50e06-6e0f-457c-92fc-399439c5442a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:14.882616 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-05e50e06-6e0f-457c-92fc-399439c5442a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:14.883390 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-05e50e06-6e0f-457c-92fc-399439c5442a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:14.883832 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-05e50e06-6e0f-457c-92fc-399439c5442a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:15.018576 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-05e50e06-6e0f-457c-92fc-399439c5442a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:15.026573 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-05e50e06-6e0f-457c-92fc-399439c5442a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.155285 Apr 08 11:26:15.027140 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 778/1569] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:14 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:15.307967 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e6410b2b-91b8-40af-a79f-98239d9d54ab tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:15.308580 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e6410b2b-91b8-40af-a79f-98239d9d54ab tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:15.314850 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e6410b2b-91b8-40af-a79f-98239d9d54ab tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:15.315302 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e6410b2b-91b8-40af-a79f-98239d9d54ab tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:15.316076 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e6410b2b-91b8-40af-a79f-98239d9d54ab tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:15.316517 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e6410b2b-91b8-40af-a79f-98239d9d54ab tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:15.376236 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e6410b2b-91b8-40af-a79f-98239d9d54ab tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:15.384218 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e6410b2b-91b8-40af-a79f-98239d9d54ab tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079617 Apr 08 11:26:15.384806 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 792/1570] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:15 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:15.506162 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3d0f4162-2996-4f24-bf2c-b6d2f75a4ce4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:15.507097 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3d0f4162-2996-4f24-bf2c-b6d2f75a4ce4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:15.513481 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3d0f4162-2996-4f24-bf2c-b6d2f75a4ce4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:15.513973 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3d0f4162-2996-4f24-bf2c-b6d2f75a4ce4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:15.514744 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3d0f4162-2996-4f24-bf2c-b6d2f75a4ce4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:15.515186 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3d0f4162-2996-4f24-bf2c-b6d2f75a4ce4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:15.544879 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3d0f4162-2996-4f24-bf2c-b6d2f75a4ce4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042663 Apr 08 11:26:15.545614 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 779/1571] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:15 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:16.043871 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-6a753089-f949-407a-8593-27f163e82737 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:16.044495 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-6a753089-f949-407a-8593-27f163e82737 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:16.050524 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6a753089-f949-407a-8593-27f163e82737 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:16.050972 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6a753089-f949-407a-8593-27f163e82737 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:16.051729 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6a753089-f949-407a-8593-27f163e82737 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:16.052169 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6a753089-f949-407a-8593-27f163e82737 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:16.185466 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6a753089-f949-407a-8593-27f163e82737 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:16.193046 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-6a753089-f949-407a-8593-27f163e82737 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.153107 Apr 08 11:26:16.193556 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 793/1572] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:16 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:16.400837 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ed70e421-0543-4981-9ae8-c93d76f91d04 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:16.401453 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ed70e421-0543-4981-9ae8-c93d76f91d04 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:16.407804 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ed70e421-0543-4981-9ae8-c93d76f91d04 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:16.408262 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ed70e421-0543-4981-9ae8-c93d76f91d04 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:16.409069 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ed70e421-0543-4981-9ae8-c93d76f91d04 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:16.409657 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ed70e421-0543-4981-9ae8-c93d76f91d04 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:16.468556 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ed70e421-0543-4981-9ae8-c93d76f91d04 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:16.475964 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ed70e421-0543-4981-9ae8-c93d76f91d04 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078979 Apr 08 11:26:16.476534 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 780/1573] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:16 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:16.557048 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-c955b027-8288-4b1c-a030-775d71d62a67 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:16.558008 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-c955b027-8288-4b1c-a030-775d71d62a67 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:16.564354 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c955b027-8288-4b1c-a030-775d71d62a67 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:16.564806 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c955b027-8288-4b1c-a030-775d71d62a67 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:16.565572 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c955b027-8288-4b1c-a030-775d71d62a67 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:16.566044 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c955b027-8288-4b1c-a030-775d71d62a67 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:16.594843 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-c955b027-8288-4b1c-a030-775d71d62a67 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042212 Apr 08 11:26:16.595401 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 794/1574] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:16 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:17.210386 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f5e97bba-1e0d-464a-824c-ab1e6c624d9a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:17.211027 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f5e97bba-1e0d-464a-824c-ab1e6c624d9a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:17.217416 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f5e97bba-1e0d-464a-824c-ab1e6c624d9a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:17.217886 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f5e97bba-1e0d-464a-824c-ab1e6c624d9a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:17.218648 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f5e97bba-1e0d-464a-824c-ab1e6c624d9a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:17.219080 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f5e97bba-1e0d-464a-824c-ab1e6c624d9a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:17.351419 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f5e97bba-1e0d-464a-824c-ab1e6c624d9a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:17.359262 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f5e97bba-1e0d-464a-824c-ab1e6c624d9a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.152677 Apr 08 11:26:17.359834 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 781/1575] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:17 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:17.492103 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-b6986bb6-c72a-4a63-bc30-856571704eca tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:17.492677 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-b6986bb6-c72a-4a63-bc30-856571704eca tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:17.498743 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b6986bb6-c72a-4a63-bc30-856571704eca tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:17.499196 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b6986bb6-c72a-4a63-bc30-856571704eca tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:17.499957 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b6986bb6-c72a-4a63-bc30-856571704eca tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:17.500391 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b6986bb6-c72a-4a63-bc30-856571704eca tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:17.562604 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b6986bb6-c72a-4a63-bc30-856571704eca tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:17.570605 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-b6986bb6-c72a-4a63-bc30-856571704eca tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082746 Apr 08 11:26:17.571721 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 795/1576] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:17 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:17.606536 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-fbdef072-7d27-4ba8-9e1c-f6fd2ef4f56c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:17.607510 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-fbdef072-7d27-4ba8-9e1c-f6fd2ef4f56c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:17.613902 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fbdef072-7d27-4ba8-9e1c-f6fd2ef4f56c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:17.614360 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fbdef072-7d27-4ba8-9e1c-f6fd2ef4f56c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:17.615138 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fbdef072-7d27-4ba8-9e1c-f6fd2ef4f56c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:17.615581 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fbdef072-7d27-4ba8-9e1c-f6fd2ef4f56c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:17.647566 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-fbdef072-7d27-4ba8-9e1c-f6fd2ef4f56c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044943 Apr 08 11:26:17.648203 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 782/1577] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:17 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:18.381912 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-66d92c57-42ff-4429-9eef-bb7de3cabaf1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:18.382543 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-66d92c57-42ff-4429-9eef-bb7de3cabaf1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:18.394108 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-66d92c57-42ff-4429-9eef-bb7de3cabaf1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:18.394570 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-66d92c57-42ff-4429-9eef-bb7de3cabaf1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:18.395377 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-66d92c57-42ff-4429-9eef-bb7de3cabaf1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:18.395817 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-66d92c57-42ff-4429-9eef-bb7de3cabaf1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:18.528059 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-66d92c57-42ff-4429-9eef-bb7de3cabaf1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:18.535474 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-66d92c57-42ff-4429-9eef-bb7de3cabaf1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.159401 Apr 08 11:26:18.536050 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 796/1578] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:18 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:18.587523 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e8c808a8-d223-4253-87da-d43c8223784e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:18.588146 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e8c808a8-d223-4253-87da-d43c8223784e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:18.594056 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e8c808a8-d223-4253-87da-d43c8223784e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:18.594512 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e8c808a8-d223-4253-87da-d43c8223784e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:18.595287 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e8c808a8-d223-4253-87da-d43c8223784e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:18.595729 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e8c808a8-d223-4253-87da-d43c8223784e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:18.655601 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e8c808a8-d223-4253-87da-d43c8223784e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:18.659557 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-f37b4768-9c7c-46ff-93be-cf64a6a13aa0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:18.660510 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-f37b4768-9c7c-46ff-93be-cf64a6a13aa0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:18.664044 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e8c808a8-d223-4253-87da-d43c8223784e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080345 Apr 08 11:26:18.665203 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 783/1579] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:18 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:18.667079 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f37b4768-9c7c-46ff-93be-cf64a6a13aa0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:18.667522 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f37b4768-9c7c-46ff-93be-cf64a6a13aa0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:18.668294 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f37b4768-9c7c-46ff-93be-cf64a6a13aa0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:18.668726 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f37b4768-9c7c-46ff-93be-cf64a6a13aa0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:18.698775 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-f37b4768-9c7c-46ff-93be-cf64a6a13aa0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042947 Apr 08 11:26:18.699344 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 797/1580] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:18 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:26:19.552745 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e2311b28-12f8-4411-a0b8-dc1ca0cdc591 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:19.553355 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e2311b28-12f8-4411-a0b8-dc1ca0cdc591 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:19.559246 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e2311b28-12f8-4411-a0b8-dc1ca0cdc591 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:19.559710 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e2311b28-12f8-4411-a0b8-dc1ca0cdc591 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:19.560447 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e2311b28-12f8-4411-a0b8-dc1ca0cdc591 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:19.560879 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e2311b28-12f8-4411-a0b8-dc1ca0cdc591 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:19.681023 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a16f6f45-aa82-43f0-97ab-fc185945361b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:19.681638 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a16f6f45-aa82-43f0-97ab-fc185945361b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:19.687995 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a16f6f45-aa82-43f0-97ab-fc185945361b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:19.688449 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a16f6f45-aa82-43f0-97ab-fc185945361b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:19.689230 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a16f6f45-aa82-43f0-97ab-fc185945361b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:19.689668 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a16f6f45-aa82-43f0-97ab-fc185945361b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:19.696579 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e2311b28-12f8-4411-a0b8-dc1ca0cdc591 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:19.704097 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e2311b28-12f8-4411-a0b8-dc1ca0cdc591 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.155339 Apr 08 11:26:19.704874 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 784/1581] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:19 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:19.710200 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-feea3002-5d2d-4325-a341-d4dafb5c738a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:19.712060 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-feea3002-5d2d-4325-a341-d4dafb5c738a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:19.723903 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-feea3002-5d2d-4325-a341-d4dafb5c738a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:19.724357 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-feea3002-5d2d-4325-a341-d4dafb5c738a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:19.725160 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-feea3002-5d2d-4325-a341-d4dafb5c738a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:19.725589 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-feea3002-5d2d-4325-a341-d4dafb5c738a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:19.760035 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a16f6f45-aa82-43f0-97ab-fc185945361b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:19.768330 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a16f6f45-aa82-43f0-97ab-fc185945361b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.091092 Apr 08 11:26:19.772280 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 798/1582] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:19 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:19.776161 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-feea3002-5d2d-4325-a341-d4dafb5c738a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069292 Apr 08 11:26:19.776742 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 785/1583] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:19 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:26:20.779559 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a5eeaa2c-e9ae-4e8d-95c5-6a1c9f64eb41 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:20.780186 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a5eeaa2c-e9ae-4e8d-95c5-6a1c9f64eb41 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:20.785809 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b9e5c916-7c19-463a-a239-04520d8973f3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:20.786465 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b9e5c916-7c19-463a-a239-04520d8973f3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:20.787531 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a5eeaa2c-e9ae-4e8d-95c5-6a1c9f64eb41 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:20.787979 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a5eeaa2c-e9ae-4e8d-95c5-6a1c9f64eb41 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:20.788747 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a5eeaa2c-e9ae-4e8d-95c5-6a1c9f64eb41 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:20.789178 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a5eeaa2c-e9ae-4e8d-95c5-6a1c9f64eb41 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:20.793225 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b9e5c916-7c19-463a-a239-04520d8973f3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:20.793688 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b9e5c916-7c19-463a-a239-04520d8973f3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:20.794497 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b9e5c916-7c19-463a-a239-04520d8973f3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:20.794940 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b9e5c916-7c19-463a-a239-04520d8973f3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:20.876139 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b9e5c916-7c19-463a-a239-04520d8973f3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:20.883561 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b9e5c916-7c19-463a-a239-04520d8973f3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.101509 Apr 08 11:26:20.884197 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 786/1584] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:20 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:26:20.888825 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-cd4ff808-b830-4ac2-89c2-2c6e9ceaa2a7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:20.889754 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-cd4ff808-b830-4ac2-89c2-2c6e9ceaa2a7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:20.895677 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cd4ff808-b830-4ac2-89c2-2c6e9ceaa2a7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:20.896063 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cd4ff808-b830-4ac2-89c2-2c6e9ceaa2a7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:20.896839 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cd4ff808-b830-4ac2-89c2-2c6e9ceaa2a7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:20.897273 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cd4ff808-b830-4ac2-89c2-2c6e9ceaa2a7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:20.927374 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-cd4ff808-b830-4ac2-89c2-2c6e9ceaa2a7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042043 Apr 08 11:26:20.928124 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 787/1585] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:20 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:20.961648 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a5eeaa2c-e9ae-4e8d-95c5-6a1c9f64eb41 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:20.969035 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a5eeaa2c-e9ae-4e8d-95c5-6a1c9f64eb41 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.193337 Apr 08 11:26:20.969612 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 799/1586] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:20 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:21.193374 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 11:26:21.193569 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: Fri Apr 8 11:26:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 11:26:21.899779 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-49b8047e-6c29-473e-9d6a-0860cda06069 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:21.900324 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-49b8047e-6c29-473e-9d6a-0860cda06069 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:21.906687 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-49b8047e-6c29-473e-9d6a-0860cda06069 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:21.907143 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-49b8047e-6c29-473e-9d6a-0860cda06069 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:21.907915 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-49b8047e-6c29-473e-9d6a-0860cda06069 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:21.908354 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-49b8047e-6c29-473e-9d6a-0860cda06069 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:21.939350 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-92aa1dcd-2e68-4c70-8ed6-5f01d761ba5b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:21.940441 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-92aa1dcd-2e68-4c70-8ed6-5f01d761ba5b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:21.947844 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-92aa1dcd-2e68-4c70-8ed6-5f01d761ba5b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:21.948392 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-92aa1dcd-2e68-4c70-8ed6-5f01d761ba5b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:21.949278 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-92aa1dcd-2e68-4c70-8ed6-5f01d761ba5b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:21.949853 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-92aa1dcd-2e68-4c70-8ed6-5f01d761ba5b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:21.969130 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-49b8047e-6c29-473e-9d6a-0860cda06069 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:21.977012 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-49b8047e-6c29-473e-9d6a-0860cda06069 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081298 Apr 08 11:26:21.977591 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 788/1587] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:21 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:21.981339 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-92aa1dcd-2e68-4c70-8ed6-5f01d761ba5b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045121 Apr 08 11:26:21.981339 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 800/1588] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:21 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:26:21.986684 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4915ecad-8463-4fb6-b1c9-7855cf30549c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:21.987381 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4915ecad-8463-4fb6-b1c9-7855cf30549c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:21.994035 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4915ecad-8463-4fb6-b1c9-7855cf30549c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:21.994487 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4915ecad-8463-4fb6-b1c9-7855cf30549c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:21.995261 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4915ecad-8463-4fb6-b1c9-7855cf30549c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:21.995704 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4915ecad-8463-4fb6-b1c9-7855cf30549c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:22.128588 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4915ecad-8463-4fb6-b1c9-7855cf30549c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:22.135988 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4915ecad-8463-4fb6-b1c9-7855cf30549c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.153150 Apr 08 11:26:22.136555 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 789/1589] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:21 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:26:22.992785 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e1ad5695-638b-473e-a094-7196c4d86d40 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:22.993609 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2f5b1c78-2d16-43bf-9af1-71be14ba5f51 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:22.994041 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e1ad5695-638b-473e-a094-7196c4d86d40 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:22.994256 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2f5b1c78-2d16-43bf-9af1-71be14ba5f51 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:22.999806 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e1ad5695-638b-473e-a094-7196c4d86d40 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:23.000277 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e1ad5695-638b-473e-a094-7196c4d86d40 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:23.000557 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2f5b1c78-2d16-43bf-9af1-71be14ba5f51 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:23.001022 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2f5b1c78-2d16-43bf-9af1-71be14ba5f51 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:23.001158 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e1ad5695-638b-473e-a094-7196c4d86d40 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:23.001595 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e1ad5695-638b-473e-a094-7196c4d86d40 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:23.001824 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2f5b1c78-2d16-43bf-9af1-71be14ba5f51 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:23.002285 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2f5b1c78-2d16-43bf-9af1-71be14ba5f51 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:23.031879 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e1ad5695-638b-473e-a094-7196c4d86d40 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043521 Apr 08 11:26:23.032437 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 801/1590] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:22 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:23.067014 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2f5b1c78-2d16-43bf-9af1-71be14ba5f51 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:23.075296 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2f5b1c78-2d16-43bf-9af1-71be14ba5f51 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.085640 Apr 08 11:26:23.075893 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 790/1591] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:22 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:26:23.152874 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-16a36c58-bae0-4147-b327-1793225a66f1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:23.153494 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-16a36c58-bae0-4147-b327-1793225a66f1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:23.159433 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-16a36c58-bae0-4147-b327-1793225a66f1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:23.159889 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-16a36c58-bae0-4147-b327-1793225a66f1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:23.160662 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-16a36c58-bae0-4147-b327-1793225a66f1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:23.161108 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-16a36c58-bae0-4147-b327-1793225a66f1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:23.294999 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-16a36c58-bae0-4147-b327-1793225a66f1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:23.302279 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-16a36c58-bae0-4147-b327-1793225a66f1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.153270 Apr 08 11:26:23.302846 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 802/1592] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:23 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:24.044169 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b15caf3f-e54a-4b44-905e-3243f23ea726 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:24.045148 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b15caf3f-e54a-4b44-905e-3243f23ea726 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:24.051694 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b15caf3f-e54a-4b44-905e-3243f23ea726 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:24.052149 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b15caf3f-e54a-4b44-905e-3243f23ea726 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:24.052923 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b15caf3f-e54a-4b44-905e-3243f23ea726 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:24.053359 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b15caf3f-e54a-4b44-905e-3243f23ea726 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:24.080966 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b15caf3f-e54a-4b44-905e-3243f23ea726 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041322 Apr 08 11:26:24.081522 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 791/1593] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:24 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:24.091996 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-f8d5cb1f-123e-4077-8f2e-5394c8c97faf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:24.092615 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-f8d5cb1f-123e-4077-8f2e-5394c8c97faf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:24.098945 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f8d5cb1f-123e-4077-8f2e-5394c8c97faf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:24.099400 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f8d5cb1f-123e-4077-8f2e-5394c8c97faf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:24.100170 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f8d5cb1f-123e-4077-8f2e-5394c8c97faf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:24.100615 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f8d5cb1f-123e-4077-8f2e-5394c8c97faf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:24.158997 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f8d5cb1f-123e-4077-8f2e-5394c8c97faf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:24.166905 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-f8d5cb1f-123e-4077-8f2e-5394c8c97faf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078701 Apr 08 11:26:24.167460 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 803/1594] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:24 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:24.319805 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-63ca6cb9-f796-4ebf-b765-bb859adba58e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:24.320923 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-63ca6cb9-f796-4ebf-b765-bb859adba58e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:24.326862 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-63ca6cb9-f796-4ebf-b765-bb859adba58e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:24.327329 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-63ca6cb9-f796-4ebf-b765-bb859adba58e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:24.328090 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-63ca6cb9-f796-4ebf-b765-bb859adba58e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:24.328531 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-63ca6cb9-f796-4ebf-b765-bb859adba58e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:24.465713 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-63ca6cb9-f796-4ebf-b765-bb859adba58e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:24.473037 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-63ca6cb9-f796-4ebf-b765-bb859adba58e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.157109 Apr 08 11:26:24.473608 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 792/1595] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:24 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:25.093219 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e6963632-70ca-4e6c-b49c-d6b72c4c6366 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:25.094183 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e6963632-70ca-4e6c-b49c-d6b72c4c6366 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:25.100472 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e6963632-70ca-4e6c-b49c-d6b72c4c6366 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:25.100915 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e6963632-70ca-4e6c-b49c-d6b72c4c6366 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:25.101760 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e6963632-70ca-4e6c-b49c-d6b72c4c6366 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:25.102314 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e6963632-70ca-4e6c-b49c-d6b72c4c6366 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:25.129857 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e6963632-70ca-4e6c-b49c-d6b72c4c6366 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040571 Apr 08 11:26:25.130411 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 804/1596] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:25 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:25.183464 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c3b4ce68-075f-4a1a-8129-ad89f4cd08f2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:25.184087 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c3b4ce68-075f-4a1a-8129-ad89f4cd08f2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:25.190514 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c3b4ce68-075f-4a1a-8129-ad89f4cd08f2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:25.190976 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c3b4ce68-075f-4a1a-8129-ad89f4cd08f2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:25.191762 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c3b4ce68-075f-4a1a-8129-ad89f4cd08f2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:25.192202 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c3b4ce68-075f-4a1a-8129-ad89f4cd08f2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:25.253175 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c3b4ce68-075f-4a1a-8129-ad89f4cd08f2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:25.261106 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c3b4ce68-075f-4a1a-8129-ad89f4cd08f2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081543 Apr 08 11:26:25.261682 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 793/1597] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:25 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:25.489326 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-45565075-d46a-4b9e-80b5-f37e36412e53 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:25.489898 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-45565075-d46a-4b9e-80b5-f37e36412e53 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:25.496511 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-45565075-d46a-4b9e-80b5-f37e36412e53 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:25.496957 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-45565075-d46a-4b9e-80b5-f37e36412e53 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:25.497711 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-45565075-d46a-4b9e-80b5-f37e36412e53 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:25.498166 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-45565075-d46a-4b9e-80b5-f37e36412e53 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:25.631070 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-45565075-d46a-4b9e-80b5-f37e36412e53 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:25.639243 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-45565075-d46a-4b9e-80b5-f37e36412e53 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.153766 Apr 08 11:26:25.639824 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 805/1598] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:25 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:26.142654 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-fc6d582e-165c-4057-8a9e-6a33c325bcc0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:26.143590 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-fc6d582e-165c-4057-8a9e-6a33c325bcc0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:26.150018 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fc6d582e-165c-4057-8a9e-6a33c325bcc0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:26.150468 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fc6d582e-165c-4057-8a9e-6a33c325bcc0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:26.151237 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fc6d582e-165c-4057-8a9e-6a33c325bcc0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:26.151714 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fc6d582e-165c-4057-8a9e-6a33c325bcc0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:26.179982 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-fc6d582e-165c-4057-8a9e-6a33c325bcc0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041248 Apr 08 11:26:26.180585 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 794/1599] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:26 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:26.277839 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2519a67e-35a2-4adf-bdca-986fe1a12677 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:26.278476 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-2519a67e-35a2-4adf-bdca-986fe1a12677 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:26.284768 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2519a67e-35a2-4adf-bdca-986fe1a12677 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:26.285228 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2519a67e-35a2-4adf-bdca-986fe1a12677 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:26.286018 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2519a67e-35a2-4adf-bdca-986fe1a12677 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:26.286462 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2519a67e-35a2-4adf-bdca-986fe1a12677 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:26.347062 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2519a67e-35a2-4adf-bdca-986fe1a12677 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:26.354549 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-2519a67e-35a2-4adf-bdca-986fe1a12677 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081108 Apr 08 11:26:26.355117 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 806/1600] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:26 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:26.655629 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f2f8ef3f-2fac-4c38-9923-bb94ac3d993d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:26.656251 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f2f8ef3f-2fac-4c38-9923-bb94ac3d993d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:26.662273 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f2f8ef3f-2fac-4c38-9923-bb94ac3d993d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:26.662723 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f2f8ef3f-2fac-4c38-9923-bb94ac3d993d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:26.663516 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f2f8ef3f-2fac-4c38-9923-bb94ac3d993d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:26.663933 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f2f8ef3f-2fac-4c38-9923-bb94ac3d993d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:26.801438 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f2f8ef3f-2fac-4c38-9923-bb94ac3d993d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:26.809496 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f2f8ef3f-2fac-4c38-9923-bb94ac3d993d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.158036 Apr 08 11:26:26.810098 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 795/1601] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:26 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:27.191138 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-7255dc88-a0b8-453e-a495-d116a3c05cb1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:27.192078 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-7255dc88-a0b8-453e-a495-d116a3c05cb1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:27.198066 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7255dc88-a0b8-453e-a495-d116a3c05cb1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:27.198532 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7255dc88-a0b8-453e-a495-d116a3c05cb1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:27.199321 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7255dc88-a0b8-453e-a495-d116a3c05cb1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:27.199767 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7255dc88-a0b8-453e-a495-d116a3c05cb1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:27.229199 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-7255dc88-a0b8-453e-a495-d116a3c05cb1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042000 Apr 08 11:26:27.229849 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 807/1602] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:27 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:27.371575 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f8c61db2-e141-43d8-a0d9-04f689f661c0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:27.372182 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f8c61db2-e141-43d8-a0d9-04f689f661c0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:27.378049 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f8c61db2-e141-43d8-a0d9-04f689f661c0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:27.378496 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f8c61db2-e141-43d8-a0d9-04f689f661c0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:27.379282 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f8c61db2-e141-43d8-a0d9-04f689f661c0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:27.379715 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f8c61db2-e141-43d8-a0d9-04f689f661c0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:27.438129 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f8c61db2-e141-43d8-a0d9-04f689f661c0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:27.445949 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f8c61db2-e141-43d8-a0d9-04f689f661c0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077673 Apr 08 11:26:27.446455 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 796/1603] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:27 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:27.827504 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-1b784118-0464-4cca-b9ba-973083c07729 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:27.828319 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-1b784118-0464-4cca-b9ba-973083c07729 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:27.834700 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1b784118-0464-4cca-b9ba-973083c07729 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:27.835151 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1b784118-0464-4cca-b9ba-973083c07729 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:27.835945 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1b784118-0464-4cca-b9ba-973083c07729 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:27.836379 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1b784118-0464-4cca-b9ba-973083c07729 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:27.973742 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1b784118-0464-4cca-b9ba-973083c07729 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:27.982659 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-1b784118-0464-4cca-b9ba-973083c07729 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.159311 Apr 08 11:26:27.983237 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 808/1604] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:27 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:28.240785 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e6f9a09f-9979-4fe6-80dd-edb577176e51 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:28.241979 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e6f9a09f-9979-4fe6-80dd-edb577176e51 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:28.248911 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e6f9a09f-9979-4fe6-80dd-edb577176e51 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:28.249362 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e6f9a09f-9979-4fe6-80dd-edb577176e51 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:28.250171 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e6f9a09f-9979-4fe6-80dd-edb577176e51 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:28.250611 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e6f9a09f-9979-4fe6-80dd-edb577176e51 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:28.278122 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e6f9a09f-9979-4fe6-80dd-edb577176e51 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041346 Apr 08 11:26:28.278684 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 797/1605] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:28 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:28.462967 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-b95a9245-aec2-4c62-85ef-aa7e544b1f23 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:28.463593 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-b95a9245-aec2-4c62-85ef-aa7e544b1f23 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:28.469509 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b95a9245-aec2-4c62-85ef-aa7e544b1f23 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:28.470063 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b95a9245-aec2-4c62-85ef-aa7e544b1f23 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:28.470825 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b95a9245-aec2-4c62-85ef-aa7e544b1f23 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:28.471257 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b95a9245-aec2-4c62-85ef-aa7e544b1f23 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:28.529689 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b95a9245-aec2-4c62-85ef-aa7e544b1f23 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:28.537016 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-b95a9245-aec2-4c62-85ef-aa7e544b1f23 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078451 Apr 08 11:26:28.537582 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 809/1606] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:28 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:29.000987 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b3f0cd00-b56b-4dc6-b78a-a56a1f4fdbdd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:29.001485 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b3f0cd00-b56b-4dc6-b78a-a56a1f4fdbdd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:29.007371 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b3f0cd00-b56b-4dc6-b78a-a56a1f4fdbdd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:29.008329 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b3f0cd00-b56b-4dc6-b78a-a56a1f4fdbdd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:29.009130 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b3f0cd00-b56b-4dc6-b78a-a56a1f4fdbdd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:29.009562 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b3f0cd00-b56b-4dc6-b78a-a56a1f4fdbdd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:29.146168 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b3f0cd00-b56b-4dc6-b78a-a56a1f4fdbdd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:29.154027 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b3f0cd00-b56b-4dc6-b78a-a56a1f4fdbdd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.157033 Apr 08 11:26:29.154597 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 798/1607] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:28 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:29.290271 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-b7199423-188a-400e-bc5b-16295022d140 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:29.291203 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-b7199423-188a-400e-bc5b-16295022d140 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:29.297455 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b7199423-188a-400e-bc5b-16295022d140 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:29.297981 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b7199423-188a-400e-bc5b-16295022d140 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:29.298753 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b7199423-188a-400e-bc5b-16295022d140 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:29.299195 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b7199423-188a-400e-bc5b-16295022d140 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:29.327083 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-b7199423-188a-400e-bc5b-16295022d140 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041289 Apr 08 11:26:29.327672 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 810/1608] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:29 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:29.554389 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b48b6ff7-50f2-400b-a47c-7b415ed717f7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:29.554970 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b48b6ff7-50f2-400b-a47c-7b415ed717f7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:29.562177 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b48b6ff7-50f2-400b-a47c-7b415ed717f7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:29.562630 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b48b6ff7-50f2-400b-a47c-7b415ed717f7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:29.563426 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b48b6ff7-50f2-400b-a47c-7b415ed717f7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:29.563868 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b48b6ff7-50f2-400b-a47c-7b415ed717f7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:29.628493 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b48b6ff7-50f2-400b-a47c-7b415ed717f7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:29.636968 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b48b6ff7-50f2-400b-a47c-7b415ed717f7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.086553 Apr 08 11:26:29.637564 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 799/1609] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:29 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:30.170365 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-40b79e5d-071f-48c9-be74-0aa5494e7a6a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:30.170868 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-40b79e5d-071f-48c9-be74-0aa5494e7a6a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:30.176691 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-40b79e5d-071f-48c9-be74-0aa5494e7a6a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:30.177145 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-40b79e5d-071f-48c9-be74-0aa5494e7a6a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:30.177934 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-40b79e5d-071f-48c9-be74-0aa5494e7a6a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:30.178370 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-40b79e5d-071f-48c9-be74-0aa5494e7a6a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:30.313844 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-40b79e5d-071f-48c9-be74-0aa5494e7a6a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:30.321402 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-40b79e5d-071f-48c9-be74-0aa5494e7a6a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.154956 Apr 08 11:26:30.322014 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 811/1610] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:30 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:30.338557 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d2c91400-a9c9-4c4d-9ed3-49c7c50dd402 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:30.339491 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d2c91400-a9c9-4c4d-9ed3-49c7c50dd402 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:30.345329 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d2c91400-a9c9-4c4d-9ed3-49c7c50dd402 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:30.345818 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d2c91400-a9c9-4c4d-9ed3-49c7c50dd402 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:30.346592 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d2c91400-a9c9-4c4d-9ed3-49c7c50dd402 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:30.347040 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d2c91400-a9c9-4c4d-9ed3-49c7c50dd402 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:30.376691 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d2c91400-a9c9-4c4d-9ed3-49c7c50dd402 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042078 Apr 08 11:26:30.377240 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 800/1611] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:30 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:30.654488 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-88d4bfae-3591-442d-8da5-689bac6fe6be tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:30.655109 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-88d4bfae-3591-442d-8da5-689bac6fe6be tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:30.660994 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-88d4bfae-3591-442d-8da5-689bac6fe6be tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:30.661448 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-88d4bfae-3591-442d-8da5-689bac6fe6be tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:30.662250 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-88d4bfae-3591-442d-8da5-689bac6fe6be tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:30.662690 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-88d4bfae-3591-442d-8da5-689bac6fe6be tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:30.721997 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-88d4bfae-3591-442d-8da5-689bac6fe6be tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:30.729334 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-88d4bfae-3591-442d-8da5-689bac6fe6be tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078721 Apr 08 11:26:30.729923 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 812/1612] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:30 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:31.338465 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a0770e45-f214-4979-9ef6-75feb65c7a84 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:31.339106 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a0770e45-f214-4979-9ef6-75feb65c7a84 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:31.345672 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a0770e45-f214-4979-9ef6-75feb65c7a84 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:31.346165 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a0770e45-f214-4979-9ef6-75feb65c7a84 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:31.346954 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a0770e45-f214-4979-9ef6-75feb65c7a84 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:31.347399 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a0770e45-f214-4979-9ef6-75feb65c7a84 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:31.388196 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-351308cf-2fbd-49c9-8127-c91809cf8fb3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:31.389184 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-351308cf-2fbd-49c9-8127-c91809cf8fb3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:31.395726 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-351308cf-2fbd-49c9-8127-c91809cf8fb3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:31.396181 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-351308cf-2fbd-49c9-8127-c91809cf8fb3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:31.396964 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-351308cf-2fbd-49c9-8127-c91809cf8fb3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:31.397408 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-351308cf-2fbd-49c9-8127-c91809cf8fb3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:31.430068 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-351308cf-2fbd-49c9-8127-c91809cf8fb3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045681 Apr 08 11:26:31.430672 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 813/1613] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:31 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:31.486980 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a0770e45-f214-4979-9ef6-75feb65c7a84 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:31.494974 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a0770e45-f214-4979-9ef6-75feb65c7a84 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.160972 Apr 08 11:26:31.495556 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 801/1614] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:31 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:31.746191 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e9af202e-d12e-436b-a1d4-e941b032949d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:31.746838 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e9af202e-d12e-436b-a1d4-e941b032949d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:31.752750 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e9af202e-d12e-436b-a1d4-e941b032949d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:31.753202 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e9af202e-d12e-436b-a1d4-e941b032949d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:31.754014 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e9af202e-d12e-436b-a1d4-e941b032949d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:31.754454 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e9af202e-d12e-436b-a1d4-e941b032949d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:31.820693 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e9af202e-d12e-436b-a1d4-e941b032949d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:31.824980 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e9af202e-d12e-436b-a1d4-e941b032949d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082664 Apr 08 11:26:31.825546 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 814/1615] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:31 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:32.441753 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8e256334-edde-48ca-a1f3-d97cf77abea8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:32.442722 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8e256334-edde-48ca-a1f3-d97cf77abea8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:32.449111 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8e256334-edde-48ca-a1f3-d97cf77abea8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:32.449568 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8e256334-edde-48ca-a1f3-d97cf77abea8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:32.450379 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8e256334-edde-48ca-a1f3-d97cf77abea8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:32.450835 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8e256334-edde-48ca-a1f3-d97cf77abea8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:32.479927 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8e256334-edde-48ca-a1f3-d97cf77abea8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042222 Apr 08 11:26:32.480503 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 802/1616] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:32 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:32.512142 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-f3d591cf-9de5-40cb-8673-5a950ef2d5e1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:32.512778 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-f3d591cf-9de5-40cb-8673-5a950ef2d5e1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:32.519137 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f3d591cf-9de5-40cb-8673-5a950ef2d5e1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:32.519609 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f3d591cf-9de5-40cb-8673-5a950ef2d5e1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:32.520385 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f3d591cf-9de5-40cb-8673-5a950ef2d5e1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:32.520822 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f3d591cf-9de5-40cb-8673-5a950ef2d5e1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:32.660051 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f3d591cf-9de5-40cb-8673-5a950ef2d5e1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:32.668929 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-f3d591cf-9de5-40cb-8673-5a950ef2d5e1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.160632 Apr 08 11:26:32.676418 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 815/1617] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:32 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:32.841578 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bfceeb4b-cea7-47d0-88eb-86c17ec50875 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:32.842298 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-bfceeb4b-cea7-47d0-88eb-86c17ec50875 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:32.853786 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bfceeb4b-cea7-47d0-88eb-86c17ec50875 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:32.854416 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bfceeb4b-cea7-47d0-88eb-86c17ec50875 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:32.855298 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bfceeb4b-cea7-47d0-88eb-86c17ec50875 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:32.855786 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bfceeb4b-cea7-47d0-88eb-86c17ec50875 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:32.920597 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-bfceeb4b-cea7-47d0-88eb-86c17ec50875 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:32.928179 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-bfceeb4b-cea7-47d0-88eb-86c17ec50875 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.090683 Apr 08 11:26:32.928760 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 803/1618] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:32 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:33.492367 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-b78ce597-e90c-47d8-b4b3-a662ed14cee0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:33.493417 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-b78ce597-e90c-47d8-b4b3-a662ed14cee0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:33.499543 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b78ce597-e90c-47d8-b4b3-a662ed14cee0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:33.500002 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b78ce597-e90c-47d8-b4b3-a662ed14cee0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:33.500801 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b78ce597-e90c-47d8-b4b3-a662ed14cee0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:33.501244 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b78ce597-e90c-47d8-b4b3-a662ed14cee0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:33.530588 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-b78ce597-e90c-47d8-b4b3-a662ed14cee0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042913 Apr 08 11:26:33.531285 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 816/1619] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:33 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:33.686761 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0a7fad5f-f5e5-451b-bbd6-d673b404da95 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:33.687375 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0a7fad5f-f5e5-451b-bbd6-d673b404da95 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:33.693636 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0a7fad5f-f5e5-451b-bbd6-d673b404da95 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:33.694153 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0a7fad5f-f5e5-451b-bbd6-d673b404da95 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:33.694953 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0a7fad5f-f5e5-451b-bbd6-d673b404da95 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:33.695395 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0a7fad5f-f5e5-451b-bbd6-d673b404da95 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:33.833840 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0a7fad5f-f5e5-451b-bbd6-d673b404da95 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:33.842878 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0a7fad5f-f5e5-451b-bbd6-d673b404da95 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.160068 Apr 08 11:26:33.843466 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 804/1620] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:33 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:33.944803 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-971df9c2-00df-45cf-94fa-348395bb8697 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:33.945438 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-971df9c2-00df-45cf-94fa-348395bb8697 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:33.951535 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-971df9c2-00df-45cf-94fa-348395bb8697 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:33.951988 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-971df9c2-00df-45cf-94fa-348395bb8697 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:33.952750 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-971df9c2-00df-45cf-94fa-348395bb8697 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:33.953191 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-971df9c2-00df-45cf-94fa-348395bb8697 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:34.012374 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-971df9c2-00df-45cf-94fa-348395bb8697 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:34.019827 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-971df9c2-00df-45cf-94fa-348395bb8697 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078882 Apr 08 11:26:34.020930 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 817/1621] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:33 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:34.541735 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0d37e098-ac01-40be-9473-afe3c2f469ee tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:34.542716 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0d37e098-ac01-40be-9473-afe3c2f469ee tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:34.548596 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0d37e098-ac01-40be-9473-afe3c2f469ee tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:34.549048 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0d37e098-ac01-40be-9473-afe3c2f469ee tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:34.549833 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0d37e098-ac01-40be-9473-afe3c2f469ee tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:34.550291 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0d37e098-ac01-40be-9473-afe3c2f469ee tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:34.578834 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0d37e098-ac01-40be-9473-afe3c2f469ee tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041188 Apr 08 11:26:34.579393 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 805/1622] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:34 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:34.859871 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-362fd681-3bbe-48ba-92e2-c548d771414d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:34.860430 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-362fd681-3bbe-48ba-92e2-c548d771414d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:34.867612 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-362fd681-3bbe-48ba-92e2-c548d771414d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:34.868069 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-362fd681-3bbe-48ba-92e2-c548d771414d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:34.868849 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-362fd681-3bbe-48ba-92e2-c548d771414d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:34.869291 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-362fd681-3bbe-48ba-92e2-c548d771414d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:35.001151 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-362fd681-3bbe-48ba-92e2-c548d771414d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:35.009270 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-362fd681-3bbe-48ba-92e2-c548d771414d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.153352 Apr 08 11:26:35.009871 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 818/1623] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:34 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:35.036209 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6636baad-f0ce-4d84-bc00-cf59aa1f802c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:35.036860 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6636baad-f0ce-4d84-bc00-cf59aa1f802c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:35.043244 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6636baad-f0ce-4d84-bc00-cf59aa1f802c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:35.043699 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6636baad-f0ce-4d84-bc00-cf59aa1f802c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:35.044473 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6636baad-f0ce-4d84-bc00-cf59aa1f802c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:35.044917 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6636baad-f0ce-4d84-bc00-cf59aa1f802c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:35.109541 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6636baad-f0ce-4d84-bc00-cf59aa1f802c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:35.117794 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6636baad-f0ce-4d84-bc00-cf59aa1f802c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.084867 Apr 08 11:26:35.118322 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 806/1624] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:35 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:35.590551 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-fe0c6a47-b4ae-4821-804b-245a0289b51e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:35.591480 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-fe0c6a47-b4ae-4821-804b-245a0289b51e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:35.597532 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fe0c6a47-b4ae-4821-804b-245a0289b51e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:35.598018 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fe0c6a47-b4ae-4821-804b-245a0289b51e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:35.598816 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fe0c6a47-b4ae-4821-804b-245a0289b51e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:35.599257 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fe0c6a47-b4ae-4821-804b-245a0289b51e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:35.627904 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-fe0c6a47-b4ae-4821-804b-245a0289b51e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041235 Apr 08 11:26:35.628461 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 819/1625] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:35 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:36.026148 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-40def844-c78b-47f6-9acc-d5c99875a756 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:36.026799 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-40def844-c78b-47f6-9acc-d5c99875a756 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:36.032612 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-40def844-c78b-47f6-9acc-d5c99875a756 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:36.033067 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-40def844-c78b-47f6-9acc-d5c99875a756 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:36.033885 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-40def844-c78b-47f6-9acc-d5c99875a756 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:36.034329 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-40def844-c78b-47f6-9acc-d5c99875a756 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:36.134762 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-36e46094-65d2-47a3-8956-6ca1374950c3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:36.135443 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-36e46094-65d2-47a3-8956-6ca1374950c3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:36.141656 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-36e46094-65d2-47a3-8956-6ca1374950c3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:36.142151 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-36e46094-65d2-47a3-8956-6ca1374950c3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:36.142934 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-36e46094-65d2-47a3-8956-6ca1374950c3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:36.143378 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-36e46094-65d2-47a3-8956-6ca1374950c3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:36.169339 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-40def844-c78b-47f6-9acc-d5c99875a756 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:36.176883 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-40def844-c78b-47f6-9acc-d5c99875a756 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.155124 Apr 08 11:26:36.177461 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 807/1626] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:36 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:36.203269 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-36e46094-65d2-47a3-8956-6ca1374950c3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:36.211208 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-36e46094-65d2-47a3-8956-6ca1374950c3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080143 Apr 08 11:26:36.211774 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 820/1627] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:36 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:26:36.639838 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5f99ff51-ed4c-4bdf-8c58-74e7c4ea00d8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:36.640828 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5f99ff51-ed4c-4bdf-8c58-74e7c4ea00d8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:36.646906 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5f99ff51-ed4c-4bdf-8c58-74e7c4ea00d8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:36.647360 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5f99ff51-ed4c-4bdf-8c58-74e7c4ea00d8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:36.648142 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5f99ff51-ed4c-4bdf-8c58-74e7c4ea00d8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:36.648578 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5f99ff51-ed4c-4bdf-8c58-74e7c4ea00d8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:36.678237 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5f99ff51-ed4c-4bdf-8c58-74e7c4ea00d8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042397 Apr 08 11:26:36.678792 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 808/1628] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:36 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:37.194059 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-68b36d02-3ea2-4789-847b-1604789ab98d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:37.194680 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-68b36d02-3ea2-4789-847b-1604789ab98d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:37.201026 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-68b36d02-3ea2-4789-847b-1604789ab98d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:37.201486 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-68b36d02-3ea2-4789-847b-1604789ab98d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:37.202291 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-68b36d02-3ea2-4789-847b-1604789ab98d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:37.202733 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-68b36d02-3ea2-4789-847b-1604789ab98d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:37.228386 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9484274a-1c9e-49ef-8fdf-b0cb8db2503e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:37.229218 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9484274a-1c9e-49ef-8fdf-b0cb8db2503e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:37.236892 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9484274a-1c9e-49ef-8fdf-b0cb8db2503e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:37.237402 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9484274a-1c9e-49ef-8fdf-b0cb8db2503e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:37.238294 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9484274a-1c9e-49ef-8fdf-b0cb8db2503e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:37.238896 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9484274a-1c9e-49ef-8fdf-b0cb8db2503e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:37.304481 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9484274a-1c9e-49ef-8fdf-b0cb8db2503e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:37.311767 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9484274a-1c9e-49ef-8fdf-b0cb8db2503e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.087916 Apr 08 11:26:37.312343 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 809/1629] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:37 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:26:37.366100 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-68b36d02-3ea2-4789-847b-1604789ab98d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:37.373977 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-68b36d02-3ea2-4789-847b-1604789ab98d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.183709 Apr 08 11:26:37.374566 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 821/1630] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:37 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:37.690425 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f0ebf3c8-9e95-4808-a0fe-e500a98ee3e5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:37.691364 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f0ebf3c8-9e95-4808-a0fe-e500a98ee3e5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:37.697718 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f0ebf3c8-9e95-4808-a0fe-e500a98ee3e5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:37.698199 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f0ebf3c8-9e95-4808-a0fe-e500a98ee3e5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:37.698970 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f0ebf3c8-9e95-4808-a0fe-e500a98ee3e5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:37.699409 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f0ebf3c8-9e95-4808-a0fe-e500a98ee3e5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:37.727678 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f0ebf3c8-9e95-4808-a0fe-e500a98ee3e5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041161 Apr 08 11:26:37.728242 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 810/1631] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:37 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:38.078427 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 11:26:38.078681 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:26:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 11:26:38.328403 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-9868a704-99b8-43b6-932d-db60d8fdcf76 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:38.329009 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-9868a704-99b8-43b6-932d-db60d8fdcf76 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:38.335507 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9868a704-99b8-43b6-932d-db60d8fdcf76 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:38.335954 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9868a704-99b8-43b6-932d-db60d8fdcf76 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:38.336726 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9868a704-99b8-43b6-932d-db60d8fdcf76 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:38.337164 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9868a704-99b8-43b6-932d-db60d8fdcf76 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:38.391548 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2b46fdd3-e509-45ab-9e17-6fa66d466ead tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:38.392289 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2b46fdd3-e509-45ab-9e17-6fa66d466ead tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:38.396636 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-9868a704-99b8-43b6-932d-db60d8fdcf76 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:38.399136 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2b46fdd3-e509-45ab-9e17-6fa66d466ead tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:38.399676 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2b46fdd3-e509-45ab-9e17-6fa66d466ead tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:38.400564 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2b46fdd3-e509-45ab-9e17-6fa66d466ead tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:38.401076 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2b46fdd3-e509-45ab-9e17-6fa66d466ead tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:38.404043 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-9868a704-99b8-43b6-932d-db60d8fdcf76 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079502 Apr 08 11:26:38.404766 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 822/1632] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:38 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:38.537851 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2b46fdd3-e509-45ab-9e17-6fa66d466ead tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:38.545855 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2b46fdd3-e509-45ab-9e17-6fa66d466ead tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.158149 Apr 08 11:26:38.546413 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 811/1633] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:38 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:26:38.739462 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e2e62789-d006-452e-ae4c-7203bf1ddd45 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:38.740376 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e2e62789-d006-452e-ae4c-7203bf1ddd45 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:38.747228 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e2e62789-d006-452e-ae4c-7203bf1ddd45 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:38.747675 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e2e62789-d006-452e-ae4c-7203bf1ddd45 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:38.748436 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e2e62789-d006-452e-ae4c-7203bf1ddd45 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:38.748870 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e2e62789-d006-452e-ae4c-7203bf1ddd45 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:38.776726 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e2e62789-d006-452e-ae4c-7203bf1ddd45 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041295 Apr 08 11:26:38.777277 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 823/1634] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:38 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:39.420854 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b83a7820-e450-4893-92d3-526064705b14 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:39.421473 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b83a7820-e450-4893-92d3-526064705b14 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:39.427822 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b83a7820-e450-4893-92d3-526064705b14 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:39.428278 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b83a7820-e450-4893-92d3-526064705b14 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:39.429059 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b83a7820-e450-4893-92d3-526064705b14 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:39.429501 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b83a7820-e450-4893-92d3-526064705b14 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:39.488895 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b83a7820-e450-4893-92d3-526064705b14 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:39.496829 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b83a7820-e450-4893-92d3-526064705b14 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079928 Apr 08 11:26:39.497440 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 812/1635] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:39 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:39.563961 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-5b0256f3-fa3a-4183-a86f-6456910c7ee1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:39.564576 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-5b0256f3-fa3a-4183-a86f-6456910c7ee1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:39.570879 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5b0256f3-fa3a-4183-a86f-6456910c7ee1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:39.571333 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5b0256f3-fa3a-4183-a86f-6456910c7ee1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:39.572185 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5b0256f3-fa3a-4183-a86f-6456910c7ee1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:39.572624 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5b0256f3-fa3a-4183-a86f-6456910c7ee1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:39.707751 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-5b0256f3-fa3a-4183-a86f-6456910c7ee1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:39.715822 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-5b0256f3-fa3a-4183-a86f-6456910c7ee1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.155792 Apr 08 11:26:39.716397 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 824/1636] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:39 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:39.788265 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b19ccec2-4be1-4c6c-ba46-adc24ea685ae tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:39.789196 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b19ccec2-4be1-4c6c-ba46-adc24ea685ae tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:39.795148 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b19ccec2-4be1-4c6c-ba46-adc24ea685ae tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:39.795598 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b19ccec2-4be1-4c6c-ba46-adc24ea685ae tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:39.796369 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b19ccec2-4be1-4c6c-ba46-adc24ea685ae tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:39.796807 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b19ccec2-4be1-4c6c-ba46-adc24ea685ae tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:39.825304 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b19ccec2-4be1-4c6c-ba46-adc24ea685ae tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040939 Apr 08 11:26:39.825880 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 813/1637] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:39 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:40.513502 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-bd0a6f34-17e4-46f8-b026-52fc9121caa8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:40.514138 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-bd0a6f34-17e4-46f8-b026-52fc9121caa8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:40.520142 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bd0a6f34-17e4-46f8-b026-52fc9121caa8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:40.520592 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bd0a6f34-17e4-46f8-b026-52fc9121caa8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:40.521361 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bd0a6f34-17e4-46f8-b026-52fc9121caa8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:40.521821 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bd0a6f34-17e4-46f8-b026-52fc9121caa8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:40.579967 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-bd0a6f34-17e4-46f8-b026-52fc9121caa8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:40.587322 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-bd0a6f34-17e4-46f8-b026-52fc9121caa8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077691 Apr 08 11:26:40.587892 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 825/1638] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:40 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:40.732600 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-77166696-a2ac-4aa0-a971-050b576ccd5d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:40.733212 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-77166696-a2ac-4aa0-a971-050b576ccd5d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:40.739530 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-77166696-a2ac-4aa0-a971-050b576ccd5d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:40.739970 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-77166696-a2ac-4aa0-a971-050b576ccd5d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:40.740735 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-77166696-a2ac-4aa0-a971-050b576ccd5d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:40.741170 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-77166696-a2ac-4aa0-a971-050b576ccd5d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:40.836616 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-137f43ea-430a-4f9b-84c4-a7de23531e9a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:40.837537 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-137f43ea-430a-4f9b-84c4-a7de23531e9a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:40.843807 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-137f43ea-430a-4f9b-84c4-a7de23531e9a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:40.844249 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-137f43ea-430a-4f9b-84c4-a7de23531e9a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:40.845016 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-137f43ea-430a-4f9b-84c4-a7de23531e9a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:40.845453 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-137f43ea-430a-4f9b-84c4-a7de23531e9a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:40.860533 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 11:26:40.860742 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:26:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 (ip 10.222.0.46) !!! Apr 08 11:26:40.879047 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-137f43ea-430a-4f9b-84c4-a7de23531e9a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046397 Apr 08 11:26:40.879625 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 826/1639] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:40 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:26:40.883881 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-77166696-a2ac-4aa0-a971-050b576ccd5d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:40.891318 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-77166696-a2ac-4aa0-a971-050b576ccd5d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.162714 Apr 08 11:26:40.891880 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 814/1640] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:40 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:41.700561 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2b4cac19-0fa5-419e-8266-eb9d320b1947 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:41.701172 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-2b4cac19-0fa5-419e-8266-eb9d320b1947 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:41.707242 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2b4cac19-0fa5-419e-8266-eb9d320b1947 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:41.707684 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2b4cac19-0fa5-419e-8266-eb9d320b1947 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:41.708455 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2b4cac19-0fa5-419e-8266-eb9d320b1947 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:41.708887 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2b4cac19-0fa5-419e-8266-eb9d320b1947 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:41.768933 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-2b4cac19-0fa5-419e-8266-eb9d320b1947 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:41.776925 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-2b4cac19-0fa5-419e-8266-eb9d320b1947 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.176704 Apr 08 11:26:41.777499 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 827/1641] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:41 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:41.891612 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0f983d8c-4104-4f58-ae14-03db13411d3f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:41.892507 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0f983d8c-4104-4f58-ae14-03db13411d3f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:41.899511 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0f983d8c-4104-4f58-ae14-03db13411d3f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:41.899964 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0f983d8c-4104-4f58-ae14-03db13411d3f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:41.900745 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0f983d8c-4104-4f58-ae14-03db13411d3f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:41.901195 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0f983d8c-4104-4f58-ae14-03db13411d3f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:41.908786 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-0c959fbf-61e8-453e-bdb5-97ce9e32fad0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:41.909403 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-0c959fbf-61e8-453e-bdb5-97ce9e32fad0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:41.916141 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0c959fbf-61e8-453e-bdb5-97ce9e32fad0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:41.916723 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0c959fbf-61e8-453e-bdb5-97ce9e32fad0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:41.917544 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0c959fbf-61e8-453e-bdb5-97ce9e32fad0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:41.918013 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0c959fbf-61e8-453e-bdb5-97ce9e32fad0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:41.934813 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0f983d8c-4104-4f58-ae14-03db13411d3f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047266 Apr 08 11:26:41.936114 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 815/1642] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:41 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:26:42.066930 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-0c959fbf-61e8-453e-bdb5-97ce9e32fad0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:42.075130 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-0c959fbf-61e8-453e-bdb5-97ce9e32fad0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.170602 Apr 08 11:26:42.075707 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 828/1643] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:41 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:26:42.794024 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1e652a83-fb6a-4f36-b2e0-ca00c0178dd4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:42.794645 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1e652a83-fb6a-4f36-b2e0-ca00c0178dd4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:42.800574 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1e652a83-fb6a-4f36-b2e0-ca00c0178dd4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:42.801025 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1e652a83-fb6a-4f36-b2e0-ca00c0178dd4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:42.801819 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1e652a83-fb6a-4f36-b2e0-ca00c0178dd4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:42.802266 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1e652a83-fb6a-4f36-b2e0-ca00c0178dd4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:42.860625 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1e652a83-fb6a-4f36-b2e0-ca00c0178dd4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:42.868627 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1e652a83-fb6a-4f36-b2e0-ca00c0178dd4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078528 Apr 08 11:26:42.869200 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 816/1644] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:42 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:42.946475 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-5e36eb18-3237-4968-a620-93802d5ae167 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:42.947400 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-5e36eb18-3237-4968-a620-93802d5ae167 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:42.953794 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5e36eb18-3237-4968-a620-93802d5ae167 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:42.954257 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5e36eb18-3237-4968-a620-93802d5ae167 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:42.955021 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5e36eb18-3237-4968-a620-93802d5ae167 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:42.955462 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5e36eb18-3237-4968-a620-93802d5ae167 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:42.983801 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-5e36eb18-3237-4968-a620-93802d5ae167 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041302 Apr 08 11:26:42.984452 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 829/1645] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:42 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:43.092733 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-063779a9-5e94-4394-b2dc-104dff2febb3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:43.093354 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-063779a9-5e94-4394-b2dc-104dff2febb3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:43.099690 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-063779a9-5e94-4394-b2dc-104dff2febb3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:43.100147 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-063779a9-5e94-4394-b2dc-104dff2febb3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:43.100976 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-063779a9-5e94-4394-b2dc-104dff2febb3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:43.102052 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-063779a9-5e94-4394-b2dc-104dff2febb3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:43.238342 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-063779a9-5e94-4394-b2dc-104dff2febb3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:43.246156 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-063779a9-5e94-4394-b2dc-104dff2febb3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.157282 Apr 08 11:26:43.246721 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 817/1646] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:43 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:43.885686 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-6c3a39e2-e91e-4aed-b80d-5f18b8c203ed tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:43.886333 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-6c3a39e2-e91e-4aed-b80d-5f18b8c203ed tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:43.892204 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6c3a39e2-e91e-4aed-b80d-5f18b8c203ed tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:43.892658 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6c3a39e2-e91e-4aed-b80d-5f18b8c203ed tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:43.893447 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6c3a39e2-e91e-4aed-b80d-5f18b8c203ed tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:43.893920 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6c3a39e2-e91e-4aed-b80d-5f18b8c203ed tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:43.952299 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6c3a39e2-e91e-4aed-b80d-5f18b8c203ed tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:43.960047 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-6c3a39e2-e91e-4aed-b80d-5f18b8c203ed tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078779 Apr 08 11:26:43.960610 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 830/1647] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:43 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:43.996980 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-db748871-8157-4e68-ae2b-ac9f285727ec tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:43.998069 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-db748871-8157-4e68-ae2b-ac9f285727ec tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:44.006184 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-db748871-8157-4e68-ae2b-ac9f285727ec tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:44.006895 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-db748871-8157-4e68-ae2b-ac9f285727ec tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:44.008213 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-db748871-8157-4e68-ae2b-ac9f285727ec tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:44.008931 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-db748871-8157-4e68-ae2b-ac9f285727ec tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:44.036979 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-db748871-8157-4e68-ae2b-ac9f285727ec tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045417 Apr 08 11:26:44.037537 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 818/1648] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:43 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:44.262794 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-bacd1b01-0891-431c-9094-06228fbac78d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:44.263440 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-bacd1b01-0891-431c-9094-06228fbac78d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:44.269348 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bacd1b01-0891-431c-9094-06228fbac78d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:44.269824 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bacd1b01-0891-431c-9094-06228fbac78d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:44.270595 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bacd1b01-0891-431c-9094-06228fbac78d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:44.271035 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-bacd1b01-0891-431c-9094-06228fbac78d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:44.405677 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-bacd1b01-0891-431c-9094-06228fbac78d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:44.413726 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-bacd1b01-0891-431c-9094-06228fbac78d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.154390 Apr 08 11:26:44.423834 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 831/1649] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:44 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:44.976791 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-21522966-12cd-42e2-b7bd-57b9f9d3237a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:44.977320 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-21522966-12cd-42e2-b7bd-57b9f9d3237a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:44.983586 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-21522966-12cd-42e2-b7bd-57b9f9d3237a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:44.984038 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-21522966-12cd-42e2-b7bd-57b9f9d3237a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:44.984817 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-21522966-12cd-42e2-b7bd-57b9f9d3237a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:44.985293 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-21522966-12cd-42e2-b7bd-57b9f9d3237a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:45.045225 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-21522966-12cd-42e2-b7bd-57b9f9d3237a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:45.048527 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-ce622926-0e36-4d34-9d2c-cd99946bbdb6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:45.049513 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-ce622926-0e36-4d34-9d2c-cd99946bbdb6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:45.052709 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-21522966-12cd-42e2-b7bd-57b9f9d3237a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079867 Apr 08 11:26:45.053276 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 819/1650] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:44 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:45.055811 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ce622926-0e36-4d34-9d2c-cd99946bbdb6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:45.056266 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ce622926-0e36-4d34-9d2c-cd99946bbdb6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:45.057361 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ce622926-0e36-4d34-9d2c-cd99946bbdb6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:45.057483 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ce622926-0e36-4d34-9d2c-cd99946bbdb6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:45.086555 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-ce622926-0e36-4d34-9d2c-cd99946bbdb6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041937 Apr 08 11:26:45.087113 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 832/1651] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:45 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:26:45.439597 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bd110c75-4797-498f-a594-c8dfe460be94 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:45.440214 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-bd110c75-4797-498f-a594-c8dfe460be94 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:45.446802 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bd110c75-4797-498f-a594-c8dfe460be94 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:45.447255 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bd110c75-4797-498f-a594-c8dfe460be94 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:45.448037 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bd110c75-4797-498f-a594-c8dfe460be94 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:45.448481 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bd110c75-4797-498f-a594-c8dfe460be94 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:45.579823 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-bd110c75-4797-498f-a594-c8dfe460be94 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:45.587212 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-bd110c75-4797-498f-a594-c8dfe460be94 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.151461 Apr 08 11:26:45.587792 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 820/1652] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:45 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:46.069223 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-7a389999-deaa-4665-9702-facf15e6a1e2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:46.069904 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-7a389999-deaa-4665-9702-facf15e6a1e2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:46.076112 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7a389999-deaa-4665-9702-facf15e6a1e2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:46.076578 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7a389999-deaa-4665-9702-facf15e6a1e2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:46.077350 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7a389999-deaa-4665-9702-facf15e6a1e2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:46.077992 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7a389999-deaa-4665-9702-facf15e6a1e2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:46.098037 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5675e252-71cc-4e40-a7a6-3d61c2befe5c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:46.098982 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5675e252-71cc-4e40-a7a6-3d61c2befe5c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:46.105903 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5675e252-71cc-4e40-a7a6-3d61c2befe5c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:46.106363 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5675e252-71cc-4e40-a7a6-3d61c2befe5c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:46.107143 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5675e252-71cc-4e40-a7a6-3d61c2befe5c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:46.107586 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5675e252-71cc-4e40-a7a6-3d61c2befe5c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:46.136790 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5675e252-71cc-4e40-a7a6-3d61c2befe5c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042659 Apr 08 11:26:46.140631 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 821/1653] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:46 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:26:46.141372 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-7a389999-deaa-4665-9702-facf15e6a1e2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:46.149136 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-7a389999-deaa-4665-9702-facf15e6a1e2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.083787 Apr 08 11:26:46.149706 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 833/1654] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:46 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:46.604656 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3bb024b1-045a-4a71-829f-aa4950c1b2db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:46.605281 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3bb024b1-045a-4a71-829f-aa4950c1b2db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:46.611183 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3bb024b1-045a-4a71-829f-aa4950c1b2db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:46.611637 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3bb024b1-045a-4a71-829f-aa4950c1b2db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:46.612439 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3bb024b1-045a-4a71-829f-aa4950c1b2db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:46.612879 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3bb024b1-045a-4a71-829f-aa4950c1b2db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:46.745322 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3bb024b1-045a-4a71-829f-aa4950c1b2db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:46.752654 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3bb024b1-045a-4a71-829f-aa4950c1b2db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.152319 Apr 08 11:26:46.753241 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 822/1655] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:46 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:26:47.148416 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a12ed369-c1f8-4281-b06f-2bc1f732df7b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:47.149349 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a12ed369-c1f8-4281-b06f-2bc1f732df7b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:47.155685 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a12ed369-c1f8-4281-b06f-2bc1f732df7b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:47.156140 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a12ed369-c1f8-4281-b06f-2bc1f732df7b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:47.156905 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a12ed369-c1f8-4281-b06f-2bc1f732df7b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:47.157346 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a12ed369-c1f8-4281-b06f-2bc1f732df7b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:47.165699 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-655ab28e-88df-4b48-8a38-73774347bfab tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:47.166429 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-655ab28e-88df-4b48-8a38-73774347bfab tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:47.173586 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-655ab28e-88df-4b48-8a38-73774347bfab tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:47.174061 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-655ab28e-88df-4b48-8a38-73774347bfab tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:47.174863 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-655ab28e-88df-4b48-8a38-73774347bfab tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:47.175295 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-655ab28e-88df-4b48-8a38-73774347bfab tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:47.186854 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a12ed369-c1f8-4281-b06f-2bc1f732df7b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042977 Apr 08 11:26:47.187422 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 834/1656] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:47 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:47.236395 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-655ab28e-88df-4b48-8a38-73774347bfab tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:47.244138 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-655ab28e-88df-4b48-8a38-73774347bfab tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082276 Apr 08 11:26:47.244707 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 823/1657] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:47 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:26:47.769918 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-4af570cb-6643-4079-9d3e-08c8c0d16704 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:47.770537 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-4af570cb-6643-4079-9d3e-08c8c0d16704 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:47.776495 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4af570cb-6643-4079-9d3e-08c8c0d16704 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:47.776952 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4af570cb-6643-4079-9d3e-08c8c0d16704 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:47.777724 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4af570cb-6643-4079-9d3e-08c8c0d16704 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:47.778192 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4af570cb-6643-4079-9d3e-08c8c0d16704 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:47.911915 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-4af570cb-6643-4079-9d3e-08c8c0d16704 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:47.919812 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-4af570cb-6643-4079-9d3e-08c8c0d16704 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.153787 Apr 08 11:26:47.920391 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 835/1658] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:47 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:48.198942 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6c63433c-1a15-4aaa-b1ab-5fe78aec2486 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:48.199775 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6c63433c-1a15-4aaa-b1ab-5fe78aec2486 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:48.206151 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6c63433c-1a15-4aaa-b1ab-5fe78aec2486 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:48.206603 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6c63433c-1a15-4aaa-b1ab-5fe78aec2486 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:48.207371 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6c63433c-1a15-4aaa-b1ab-5fe78aec2486 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:48.207807 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6c63433c-1a15-4aaa-b1ab-5fe78aec2486 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:48.237102 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6c63433c-1a15-4aaa-b1ab-5fe78aec2486 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042261 Apr 08 11:26:48.237674 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 824/1659] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:48 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:48.260311 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-57ee30dd-f4bf-4ce9-bcae-3e6ab75176e0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:48.260928 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-57ee30dd-f4bf-4ce9-bcae-3e6ab75176e0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:48.267197 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-57ee30dd-f4bf-4ce9-bcae-3e6ab75176e0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:48.267649 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-57ee30dd-f4bf-4ce9-bcae-3e6ab75176e0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:48.268414 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-57ee30dd-f4bf-4ce9-bcae-3e6ab75176e0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:48.268851 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-57ee30dd-f4bf-4ce9-bcae-3e6ab75176e0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:48.328576 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-57ee30dd-f4bf-4ce9-bcae-3e6ab75176e0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:48.336742 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-57ee30dd-f4bf-4ce9-bcae-3e6ab75176e0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080288 Apr 08 11:26:48.337312 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 836/1660] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:48 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:48.937629 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2cde6100-140b-4541-8c34-5c8d88d9c1c5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:48.938185 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2cde6100-140b-4541-8c34-5c8d88d9c1c5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:48.944624 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2cde6100-140b-4541-8c34-5c8d88d9c1c5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:48.945097 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2cde6100-140b-4541-8c34-5c8d88d9c1c5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:48.945884 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2cde6100-140b-4541-8c34-5c8d88d9c1c5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:48.946324 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2cde6100-140b-4541-8c34-5c8d88d9c1c5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:49.092295 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2cde6100-140b-4541-8c34-5c8d88d9c1c5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:49.099681 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2cde6100-140b-4541-8c34-5c8d88d9c1c5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.166055 Apr 08 11:26:49.100251 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 825/1661] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:48 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:49.248971 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-1fc37fe1-39f6-455a-aff6-672caae7c7fe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:49.249853 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-1fc37fe1-39f6-455a-aff6-672caae7c7fe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:49.255828 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1fc37fe1-39f6-455a-aff6-672caae7c7fe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:49.256285 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1fc37fe1-39f6-455a-aff6-672caae7c7fe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:49.257626 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1fc37fe1-39f6-455a-aff6-672caae7c7fe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:49.258093 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1fc37fe1-39f6-455a-aff6-672caae7c7fe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:49.286827 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-1fc37fe1-39f6-455a-aff6-672caae7c7fe tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041865 Apr 08 11:26:49.287583 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 837/1662] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:49 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:49.353825 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1e4f35c1-2fc2-496b-912d-850cb8cbff48 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:49.354845 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1e4f35c1-2fc2-496b-912d-850cb8cbff48 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:49.361514 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1e4f35c1-2fc2-496b-912d-850cb8cbff48 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:49.362207 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1e4f35c1-2fc2-496b-912d-850cb8cbff48 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:49.363561 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1e4f35c1-2fc2-496b-912d-850cb8cbff48 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:49.364327 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1e4f35c1-2fc2-496b-912d-850cb8cbff48 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:49.435840 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1e4f35c1-2fc2-496b-912d-850cb8cbff48 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:49.443127 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1e4f35c1-2fc2-496b-912d-850cb8cbff48 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.093414 Apr 08 11:26:49.443693 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 826/1663] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:49 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:50.117744 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-80246d68-0576-4f56-9a61-901d6616ca51 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:50.118385 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-80246d68-0576-4f56-9a61-901d6616ca51 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:50.124348 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-80246d68-0576-4f56-9a61-901d6616ca51 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:50.124808 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-80246d68-0576-4f56-9a61-901d6616ca51 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:50.125578 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-80246d68-0576-4f56-9a61-901d6616ca51 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:50.126049 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-80246d68-0576-4f56-9a61-901d6616ca51 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:50.258541 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-80246d68-0576-4f56-9a61-901d6616ca51 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:50.265705 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-80246d68-0576-4f56-9a61-901d6616ca51 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.152697 Apr 08 11:26:50.266330 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 838/1664] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:50 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:50.298635 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0a0bdc98-3b50-4f7f-83d1-8e087f718c5e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:50.299568 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0a0bdc98-3b50-4f7f-83d1-8e087f718c5e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:50.306216 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0a0bdc98-3b50-4f7f-83d1-8e087f718c5e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:50.306673 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0a0bdc98-3b50-4f7f-83d1-8e087f718c5e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:50.307447 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0a0bdc98-3b50-4f7f-83d1-8e087f718c5e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:50.307890 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0a0bdc98-3b50-4f7f-83d1-8e087f718c5e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:50.336805 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0a0bdc98-3b50-4f7f-83d1-8e087f718c5e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042062 Apr 08 11:26:50.337371 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 827/1665] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:50 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:50.459706 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-5c7916b7-94b6-45c3-93a0-e2f97cbb4de0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:50.460326 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-5c7916b7-94b6-45c3-93a0-e2f97cbb4de0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:50.466274 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5c7916b7-94b6-45c3-93a0-e2f97cbb4de0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:50.466731 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5c7916b7-94b6-45c3-93a0-e2f97cbb4de0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:50.467498 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5c7916b7-94b6-45c3-93a0-e2f97cbb4de0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:50.467992 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5c7916b7-94b6-45c3-93a0-e2f97cbb4de0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:50.526645 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-5c7916b7-94b6-45c3-93a0-e2f97cbb4de0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:50.533893 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-5c7916b7-94b6-45c3-93a0-e2f97cbb4de0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078068 Apr 08 11:26:50.534445 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 839/1666] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:50 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:51.282773 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ddf06f23-bcd4-4a7a-8583-1c96ddbd0ad2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:51.283393 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ddf06f23-bcd4-4a7a-8583-1c96ddbd0ad2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:51.289815 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ddf06f23-bcd4-4a7a-8583-1c96ddbd0ad2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:51.290275 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ddf06f23-bcd4-4a7a-8583-1c96ddbd0ad2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:51.291046 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ddf06f23-bcd4-4a7a-8583-1c96ddbd0ad2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:51.291488 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ddf06f23-bcd4-4a7a-8583-1c96ddbd0ad2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:51.349479 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-b7cc1633-e6b4-4d1f-b688-e0a96a8d5e15 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:51.350496 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-b7cc1633-e6b4-4d1f-b688-e0a96a8d5e15 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:51.356827 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b7cc1633-e6b4-4d1f-b688-e0a96a8d5e15 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:51.357422 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b7cc1633-e6b4-4d1f-b688-e0a96a8d5e15 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:51.358095 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b7cc1633-e6b4-4d1f-b688-e0a96a8d5e15 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:51.358535 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b7cc1633-e6b4-4d1f-b688-e0a96a8d5e15 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:51.394469 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-b7cc1633-e6b4-4d1f-b688-e0a96a8d5e15 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049857 Apr 08 11:26:51.395062 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 840/1667] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:51 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:26:51.454420 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ddf06f23-bcd4-4a7a-8583-1c96ddbd0ad2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:51.464206 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ddf06f23-bcd4-4a7a-8583-1c96ddbd0ad2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.185245 Apr 08 11:26:51.464790 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 828/1668] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:51 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:51.552677 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-7368aa19-7706-4336-807d-50b5ff3191fa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:51.554113 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-7368aa19-7706-4336-807d-50b5ff3191fa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:51.560208 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7368aa19-7706-4336-807d-50b5ff3191fa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:51.560666 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7368aa19-7706-4336-807d-50b5ff3191fa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:51.561529 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7368aa19-7706-4336-807d-50b5ff3191fa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:51.562015 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7368aa19-7706-4336-807d-50b5ff3191fa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:51.625427 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-7368aa19-7706-4336-807d-50b5ff3191fa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:51.633610 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-7368aa19-7706-4336-807d-50b5ff3191fa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.086428 Apr 08 11:26:51.634225 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 841/1669] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:51 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:52.406413 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-dd36ec2c-19ac-4123-b064-88d3a2b4facf tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:52.407368 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-dd36ec2c-19ac-4123-b064-88d3a2b4facf tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:52.414314 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dd36ec2c-19ac-4123-b064-88d3a2b4facf tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:52.414726 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dd36ec2c-19ac-4123-b064-88d3a2b4facf tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:52.415510 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dd36ec2c-19ac-4123-b064-88d3a2b4facf tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:52.415952 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dd36ec2c-19ac-4123-b064-88d3a2b4facf tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:52.444605 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-dd36ec2c-19ac-4123-b064-88d3a2b4facf tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042050 Apr 08 11:26:52.445173 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 829/1670] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:52 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:52.482856 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-dee2105d-1d23-41d4-8531-698e6b565bde tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:52.483479 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-dee2105d-1d23-41d4-8531-698e6b565bde tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:52.489794 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dee2105d-1d23-41d4-8531-698e6b565bde tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:52.490262 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dee2105d-1d23-41d4-8531-698e6b565bde tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:52.491847 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dee2105d-1d23-41d4-8531-698e6b565bde tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:52.492330 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dee2105d-1d23-41d4-8531-698e6b565bde tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:52.630357 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-dee2105d-1d23-41d4-8531-698e6b565bde tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:52.637878 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-dee2105d-1d23-41d4-8531-698e6b565bde tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.158806 Apr 08 11:26:52.647408 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 842/1671] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:52 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:52.653383 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8febf8f2-74fb-430c-a606-30965c171d7c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:52.654138 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8febf8f2-74fb-430c-a606-30965c171d7c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:52.660408 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8febf8f2-74fb-430c-a606-30965c171d7c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:52.660890 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8febf8f2-74fb-430c-a606-30965c171d7c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:52.661682 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8febf8f2-74fb-430c-a606-30965c171d7c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:52.662188 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8febf8f2-74fb-430c-a606-30965c171d7c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:52.724089 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8febf8f2-74fb-430c-a606-30965c171d7c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:52.733165 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8febf8f2-74fb-430c-a606-30965c171d7c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.086604 Apr 08 11:26:52.734008 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 830/1672] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:52 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:53.455912 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e073f422-9aae-4e10-aa02-bfb271a203e0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:53.456767 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e073f422-9aae-4e10-aa02-bfb271a203e0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:53.463168 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e073f422-9aae-4e10-aa02-bfb271a203e0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:53.463621 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e073f422-9aae-4e10-aa02-bfb271a203e0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:53.464374 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e073f422-9aae-4e10-aa02-bfb271a203e0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:53.464810 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e073f422-9aae-4e10-aa02-bfb271a203e0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:53.493081 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e073f422-9aae-4e10-aa02-bfb271a203e0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041206 Apr 08 11:26:53.493640 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 843/1673] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:53 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:53.654551 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b6aa76b1-ca1a-4b0a-b981-96ecbe3069e3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:53.655161 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b6aa76b1-ca1a-4b0a-b981-96ecbe3069e3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:53.661555 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b6aa76b1-ca1a-4b0a-b981-96ecbe3069e3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:53.662020 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b6aa76b1-ca1a-4b0a-b981-96ecbe3069e3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:53.662790 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b6aa76b1-ca1a-4b0a-b981-96ecbe3069e3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:53.663222 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b6aa76b1-ca1a-4b0a-b981-96ecbe3069e3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:53.754687 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-97fc87a8-3ce2-45a9-a2bc-1fae25687f45 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:53.755404 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-97fc87a8-3ce2-45a9-a2bc-1fae25687f45 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:53.762210 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-97fc87a8-3ce2-45a9-a2bc-1fae25687f45 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:53.762750 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-97fc87a8-3ce2-45a9-a2bc-1fae25687f45 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:53.763636 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-97fc87a8-3ce2-45a9-a2bc-1fae25687f45 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:53.764058 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-97fc87a8-3ce2-45a9-a2bc-1fae25687f45 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:53.835045 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-97fc87a8-3ce2-45a9-a2bc-1fae25687f45 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:53.839116 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b6aa76b1-ca1a-4b0a-b981-96ecbe3069e3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:53.842442 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-97fc87a8-3ce2-45a9-a2bc-1fae25687f45 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.091892 Apr 08 11:26:53.843033 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 844/1674] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:53 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:53.846745 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b6aa76b1-ca1a-4b0a-b981-96ecbe3069e3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.195965 Apr 08 11:26:53.847317 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 831/1675] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:53 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:54.504943 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-06f1c0cc-f787-4bf8-8123-3e238e2dd446 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:54.505903 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-06f1c0cc-f787-4bf8-8123-3e238e2dd446 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:54.512913 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-06f1c0cc-f787-4bf8-8123-3e238e2dd446 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:54.513368 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-06f1c0cc-f787-4bf8-8123-3e238e2dd446 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:54.514167 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-06f1c0cc-f787-4bf8-8123-3e238e2dd446 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:54.514612 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-06f1c0cc-f787-4bf8-8123-3e238e2dd446 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:54.542861 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-06f1c0cc-f787-4bf8-8123-3e238e2dd446 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041962 Apr 08 11:26:54.543429 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 845/1676] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:54 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:54.859037 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a9b182a1-98bc-40bf-a424-a01ea0c6c44c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:54.859661 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a9b182a1-98bc-40bf-a424-a01ea0c6c44c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:54.863483 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-dfa16d62-f9f8-4a0d-943f-5047e366eb8f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:54.864102 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-dfa16d62-f9f8-4a0d-943f-5047e366eb8f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:54.866949 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a9b182a1-98bc-40bf-a424-a01ea0c6c44c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:54.867406 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a9b182a1-98bc-40bf-a424-a01ea0c6c44c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:54.868192 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a9b182a1-98bc-40bf-a424-a01ea0c6c44c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:54.868633 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a9b182a1-98bc-40bf-a424-a01ea0c6c44c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:54.871022 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dfa16d62-f9f8-4a0d-943f-5047e366eb8f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:54.871539 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dfa16d62-f9f8-4a0d-943f-5047e366eb8f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:54.872382 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dfa16d62-f9f8-4a0d-943f-5047e366eb8f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:54.872890 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dfa16d62-f9f8-4a0d-943f-5047e366eb8f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:54.936564 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a9b182a1-98bc-40bf-a424-a01ea0c6c44c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:54.944008 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a9b182a1-98bc-40bf-a424-a01ea0c6c44c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.088840 Apr 08 11:26:54.944583 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 832/1677] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:54 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:55.029381 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-dfa16d62-f9f8-4a0d-943f-5047e366eb8f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:55.036736 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-dfa16d62-f9f8-4a0d-943f-5047e366eb8f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.177030 Apr 08 11:26:55.037304 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 846/1678] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:54 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:26:55.556279 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bb38c1eb-4f32-461c-a239-1af2cbf93be9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:55.557204 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-bb38c1eb-4f32-461c-a239-1af2cbf93be9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:55.563049 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bb38c1eb-4f32-461c-a239-1af2cbf93be9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:55.563498 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bb38c1eb-4f32-461c-a239-1af2cbf93be9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:55.564301 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bb38c1eb-4f32-461c-a239-1af2cbf93be9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:55.564735 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bb38c1eb-4f32-461c-a239-1af2cbf93be9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:55.592817 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-bb38c1eb-4f32-461c-a239-1af2cbf93be9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042066 Apr 08 11:26:55.593380 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 833/1679] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:55 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:55.961726 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-89d33994-e7ae-4c4f-a8a4-7c8d074318be tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:55.962325 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-89d33994-e7ae-4c4f-a8a4-7c8d074318be tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:55.968676 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-89d33994-e7ae-4c4f-a8a4-7c8d074318be tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:55.969135 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-89d33994-e7ae-4c4f-a8a4-7c8d074318be tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:55.969951 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-89d33994-e7ae-4c4f-a8a4-7c8d074318be tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:55.970397 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-89d33994-e7ae-4c4f-a8a4-7c8d074318be tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:56.029502 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-89d33994-e7ae-4c4f-a8a4-7c8d074318be tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:56.036917 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-89d33994-e7ae-4c4f-a8a4-7c8d074318be tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079707 Apr 08 11:26:56.037493 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 847/1680] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:55 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:56.053699 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-667e55e6-141b-42a4-90b4-0cf45651b800 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:56.054464 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-667e55e6-141b-42a4-90b4-0cf45651b800 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:56.060743 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-667e55e6-141b-42a4-90b4-0cf45651b800 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:56.061191 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-667e55e6-141b-42a4-90b4-0cf45651b800 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:56.061997 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-667e55e6-141b-42a4-90b4-0cf45651b800 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:56.062437 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-667e55e6-141b-42a4-90b4-0cf45651b800 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:56.192506 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-667e55e6-141b-42a4-90b4-0cf45651b800 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:56.200440 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-667e55e6-141b-42a4-90b4-0cf45651b800 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.150580 Apr 08 11:26:56.201011 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 834/1681] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:56 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:56.604585 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-2689edd6-856a-4f24-bd71-1513ce4eb27d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:56.605520 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-2689edd6-856a-4f24-bd71-1513ce4eb27d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:56.611488 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2689edd6-856a-4f24-bd71-1513ce4eb27d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:56.611940 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2689edd6-856a-4f24-bd71-1513ce4eb27d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:56.612713 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2689edd6-856a-4f24-bd71-1513ce4eb27d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:56.613159 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-2689edd6-856a-4f24-bd71-1513ce4eb27d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:56.642489 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-2689edd6-856a-4f24-bd71-1513ce4eb27d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041883 Apr 08 11:26:56.643067 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 848/1682] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:56 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:57.054638 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9b57f411-9312-4b0a-ae55-457881887e73 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:57.055247 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9b57f411-9312-4b0a-ae55-457881887e73 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:57.061155 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9b57f411-9312-4b0a-ae55-457881887e73 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:57.061601 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9b57f411-9312-4b0a-ae55-457881887e73 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:57.062398 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9b57f411-9312-4b0a-ae55-457881887e73 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:57.062836 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9b57f411-9312-4b0a-ae55-457881887e73 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:57.124331 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9b57f411-9312-4b0a-ae55-457881887e73 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:57.131691 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9b57f411-9312-4b0a-ae55-457881887e73 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081538 Apr 08 11:26:57.132253 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 835/1683] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:57 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:57.218019 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-61302bb0-d53f-4d32-a9fa-c5285e218446 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:57.218640 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-61302bb0-d53f-4d32-a9fa-c5285e218446 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:57.225937 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-61302bb0-d53f-4d32-a9fa-c5285e218446 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:57.226400 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-61302bb0-d53f-4d32-a9fa-c5285e218446 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:57.227175 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-61302bb0-d53f-4d32-a9fa-c5285e218446 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:57.227619 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-61302bb0-d53f-4d32-a9fa-c5285e218446 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:57.363640 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-61302bb0-d53f-4d32-a9fa-c5285e218446 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:57.371307 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-61302bb0-d53f-4d32-a9fa-c5285e218446 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.157184 Apr 08 11:26:57.371880 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 849/1684] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:57 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:26:57.654872 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-618f1104-7f5c-43de-a01d-4d5302b256de tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:57.655792 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-618f1104-7f5c-43de-a01d-4d5302b256de tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:57.662303 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-618f1104-7f5c-43de-a01d-4d5302b256de tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:57.662750 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-618f1104-7f5c-43de-a01d-4d5302b256de tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:57.663601 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-618f1104-7f5c-43de-a01d-4d5302b256de tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:57.664034 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-618f1104-7f5c-43de-a01d-4d5302b256de tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:57.693409 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-618f1104-7f5c-43de-a01d-4d5302b256de tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042629 Apr 08 11:26:57.694612 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 836/1685] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:57 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:58.148839 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-27448444-0ec6-490f-b276-5daf12f968cd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:58.149454 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-27448444-0ec6-490f-b276-5daf12f968cd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:58.155468 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-27448444-0ec6-490f-b276-5daf12f968cd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:58.155971 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-27448444-0ec6-490f-b276-5daf12f968cd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:58.156797 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-27448444-0ec6-490f-b276-5daf12f968cd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:58.157308 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-27448444-0ec6-490f-b276-5daf12f968cd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:58.216935 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-27448444-0ec6-490f-b276-5daf12f968cd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:58.224783 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-27448444-0ec6-490f-b276-5daf12f968cd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080391 Apr 08 11:26:58.225390 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 850/1686] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:58 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:58.389824 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-41a8534d-9190-45b2-a430-49c9b0623829 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:58.390483 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-41a8534d-9190-45b2-a430-49c9b0623829 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:58.396423 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-41a8534d-9190-45b2-a430-49c9b0623829 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:58.396945 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-41a8534d-9190-45b2-a430-49c9b0623829 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:58.397728 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-41a8534d-9190-45b2-a430-49c9b0623829 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:58.398195 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-41a8534d-9190-45b2-a430-49c9b0623829 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:58.533917 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-41a8534d-9190-45b2-a430-49c9b0623829 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:58.541824 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-41a8534d-9190-45b2-a430-49c9b0623829 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.156261 Apr 08 11:26:58.542402 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 837/1687] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:58 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:58.706014 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-4f2157ba-01ad-441c-aabf-48e916957ff7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:58.706970 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-4f2157ba-01ad-441c-aabf-48e916957ff7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:58.713537 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4f2157ba-01ad-441c-aabf-48e916957ff7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:58.714051 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4f2157ba-01ad-441c-aabf-48e916957ff7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:58.714857 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4f2157ba-01ad-441c-aabf-48e916957ff7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:58.715297 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4f2157ba-01ad-441c-aabf-48e916957ff7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:58.743447 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-4f2157ba-01ad-441c-aabf-48e916957ff7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041464 Apr 08 11:26:58.744005 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 851/1688] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:58 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:26:59.242616 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-97081924-929f-4bd9-a981-1056e687cf3a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:59.243225 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-97081924-929f-4bd9-a981-1056e687cf3a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:59.249603 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-97081924-929f-4bd9-a981-1056e687cf3a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:59.250088 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-97081924-929f-4bd9-a981-1056e687cf3a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:59.250873 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-97081924-929f-4bd9-a981-1056e687cf3a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:59.251320 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-97081924-929f-4bd9-a981-1056e687cf3a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:59.309981 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-97081924-929f-4bd9-a981-1056e687cf3a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:59.317333 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-97081924-929f-4bd9-a981-1056e687cf3a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079534 Apr 08 11:26:59.317933 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 838/1689] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:59 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:59.559031 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-d1122405-f93d-4970-b057-02e06a65a9e1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:59.559687 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-d1122405-f93d-4970-b057-02e06a65a9e1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:59.566040 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d1122405-f93d-4970-b057-02e06a65a9e1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:59.566493 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d1122405-f93d-4970-b057-02e06a65a9e1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:59.567267 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d1122405-f93d-4970-b057-02e06a65a9e1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:59.567711 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d1122405-f93d-4970-b057-02e06a65a9e1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:59.701357 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d1122405-f93d-4970-b057-02e06a65a9e1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:26:59.709044 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-d1122405-f93d-4970-b057-02e06a65a9e1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.153893 Apr 08 11:26:59.710231 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 852/1690] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:26:59 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:26:59.755220 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-fd94b5a4-ef7a-4c23-84c0-a12052b73263 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:26:59.756160 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-fd94b5a4-ef7a-4c23-84c0-a12052b73263 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:26:59.762188 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fd94b5a4-ef7a-4c23-84c0-a12052b73263 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:59.768964 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fd94b5a4-ef7a-4c23-84c0-a12052b73263 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:59.768964 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fd94b5a4-ef7a-4c23-84c0-a12052b73263 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:26:59.768964 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fd94b5a4-ef7a-4c23-84c0-a12052b73263 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:26:59.793655 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-fd94b5a4-ef7a-4c23-84c0-a12052b73263 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042477 Apr 08 11:26:59.794274 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 839/1691] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:26:59 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:00.334035 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-c183011b-b991-4b7f-b904-c0ca5ffa1bfc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:00.335145 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-c183011b-b991-4b7f-b904-c0ca5ffa1bfc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:00.341239 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c183011b-b991-4b7f-b904-c0ca5ffa1bfc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:00.341725 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c183011b-b991-4b7f-b904-c0ca5ffa1bfc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:00.342529 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c183011b-b991-4b7f-b904-c0ca5ffa1bfc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:00.343001 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c183011b-b991-4b7f-b904-c0ca5ffa1bfc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:00.403226 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-c183011b-b991-4b7f-b904-c0ca5ffa1bfc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:00.410872 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-c183011b-b991-4b7f-b904-c0ca5ffa1bfc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080698 Apr 08 11:27:00.411560 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 853/1692] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:00 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:00.726984 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f9c9b6af-1bf7-4818-9724-9ef1c45417a5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:00.727604 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f9c9b6af-1bf7-4818-9724-9ef1c45417a5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:00.734166 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f9c9b6af-1bf7-4818-9724-9ef1c45417a5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:00.734628 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f9c9b6af-1bf7-4818-9724-9ef1c45417a5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:00.735411 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f9c9b6af-1bf7-4818-9724-9ef1c45417a5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:00.735851 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f9c9b6af-1bf7-4818-9724-9ef1c45417a5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:00.808541 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-7fdabfd1-cee4-432c-8397-2f83cdb3c27d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:00.810752 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-7fdabfd1-cee4-432c-8397-2f83cdb3c27d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:00.823959 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7fdabfd1-cee4-432c-8397-2f83cdb3c27d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:00.824432 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7fdabfd1-cee4-432c-8397-2f83cdb3c27d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:00.825269 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7fdabfd1-cee4-432c-8397-2f83cdb3c27d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:00.825709 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7fdabfd1-cee4-432c-8397-2f83cdb3c27d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:00.857607 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-7fdabfd1-cee4-432c-8397-2f83cdb3c27d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055182 Apr 08 11:27:00.858222 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 854/1693] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:00 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:27:00.888447 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f9c9b6af-1bf7-4818-9724-9ef1c45417a5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:00.896372 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f9c9b6af-1bf7-4818-9724-9ef1c45417a5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.173265 Apr 08 11:27:00.896940 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 840/1694] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:00 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:01.429380 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-55d1759f-38e7-41e8-a730-516a7e118e25 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:01.430054 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-55d1759f-38e7-41e8-a730-516a7e118e25 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:01.436759 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-55d1759f-38e7-41e8-a730-516a7e118e25 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:01.437220 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-55d1759f-38e7-41e8-a730-516a7e118e25 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:01.438060 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-55d1759f-38e7-41e8-a730-516a7e118e25 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:01.438510 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-55d1759f-38e7-41e8-a730-516a7e118e25 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:01.506264 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-55d1759f-38e7-41e8-a730-516a7e118e25 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:01.516780 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-55d1759f-38e7-41e8-a730-516a7e118e25 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.092184 Apr 08 11:27:01.517402 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 855/1695] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:01 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:01.869904 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b085d13e-9ef7-4a17-b509-aed1965e2046 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:01.870893 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b085d13e-9ef7-4a17-b509-aed1965e2046 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:01.877398 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b085d13e-9ef7-4a17-b509-aed1965e2046 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:01.877892 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b085d13e-9ef7-4a17-b509-aed1965e2046 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:01.878692 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b085d13e-9ef7-4a17-b509-aed1965e2046 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:01.879137 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b085d13e-9ef7-4a17-b509-aed1965e2046 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:01.910936 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b085d13e-9ef7-4a17-b509-aed1965e2046 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045318 Apr 08 11:27:01.911851 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 841/1696] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:01 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:01.914898 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-1595f445-6434-4ff0-9780-9d763df1e490 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:01.915524 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-1595f445-6434-4ff0-9780-9d763df1e490 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:01.922062 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1595f445-6434-4ff0-9780-9d763df1e490 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:01.922521 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1595f445-6434-4ff0-9780-9d763df1e490 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:01.923309 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1595f445-6434-4ff0-9780-9d763df1e490 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:01.923753 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1595f445-6434-4ff0-9780-9d763df1e490 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:02.071793 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1595f445-6434-4ff0-9780-9d763df1e490 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:02.080764 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-1595f445-6434-4ff0-9780-9d763df1e490 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.170385 Apr 08 11:27:02.081345 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 856/1697] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:01 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:27:02.533125 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-adca16eb-793b-4f26-baa9-9839f51af3c8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:02.533730 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-adca16eb-793b-4f26-baa9-9839f51af3c8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:02.540147 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-adca16eb-793b-4f26-baa9-9839f51af3c8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:02.540593 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-adca16eb-793b-4f26-baa9-9839f51af3c8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:02.541384 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-adca16eb-793b-4f26-baa9-9839f51af3c8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:02.541841 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-adca16eb-793b-4f26-baa9-9839f51af3c8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:02.599483 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-adca16eb-793b-4f26-baa9-9839f51af3c8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:02.607608 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-adca16eb-793b-4f26-baa9-9839f51af3c8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078392 Apr 08 11:27:02.608174 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 842/1698] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:02 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:02.923384 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-0193deb8-be7f-4a57-9fcf-e23c7586f8be tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:02.924217 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-0193deb8-be7f-4a57-9fcf-e23c7586f8be tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:02.931303 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0193deb8-be7f-4a57-9fcf-e23c7586f8be tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:02.931749 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0193deb8-be7f-4a57-9fcf-e23c7586f8be tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:02.932528 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0193deb8-be7f-4a57-9fcf-e23c7586f8be tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:02.932968 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0193deb8-be7f-4a57-9fcf-e23c7586f8be tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:02.962625 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-0193deb8-be7f-4a57-9fcf-e23c7586f8be tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043201 Apr 08 11:27:02.963185 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 857/1699] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:02 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:03.098629 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-dcb88888-7c0d-424a-84c2-73e693b9d0d3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:03.099240 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-dcb88888-7c0d-424a-84c2-73e693b9d0d3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:03.105812 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dcb88888-7c0d-424a-84c2-73e693b9d0d3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:03.109417 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dcb88888-7c0d-424a-84c2-73e693b9d0d3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:03.109417 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dcb88888-7c0d-424a-84c2-73e693b9d0d3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:03.109417 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dcb88888-7c0d-424a-84c2-73e693b9d0d3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:03.252299 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-dcb88888-7c0d-424a-84c2-73e693b9d0d3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:03.259842 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-dcb88888-7c0d-424a-84c2-73e693b9d0d3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.165071 Apr 08 11:27:03.260414 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 843/1700] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:03 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:03.625891 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-6818d4f9-fe9d-4f28-9cda-2e9d355b4c76 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:03.626510 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-6818d4f9-fe9d-4f28-9cda-2e9d355b4c76 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:03.633120 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6818d4f9-fe9d-4f28-9cda-2e9d355b4c76 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:03.633596 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6818d4f9-fe9d-4f28-9cda-2e9d355b4c76 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:03.634439 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6818d4f9-fe9d-4f28-9cda-2e9d355b4c76 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:03.635217 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6818d4f9-fe9d-4f28-9cda-2e9d355b4c76 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:03.696992 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6818d4f9-fe9d-4f28-9cda-2e9d355b4c76 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:03.704402 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-6818d4f9-fe9d-4f28-9cda-2e9d355b4c76 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.083053 Apr 08 11:27:03.704973 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 858/1701] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:03 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:03.974727 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bd46324f-3c60-4e82-9fde-45825deed7e2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:03.975616 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-bd46324f-3c60-4e82-9fde-45825deed7e2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:03.981761 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bd46324f-3c60-4e82-9fde-45825deed7e2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:03.982242 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bd46324f-3c60-4e82-9fde-45825deed7e2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:03.983071 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bd46324f-3c60-4e82-9fde-45825deed7e2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:03.983526 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bd46324f-3c60-4e82-9fde-45825deed7e2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:04.012933 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-bd46324f-3c60-4e82-9fde-45825deed7e2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042324 Apr 08 11:27:04.013491 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 844/1702] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:03 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:04.276980 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-5214b7db-f0ec-4500-8b4e-20b54ad4a5e2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:04.277597 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-5214b7db-f0ec-4500-8b4e-20b54ad4a5e2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:04.283921 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5214b7db-f0ec-4500-8b4e-20b54ad4a5e2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:04.284375 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5214b7db-f0ec-4500-8b4e-20b54ad4a5e2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:04.285177 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5214b7db-f0ec-4500-8b4e-20b54ad4a5e2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:04.285617 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5214b7db-f0ec-4500-8b4e-20b54ad4a5e2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:04.426305 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-5214b7db-f0ec-4500-8b4e-20b54ad4a5e2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:04.433674 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-5214b7db-f0ec-4500-8b4e-20b54ad4a5e2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.160553 Apr 08 11:27:04.434272 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 859/1703] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:04 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:04.721670 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d158e9d7-9fcf-413c-a405-37a66078361b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:04.722326 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d158e9d7-9fcf-413c-a405-37a66078361b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:04.729227 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d158e9d7-9fcf-413c-a405-37a66078361b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:04.729682 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d158e9d7-9fcf-413c-a405-37a66078361b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:04.730496 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d158e9d7-9fcf-413c-a405-37a66078361b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:04.730934 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d158e9d7-9fcf-413c-a405-37a66078361b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:04.790273 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d158e9d7-9fcf-413c-a405-37a66078361b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:04.797917 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d158e9d7-9fcf-413c-a405-37a66078361b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080159 Apr 08 11:27:04.798484 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 845/1704] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:04 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:05.025848 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-50df1a91-f1c9-42c5-b6d0-d3f3b4f813d0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:05.026772 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-50df1a91-f1c9-42c5-b6d0-d3f3b4f813d0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:05.032627 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-50df1a91-f1c9-42c5-b6d0-d3f3b4f813d0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:05.033073 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-50df1a91-f1c9-42c5-b6d0-d3f3b4f813d0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:05.033865 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-50df1a91-f1c9-42c5-b6d0-d3f3b4f813d0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:05.034298 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-50df1a91-f1c9-42c5-b6d0-d3f3b4f813d0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:05.061434 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-50df1a91-f1c9-42c5-b6d0-d3f3b4f813d0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040169 Apr 08 11:27:05.062016 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 860/1705] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:05 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:05.450893 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e9057ae8-d8b7-4b15-b9b4-d533848fb881 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:05.451415 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e9057ae8-d8b7-4b15-b9b4-d533848fb881 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:05.457733 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e9057ae8-d8b7-4b15-b9b4-d533848fb881 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:05.458211 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e9057ae8-d8b7-4b15-b9b4-d533848fb881 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:05.459081 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e9057ae8-d8b7-4b15-b9b4-d533848fb881 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:05.459520 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e9057ae8-d8b7-4b15-b9b4-d533848fb881 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:05.610824 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e9057ae8-d8b7-4b15-b9b4-d533848fb881 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:05.618696 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e9057ae8-d8b7-4b15-b9b4-d533848fb881 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.171700 Apr 08 11:27:05.619275 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 846/1706] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:05 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:05.814851 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-c6ea9a7f-5245-41f5-873f-4a8a810f6d3c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:05.815479 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-c6ea9a7f-5245-41f5-873f-4a8a810f6d3c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:05.822574 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c6ea9a7f-5245-41f5-873f-4a8a810f6d3c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:05.823031 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c6ea9a7f-5245-41f5-873f-4a8a810f6d3c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:05.823827 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c6ea9a7f-5245-41f5-873f-4a8a810f6d3c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:05.824266 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c6ea9a7f-5245-41f5-873f-4a8a810f6d3c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:05.892999 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-c6ea9a7f-5245-41f5-873f-4a8a810f6d3c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:05.901325 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-c6ea9a7f-5245-41f5-873f-4a8a810f6d3c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.090465 Apr 08 11:27:05.901938 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 861/1707] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:05 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:06.073440 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bbdf59c2-9114-4c83-a790-ae137dac4681 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:06.074316 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-bbdf59c2-9114-4c83-a790-ae137dac4681 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:06.081021 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bbdf59c2-9114-4c83-a790-ae137dac4681 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:06.081472 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bbdf59c2-9114-4c83-a790-ae137dac4681 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:06.082292 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bbdf59c2-9114-4c83-a790-ae137dac4681 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:06.082766 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bbdf59c2-9114-4c83-a790-ae137dac4681 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:06.112097 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-bbdf59c2-9114-4c83-a790-ae137dac4681 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043258 Apr 08 11:27:06.112656 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 847/1708] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:06 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:06.636061 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-72a82d28-57ac-41f6-a111-e9964259b927 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:06.636680 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-72a82d28-57ac-41f6-a111-e9964259b927 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:06.643014 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-72a82d28-57ac-41f6-a111-e9964259b927 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:06.643477 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-72a82d28-57ac-41f6-a111-e9964259b927 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:06.644270 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-72a82d28-57ac-41f6-a111-e9964259b927 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:06.644714 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-72a82d28-57ac-41f6-a111-e9964259b927 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:06.786120 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-72a82d28-57ac-41f6-a111-e9964259b927 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:06.794357 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-72a82d28-57ac-41f6-a111-e9964259b927 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.162150 Apr 08 11:27:06.794941 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 862/1709] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:06 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:06.918918 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f4c3b0e0-9f0b-41ae-be9f-b7c88fc11214 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:06.919454 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f4c3b0e0-9f0b-41ae-be9f-b7c88fc11214 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:06.925445 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f4c3b0e0-9f0b-41ae-be9f-b7c88fc11214 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:06.925943 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f4c3b0e0-9f0b-41ae-be9f-b7c88fc11214 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:06.926734 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f4c3b0e0-9f0b-41ae-be9f-b7c88fc11214 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:06.927176 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f4c3b0e0-9f0b-41ae-be9f-b7c88fc11214 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:06.994417 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f4c3b0e0-9f0b-41ae-be9f-b7c88fc11214 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:07.002191 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f4c3b0e0-9f0b-41ae-be9f-b7c88fc11214 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.087319 Apr 08 11:27:07.002780 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 848/1710] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:06 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:07.124503 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-d0221da4-108f-490c-8cdb-7c099448d9c8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:07.125429 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-d0221da4-108f-490c-8cdb-7c099448d9c8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:07.132411 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d0221da4-108f-490c-8cdb-7c099448d9c8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:07.132857 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d0221da4-108f-490c-8cdb-7c099448d9c8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:07.133640 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d0221da4-108f-490c-8cdb-7c099448d9c8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:07.134106 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d0221da4-108f-490c-8cdb-7c099448d9c8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:07.164373 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-d0221da4-108f-490c-8cdb-7c099448d9c8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043805 Apr 08 11:27:07.164956 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 863/1711] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:07 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:07.812053 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ee92d770-e445-49db-9760-a9c97d09a19e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:07.813319 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ee92d770-e445-49db-9760-a9c97d09a19e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:07.819729 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ee92d770-e445-49db-9760-a9c97d09a19e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:07.820306 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ee92d770-e445-49db-9760-a9c97d09a19e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:07.821152 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ee92d770-e445-49db-9760-a9c97d09a19e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:07.821645 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ee92d770-e445-49db-9760-a9c97d09a19e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:07.963131 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ee92d770-e445-49db-9760-a9c97d09a19e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:07.970761 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ee92d770-e445-49db-9760-a9c97d09a19e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.162614 Apr 08 11:27:07.971371 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 849/1712] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:07 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:08.018893 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-619e4aa3-170b-48dc-be48-dc63a9168a67 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:08.019515 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-619e4aa3-170b-48dc-be48-dc63a9168a67 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:08.025847 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-619e4aa3-170b-48dc-be48-dc63a9168a67 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:08.026314 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-619e4aa3-170b-48dc-be48-dc63a9168a67 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:08.027108 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-619e4aa3-170b-48dc-be48-dc63a9168a67 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:08.027566 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-619e4aa3-170b-48dc-be48-dc63a9168a67 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:08.089422 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-619e4aa3-170b-48dc-be48-dc63a9168a67 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:08.097077 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-619e4aa3-170b-48dc-be48-dc63a9168a67 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082060 Apr 08 11:27:08.097663 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 864/1713] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:08 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:08.176450 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-fa56590e-e212-4130-bbde-389e4cd1dea9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:08.177297 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-fa56590e-e212-4130-bbde-389e4cd1dea9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:08.183539 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fa56590e-e212-4130-bbde-389e4cd1dea9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:08.183979 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fa56590e-e212-4130-bbde-389e4cd1dea9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:08.184758 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fa56590e-e212-4130-bbde-389e4cd1dea9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:08.185190 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fa56590e-e212-4130-bbde-389e4cd1dea9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:08.218322 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-fa56590e-e212-4130-bbde-389e4cd1dea9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045905 Apr 08 11:27:08.218902 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 850/1714] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:08 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:08.988623 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-5d7ddbad-44cc-4199-b352-21f9e2365f39 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:08.989180 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-5d7ddbad-44cc-4199-b352-21f9e2365f39 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:08.996594 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5d7ddbad-44cc-4199-b352-21f9e2365f39 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:08.997050 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5d7ddbad-44cc-4199-b352-21f9e2365f39 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:08.997876 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5d7ddbad-44cc-4199-b352-21f9e2365f39 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:08.998334 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5d7ddbad-44cc-4199-b352-21f9e2365f39 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:09.114315 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f9080a84-f9c8-4da0-aa1b-c7d76df47f9d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:09.114940 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f9080a84-f9c8-4da0-aa1b-c7d76df47f9d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:09.122024 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f9080a84-f9c8-4da0-aa1b-c7d76df47f9d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:09.122481 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f9080a84-f9c8-4da0-aa1b-c7d76df47f9d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:09.123272 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f9080a84-f9c8-4da0-aa1b-c7d76df47f9d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:09.123710 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f9080a84-f9c8-4da0-aa1b-c7d76df47f9d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:09.141044 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-5d7ddbad-44cc-4199-b352-21f9e2365f39 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:09.148912 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-5d7ddbad-44cc-4199-b352-21f9e2365f39 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.164383 Apr 08 11:27:09.149485 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 865/1715] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:08 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:27:09.191105 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f9080a84-f9c8-4da0-aa1b-c7d76df47f9d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:09.198726 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f9080a84-f9c8-4da0-aa1b-c7d76df47f9d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.088290 Apr 08 11:27:09.199310 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 851/1716] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:09 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:27:09.232184 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a6ec2472-8b0c-435e-8303-11900161bc5c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:09.233192 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a6ec2472-8b0c-435e-8303-11900161bc5c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:09.239777 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a6ec2472-8b0c-435e-8303-11900161bc5c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:09.240154 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a6ec2472-8b0c-435e-8303-11900161bc5c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:09.240945 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a6ec2472-8b0c-435e-8303-11900161bc5c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:09.241387 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a6ec2472-8b0c-435e-8303-11900161bc5c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:09.270335 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a6ec2472-8b0c-435e-8303-11900161bc5c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043046 Apr 08 11:27:09.270902 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 866/1717] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:09 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:10.166406 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a40cf5f6-4729-48ab-88e6-dc33ff86df61 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:10.167034 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a40cf5f6-4729-48ab-88e6-dc33ff86df61 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:10.173391 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a40cf5f6-4729-48ab-88e6-dc33ff86df61 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:10.173909 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a40cf5f6-4729-48ab-88e6-dc33ff86df61 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:10.174692 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a40cf5f6-4729-48ab-88e6-dc33ff86df61 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:10.175139 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a40cf5f6-4729-48ab-88e6-dc33ff86df61 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:10.215514 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-f85b8510-ed9e-4561-a7e3-600dd0b75964 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:10.216167 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-f85b8510-ed9e-4561-a7e3-600dd0b75964 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:10.222671 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f85b8510-ed9e-4561-a7e3-600dd0b75964 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:10.223123 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f85b8510-ed9e-4561-a7e3-600dd0b75964 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:10.223908 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f85b8510-ed9e-4561-a7e3-600dd0b75964 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:10.224846 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f85b8510-ed9e-4561-a7e3-600dd0b75964 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:10.293247 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f85b8510-ed9e-4561-a7e3-600dd0b75964 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:10.301377 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-f85b8510-ed9e-4561-a7e3-600dd0b75964 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.089626 Apr 08 11:27:10.301984 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 867/1718] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:10 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:27:10.307262 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e00c4f8f-3d00-41ad-b1e9-3cddb5b82fe7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:10.308152 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e00c4f8f-3d00-41ad-b1e9-3cddb5b82fe7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:10.316962 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e00c4f8f-3d00-41ad-b1e9-3cddb5b82fe7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:10.317417 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e00c4f8f-3d00-41ad-b1e9-3cddb5b82fe7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:10.318288 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e00c4f8f-3d00-41ad-b1e9-3cddb5b82fe7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:10.318732 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e00c4f8f-3d00-41ad-b1e9-3cddb5b82fe7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:10.332844 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a40cf5f6-4729-48ab-88e6-dc33ff86df61 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:10.340418 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a40cf5f6-4729-48ab-88e6-dc33ff86df61 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.178385 Apr 08 11:27:10.341018 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 852/1719] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:10 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:10.348803 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e00c4f8f-3d00-41ad-b1e9-3cddb5b82fe7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045709 Apr 08 11:27:10.349934 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 868/1720] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:10 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:11.318805 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-aa5265fc-05ff-4a6a-9212-348d0efa603e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:11.319453 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-aa5265fc-05ff-4a6a-9212-348d0efa603e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:11.326088 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aa5265fc-05ff-4a6a-9212-348d0efa603e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:11.326546 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aa5265fc-05ff-4a6a-9212-348d0efa603e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:11.327342 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aa5265fc-05ff-4a6a-9212-348d0efa603e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:11.327788 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aa5265fc-05ff-4a6a-9212-348d0efa603e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:11.360626 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-18774f69-68e9-4ce9-bfe0-d3a15f66ea7e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:11.362042 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-18774f69-68e9-4ce9-bfe0-d3a15f66ea7e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:11.368175 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-18774f69-68e9-4ce9-bfe0-d3a15f66ea7e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:11.368749 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-18774f69-68e9-4ce9-bfe0-d3a15f66ea7e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:11.369608 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-18774f69-68e9-4ce9-bfe0-d3a15f66ea7e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:11.370153 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-18774f69-68e9-4ce9-bfe0-d3a15f66ea7e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:11.388792 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-aa5265fc-05ff-4a6a-9212-348d0efa603e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:11.397582 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-aa5265fc-05ff-4a6a-9212-348d0efa603e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082594 Apr 08 11:27:11.398536 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 853/1721] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:11 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:11.403302 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d1449ce0-f3f8-4817-bf74-0d99b1d64aef tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:11.404229 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d1449ce0-f3f8-4817-bf74-0d99b1d64aef tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:11.410592 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d1449ce0-f3f8-4817-bf74-0d99b1d64aef tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:11.411046 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d1449ce0-f3f8-4817-bf74-0d99b1d64aef tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:11.411823 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d1449ce0-f3f8-4817-bf74-0d99b1d64aef tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:11.412906 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d1449ce0-f3f8-4817-bf74-0d99b1d64aef tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:11.442881 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d1449ce0-f3f8-4817-bf74-0d99b1d64aef tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043452 Apr 08 11:27:11.443475 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 854/1722] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:11 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:11.519221 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-18774f69-68e9-4ce9-bfe0-d3a15f66ea7e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:11.527410 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-18774f69-68e9-4ce9-bfe0-d3a15f66ea7e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.170650 Apr 08 11:27:11.527993 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 869/1723] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:11 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:12.421428 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4feeaf37-939d-4518-b69d-0bb2256af90f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:12.422218 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4feeaf37-939d-4518-b69d-0bb2256af90f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:12.429165 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4feeaf37-939d-4518-b69d-0bb2256af90f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:12.429619 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4feeaf37-939d-4518-b69d-0bb2256af90f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:12.430449 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4feeaf37-939d-4518-b69d-0bb2256af90f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:12.430881 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4feeaf37-939d-4518-b69d-0bb2256af90f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:12.454815 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-ca3330b7-7d6a-4f35-b8e2-ef7f92e7f207 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:12.455754 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-ca3330b7-7d6a-4f35-b8e2-ef7f92e7f207 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:12.462667 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ca3330b7-7d6a-4f35-b8e2-ef7f92e7f207 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:12.463122 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ca3330b7-7d6a-4f35-b8e2-ef7f92e7f207 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:12.463910 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ca3330b7-7d6a-4f35-b8e2-ef7f92e7f207 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:12.464354 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ca3330b7-7d6a-4f35-b8e2-ef7f92e7f207 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:12.492604 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4feeaf37-939d-4518-b69d-0bb2256af90f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:12.495945 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-ca3330b7-7d6a-4f35-b8e2-ef7f92e7f207 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045147 Apr 08 11:27:12.496528 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 870/1724] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:12 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:27:12.499858 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4feeaf37-939d-4518-b69d-0bb2256af90f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082267 Apr 08 11:27:12.500422 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 855/1725] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:12 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:12.544525 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-c9d51fc1-80bd-40f3-bd35-fb6f619c759a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:12.545145 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-c9d51fc1-80bd-40f3-bd35-fb6f619c759a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:12.551344 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c9d51fc1-80bd-40f3-bd35-fb6f619c759a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:12.551798 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c9d51fc1-80bd-40f3-bd35-fb6f619c759a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:12.553155 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c9d51fc1-80bd-40f3-bd35-fb6f619c759a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:12.553596 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c9d51fc1-80bd-40f3-bd35-fb6f619c759a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:12.693648 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-c9d51fc1-80bd-40f3-bd35-fb6f619c759a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:12.701439 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-c9d51fc1-80bd-40f3-bd35-fb6f619c759a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.160972 Apr 08 11:27:12.702042 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 871/1726] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:12 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:13.509668 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ab287282-a52a-4e1a-b250-fa167238dbcb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:13.510911 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ab287282-a52a-4e1a-b250-fa167238dbcb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:13.517583 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-03d15b99-2b3b-407b-b61c-8856ac1fa2b9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:13.518247 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-03d15b99-2b3b-407b-b61c-8856ac1fa2b9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:13.518383 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ab287282-a52a-4e1a-b250-fa167238dbcb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:13.518810 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ab287282-a52a-4e1a-b250-fa167238dbcb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:13.519668 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ab287282-a52a-4e1a-b250-fa167238dbcb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:13.520198 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ab287282-a52a-4e1a-b250-fa167238dbcb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:13.524868 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-03d15b99-2b3b-407b-b61c-8856ac1fa2b9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:13.525317 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-03d15b99-2b3b-407b-b61c-8856ac1fa2b9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:13.526126 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-03d15b99-2b3b-407b-b61c-8856ac1fa2b9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:13.526565 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-03d15b99-2b3b-407b-b61c-8856ac1fa2b9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:13.551371 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ab287282-a52a-4e1a-b250-fa167238dbcb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047485 Apr 08 11:27:13.551946 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 856/1727] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:13 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:13.591197 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-03d15b99-2b3b-407b-b61c-8856ac1fa2b9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:13.598998 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-03d15b99-2b3b-407b-b61c-8856ac1fa2b9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.085333 Apr 08 11:27:13.599585 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 872/1728] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:13 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:27:13.718183 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-97c63afd-b160-4f6b-b97e-8c09ed7bbe9c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:13.718826 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-97c63afd-b160-4f6b-b97e-8c09ed7bbe9c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:13.724962 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-97c63afd-b160-4f6b-b97e-8c09ed7bbe9c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:13.725425 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-97c63afd-b160-4f6b-b97e-8c09ed7bbe9c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:13.726225 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-97c63afd-b160-4f6b-b97e-8c09ed7bbe9c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:13.726657 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-97c63afd-b160-4f6b-b97e-8c09ed7bbe9c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:13.862720 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-97c63afd-b160-4f6b-b97e-8c09ed7bbe9c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:13.870796 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-97c63afd-b160-4f6b-b97e-8c09ed7bbe9c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.156441 Apr 08 11:27:13.871382 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 857/1729] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:13 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:14.563593 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-934bfaa8-9872-497b-ad0c-6dacef612eec tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:14.564552 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-934bfaa8-9872-497b-ad0c-6dacef612eec tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:14.571663 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-934bfaa8-9872-497b-ad0c-6dacef612eec tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:14.572120 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-934bfaa8-9872-497b-ad0c-6dacef612eec tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:14.572921 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-934bfaa8-9872-497b-ad0c-6dacef612eec tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:14.573364 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-934bfaa8-9872-497b-ad0c-6dacef612eec tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:14.603395 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-934bfaa8-9872-497b-ad0c-6dacef612eec tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043720 Apr 08 11:27:14.603988 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 873/1730] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:14 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:14.615117 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1b1ba5d4-d9ef-4fc9-9db0-e3ace76ce42a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:14.615736 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1b1ba5d4-d9ef-4fc9-9db0-e3ace76ce42a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:14.622447 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1b1ba5d4-d9ef-4fc9-9db0-e3ace76ce42a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:14.622922 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1b1ba5d4-d9ef-4fc9-9db0-e3ace76ce42a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:14.623695 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1b1ba5d4-d9ef-4fc9-9db0-e3ace76ce42a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:14.624172 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1b1ba5d4-d9ef-4fc9-9db0-e3ace76ce42a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:14.686630 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1b1ba5d4-d9ef-4fc9-9db0-e3ace76ce42a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:14.694878 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1b1ba5d4-d9ef-4fc9-9db0-e3ace76ce42a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.083650 Apr 08 11:27:14.695468 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 858/1731] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:14 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:14.888341 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-36597c9c-8dcd-49d6-a571-8400dce9c73e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:14.888885 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-36597c9c-8dcd-49d6-a571-8400dce9c73e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:14.895459 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-36597c9c-8dcd-49d6-a571-8400dce9c73e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:14.895905 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-36597c9c-8dcd-49d6-a571-8400dce9c73e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:14.896761 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-36597c9c-8dcd-49d6-a571-8400dce9c73e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:14.897196 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-36597c9c-8dcd-49d6-a571-8400dce9c73e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:15.035362 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-36597c9c-8dcd-49d6-a571-8400dce9c73e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:15.042928 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-36597c9c-8dcd-49d6-a571-8400dce9c73e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.158606 Apr 08 11:27:15.043496 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 874/1732] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:14 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:15.616259 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1a2fb15a-c9eb-44b7-8163-977dd862c526 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:15.617464 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1a2fb15a-c9eb-44b7-8163-977dd862c526 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:15.624320 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1a2fb15a-c9eb-44b7-8163-977dd862c526 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:15.624781 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1a2fb15a-c9eb-44b7-8163-977dd862c526 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:15.625595 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1a2fb15a-c9eb-44b7-8163-977dd862c526 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:15.626072 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1a2fb15a-c9eb-44b7-8163-977dd862c526 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:15.659127 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1a2fb15a-c9eb-44b7-8163-977dd862c526 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047708 Apr 08 11:27:15.659852 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 859/1733] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:15 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:15.712077 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e3e39149-0d33-4359-b541-2866a147e43c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:15.712695 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e3e39149-0d33-4359-b541-2866a147e43c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:15.719493 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e3e39149-0d33-4359-b541-2866a147e43c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:15.719951 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e3e39149-0d33-4359-b541-2866a147e43c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:15.720742 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e3e39149-0d33-4359-b541-2866a147e43c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:15.721184 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e3e39149-0d33-4359-b541-2866a147e43c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:15.784728 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e3e39149-0d33-4359-b541-2866a147e43c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:15.793109 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e3e39149-0d33-4359-b541-2866a147e43c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.085587 Apr 08 11:27:15.793701 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 875/1734] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:15 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:16.059377 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6597035b-121b-4dec-b46a-4cd8853ec97b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:16.060002 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6597035b-121b-4dec-b46a-4cd8853ec97b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:16.066249 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6597035b-121b-4dec-b46a-4cd8853ec97b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:16.066719 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6597035b-121b-4dec-b46a-4cd8853ec97b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:16.067504 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6597035b-121b-4dec-b46a-4cd8853ec97b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:16.068491 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6597035b-121b-4dec-b46a-4cd8853ec97b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:16.207424 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6597035b-121b-4dec-b46a-4cd8853ec97b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:16.215948 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6597035b-121b-4dec-b46a-4cd8853ec97b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.160457 Apr 08 11:27:16.216629 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 860/1735] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:16 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:16.672238 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-67f4c263-f809-4905-822a-95b61bf5099e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:16.673191 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-67f4c263-f809-4905-822a-95b61bf5099e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:16.681891 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-67f4c263-f809-4905-822a-95b61bf5099e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:16.682690 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-67f4c263-f809-4905-822a-95b61bf5099e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:16.684085 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-67f4c263-f809-4905-822a-95b61bf5099e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:16.684850 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-67f4c263-f809-4905-822a-95b61bf5099e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:16.721006 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-67f4c263-f809-4905-822a-95b61bf5099e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052769 Apr 08 11:27:16.721819 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 876/1736] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:16 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:27:16.810079 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-96ac0d4c-a07c-40bc-ae03-c5a6e159f376 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:16.810725 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-96ac0d4c-a07c-40bc-ae03-c5a6e159f376 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:16.817272 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-96ac0d4c-a07c-40bc-ae03-c5a6e159f376 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:16.817725 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-96ac0d4c-a07c-40bc-ae03-c5a6e159f376 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:16.819031 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-96ac0d4c-a07c-40bc-ae03-c5a6e159f376 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:16.819464 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-96ac0d4c-a07c-40bc-ae03-c5a6e159f376 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:16.885977 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-96ac0d4c-a07c-40bc-ae03-c5a6e159f376 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:16.893871 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-96ac0d4c-a07c-40bc-ae03-c5a6e159f376 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.087642 Apr 08 11:27:16.894488 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 861/1737] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:16 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:17.234070 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-cdd225fb-2489-48cc-821a-b46c96a945ea tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:17.234696 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-cdd225fb-2489-48cc-821a-b46c96a945ea tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:17.242300 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cdd225fb-2489-48cc-821a-b46c96a945ea tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:17.242903 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cdd225fb-2489-48cc-821a-b46c96a945ea tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:17.243805 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cdd225fb-2489-48cc-821a-b46c96a945ea tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:17.244343 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cdd225fb-2489-48cc-821a-b46c96a945ea tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:17.399361 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-cdd225fb-2489-48cc-821a-b46c96a945ea tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:17.407774 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-cdd225fb-2489-48cc-821a-b46c96a945ea tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.177730 Apr 08 11:27:17.408393 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 877/1738] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:17 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:27:17.733701 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-63f84178-bd67-4f75-9413-2a661cfe4975 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:17.734739 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-63f84178-bd67-4f75-9413-2a661cfe4975 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:17.742036 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-63f84178-bd67-4f75-9413-2a661cfe4975 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:17.742494 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-63f84178-bd67-4f75-9413-2a661cfe4975 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:17.743318 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-63f84178-bd67-4f75-9413-2a661cfe4975 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:17.743762 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-63f84178-bd67-4f75-9413-2a661cfe4975 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:17.774598 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-63f84178-bd67-4f75-9413-2a661cfe4975 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044905 Apr 08 11:27:17.775183 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 862/1739] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:17 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:27:17.912721 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-df80d96b-e621-4f94-96a0-5349951801e3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:17.913517 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-df80d96b-e621-4f94-96a0-5349951801e3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:17.920271 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-df80d96b-e621-4f94-96a0-5349951801e3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:17.920729 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-df80d96b-e621-4f94-96a0-5349951801e3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:17.921537 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-df80d96b-e621-4f94-96a0-5349951801e3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:17.922015 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-df80d96b-e621-4f94-96a0-5349951801e3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:17.985628 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-df80d96b-e621-4f94-96a0-5349951801e3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:17.994217 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-df80d96b-e621-4f94-96a0-5349951801e3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.085789 Apr 08 11:27:17.994891 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 878/1740] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:17 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:18.426042 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-02e171c2-02d1-4c35-a2c5-8b18e8321783 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:18.426869 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-02e171c2-02d1-4c35-a2c5-8b18e8321783 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:18.434485 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-02e171c2-02d1-4c35-a2c5-8b18e8321783 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:18.434936 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-02e171c2-02d1-4c35-a2c5-8b18e8321783 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:18.435731 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-02e171c2-02d1-4c35-a2c5-8b18e8321783 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:18.436159 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-02e171c2-02d1-4c35-a2c5-8b18e8321783 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:18.593006 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-02e171c2-02d1-4c35-a2c5-8b18e8321783 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:18.602592 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-02e171c2-02d1-4c35-a2c5-8b18e8321783 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.180935 Apr 08 11:27:18.603253 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 863/1741] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:18 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:18.787788 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-5c619875-cba4-45fe-933a-9822e6d2cf14 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:18.788833 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-5c619875-cba4-45fe-933a-9822e6d2cf14 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:18.795049 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5c619875-cba4-45fe-933a-9822e6d2cf14 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:18.795497 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5c619875-cba4-45fe-933a-9822e6d2cf14 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:18.796278 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5c619875-cba4-45fe-933a-9822e6d2cf14 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:18.796721 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5c619875-cba4-45fe-933a-9822e6d2cf14 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:18.828775 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-5c619875-cba4-45fe-933a-9822e6d2cf14 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045117 Apr 08 11:27:18.829375 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 879/1742] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:18 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:19.011877 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bd658a41-db73-4cbf-aadc-c1938f0c3127 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:19.012627 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-bd658a41-db73-4cbf-aadc-c1938f0c3127 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:19.019144 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bd658a41-db73-4cbf-aadc-c1938f0c3127 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:19.019600 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bd658a41-db73-4cbf-aadc-c1938f0c3127 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:19.020473 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bd658a41-db73-4cbf-aadc-c1938f0c3127 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:19.020892 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bd658a41-db73-4cbf-aadc-c1938f0c3127 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:19.086076 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-bd658a41-db73-4cbf-aadc-c1938f0c3127 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:19.094244 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-bd658a41-db73-4cbf-aadc-c1938f0c3127 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.086272 Apr 08 11:27:19.095162 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 864/1743] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:19 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:19.625283 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-b9ff74c4-d1fd-4907-a922-1ebb5b8dadbe tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:19.626008 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-b9ff74c4-d1fd-4907-a922-1ebb5b8dadbe tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:19.632952 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b9ff74c4-d1fd-4907-a922-1ebb5b8dadbe tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:19.633401 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b9ff74c4-d1fd-4907-a922-1ebb5b8dadbe tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:19.634216 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b9ff74c4-d1fd-4907-a922-1ebb5b8dadbe tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:19.634652 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b9ff74c4-d1fd-4907-a922-1ebb5b8dadbe tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:19.786228 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b9ff74c4-d1fd-4907-a922-1ebb5b8dadbe tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:19.794733 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-b9ff74c4-d1fd-4907-a922-1ebb5b8dadbe tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.173275 Apr 08 11:27:19.795315 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 880/1744] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:19 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:19.843384 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6f284bad-9c82-4478-bc81-f874f713bdd0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:19.844609 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6f284bad-9c82-4478-bc81-f874f713bdd0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:19.853078 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6f284bad-9c82-4478-bc81-f874f713bdd0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:19.853535 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6f284bad-9c82-4478-bc81-f874f713bdd0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:19.854375 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6f284bad-9c82-4478-bc81-f874f713bdd0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:19.854820 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6f284bad-9c82-4478-bc81-f874f713bdd0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:19.886896 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6f284bad-9c82-4478-bc81-f874f713bdd0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047422 Apr 08 11:27:19.887419 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 865/1745] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:19 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:20.112615 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-af3f973c-794e-4d9a-b3f1-2aa4b3e759e0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:20.113224 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-af3f973c-794e-4d9a-b3f1-2aa4b3e759e0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:20.120445 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-af3f973c-794e-4d9a-b3f1-2aa4b3e759e0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:20.120892 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-af3f973c-794e-4d9a-b3f1-2aa4b3e759e0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:20.121675 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-af3f973c-794e-4d9a-b3f1-2aa4b3e759e0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:20.122152 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-af3f973c-794e-4d9a-b3f1-2aa4b3e759e0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:20.188227 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-af3f973c-794e-4d9a-b3f1-2aa4b3e759e0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:20.196157 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-af3f973c-794e-4d9a-b3f1-2aa4b3e759e0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.087481 Apr 08 11:27:20.196759 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 881/1746] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:20 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:20.812656 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4a45ec0e-3b8e-433d-a0f4-2507c58f9650 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:20.813283 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4a45ec0e-3b8e-433d-a0f4-2507c58f9650 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:20.819700 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4a45ec0e-3b8e-433d-a0f4-2507c58f9650 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:20.820160 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4a45ec0e-3b8e-433d-a0f4-2507c58f9650 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:20.820953 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4a45ec0e-3b8e-433d-a0f4-2507c58f9650 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:20.821398 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4a45ec0e-3b8e-433d-a0f4-2507c58f9650 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:20.900388 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-1d6192e4-e4eb-49cb-be9d-e99f18d66550 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:20.901417 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-1d6192e4-e4eb-49cb-be9d-e99f18d66550 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:20.908157 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1d6192e4-e4eb-49cb-be9d-e99f18d66550 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:20.908623 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1d6192e4-e4eb-49cb-be9d-e99f18d66550 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:20.909436 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1d6192e4-e4eb-49cb-be9d-e99f18d66550 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:20.909919 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1d6192e4-e4eb-49cb-be9d-e99f18d66550 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:20.948488 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-1d6192e4-e4eb-49cb-be9d-e99f18d66550 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052965 Apr 08 11:27:20.949565 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 882/1747] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:20 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:27:20.982653 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4a45ec0e-3b8e-433d-a0f4-2507c58f9650 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:20.990740 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4a45ec0e-3b8e-433d-a0f4-2507c58f9650 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.181870 Apr 08 11:27:20.991342 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 866/1748] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:20 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:21.213525 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-aaa99211-73bf-4aa5-9764-b318fa75f62b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:21.214112 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-aaa99211-73bf-4aa5-9764-b318fa75f62b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:21.220668 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-aaa99211-73bf-4aa5-9764-b318fa75f62b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:21.221122 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-aaa99211-73bf-4aa5-9764-b318fa75f62b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:21.221946 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-aaa99211-73bf-4aa5-9764-b318fa75f62b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:21.222388 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-aaa99211-73bf-4aa5-9764-b318fa75f62b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:21.285863 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-aaa99211-73bf-4aa5-9764-b318fa75f62b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:21.293994 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-aaa99211-73bf-4aa5-9764-b318fa75f62b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.084394 Apr 08 11:27:21.294573 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 883/1749] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:21 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:21.960883 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7bab1ec4-7ea6-4361-9b85-3f85e21b6725 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:21.961721 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7bab1ec4-7ea6-4361-9b85-3f85e21b6725 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:21.968185 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7bab1ec4-7ea6-4361-9b85-3f85e21b6725 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:21.968639 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7bab1ec4-7ea6-4361-9b85-3f85e21b6725 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:21.969429 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7bab1ec4-7ea6-4361-9b85-3f85e21b6725 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:21.969902 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7bab1ec4-7ea6-4361-9b85-3f85e21b6725 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:22.001481 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7bab1ec4-7ea6-4361-9b85-3f85e21b6725 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044629 Apr 08 11:27:22.002477 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 867/1750] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:21 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:22.008983 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-628026cb-2427-4c80-8c70-b899a454d6be tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:22.009602 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-628026cb-2427-4c80-8c70-b899a454d6be tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:22.023279 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-628026cb-2427-4c80-8c70-b899a454d6be tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:22.023745 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-628026cb-2427-4c80-8c70-b899a454d6be tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:22.024662 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-628026cb-2427-4c80-8c70-b899a454d6be tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:22.025268 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-628026cb-2427-4c80-8c70-b899a454d6be tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:22.176836 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-628026cb-2427-4c80-8c70-b899a454d6be tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:22.184719 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-628026cb-2427-4c80-8c70-b899a454d6be tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.180262 Apr 08 11:27:22.185289 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 884/1751] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:22 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:22.310794 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-69ed617f-d9a7-40d2-86bf-0c90f3e32f36 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:22.311408 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-69ed617f-d9a7-40d2-86bf-0c90f3e32f36 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:22.317304 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-69ed617f-d9a7-40d2-86bf-0c90f3e32f36 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:22.317759 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-69ed617f-d9a7-40d2-86bf-0c90f3e32f36 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:22.318554 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-69ed617f-d9a7-40d2-86bf-0c90f3e32f36 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:22.318995 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-69ed617f-d9a7-40d2-86bf-0c90f3e32f36 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:22.377291 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-69ed617f-d9a7-40d2-86bf-0c90f3e32f36 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:22.384731 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-69ed617f-d9a7-40d2-86bf-0c90f3e32f36 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078016 Apr 08 11:27:22.385298 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 868/1752] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:22 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:23.013867 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-f18dbddf-2ad8-45e2-8009-4e39600efa99 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:23.014852 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-f18dbddf-2ad8-45e2-8009-4e39600efa99 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:23.022126 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f18dbddf-2ad8-45e2-8009-4e39600efa99 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:23.022582 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f18dbddf-2ad8-45e2-8009-4e39600efa99 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:23.023396 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f18dbddf-2ad8-45e2-8009-4e39600efa99 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:23.023841 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f18dbddf-2ad8-45e2-8009-4e39600efa99 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:23.053615 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-f18dbddf-2ad8-45e2-8009-4e39600efa99 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043735 Apr 08 11:27:23.054565 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 885/1753] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:23 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:23.200897 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-10e79621-fa17-413e-b8ec-55ffca836313 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:23.201543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-10e79621-fa17-413e-b8ec-55ffca836313 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:23.208514 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-10e79621-fa17-413e-b8ec-55ffca836313 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:23.208514 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-10e79621-fa17-413e-b8ec-55ffca836313 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:23.209320 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-10e79621-fa17-413e-b8ec-55ffca836313 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:23.209644 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-10e79621-fa17-413e-b8ec-55ffca836313 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:23.345866 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-10e79621-fa17-413e-b8ec-55ffca836313 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:23.353849 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-10e79621-fa17-413e-b8ec-55ffca836313 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.156688 Apr 08 11:27:23.354450 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 869/1754] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:23 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:23.400577 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-6eabff45-f8a2-4831-afee-f1fc5f6fdc59 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:23.401263 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-6eabff45-f8a2-4831-afee-f1fc5f6fdc59 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:23.407257 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6eabff45-f8a2-4831-afee-f1fc5f6fdc59 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:23.407715 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6eabff45-f8a2-4831-afee-f1fc5f6fdc59 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:23.408495 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6eabff45-f8a2-4831-afee-f1fc5f6fdc59 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:23.408936 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6eabff45-f8a2-4831-afee-f1fc5f6fdc59 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:23.468228 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6eabff45-f8a2-4831-afee-f1fc5f6fdc59 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:23.476088 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-6eabff45-f8a2-4831-afee-f1fc5f6fdc59 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079428 Apr 08 11:27:23.476670 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 886/1755] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:23 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:24.064745 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a4c25229-dca6-477d-9bcc-6660a0447447 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:24.065681 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a4c25229-dca6-477d-9bcc-6660a0447447 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:24.071748 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a4c25229-dca6-477d-9bcc-6660a0447447 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:24.072206 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a4c25229-dca6-477d-9bcc-6660a0447447 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:24.072986 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a4c25229-dca6-477d-9bcc-6660a0447447 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:24.073430 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a4c25229-dca6-477d-9bcc-6660a0447447 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:24.104575 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a4c25229-dca6-477d-9bcc-6660a0447447 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043879 Apr 08 11:27:24.105151 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 870/1756] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:24 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:24.376119 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-dc7a7bb6-c3dd-4c93-8943-4e2eb062ae7d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:24.376742 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-dc7a7bb6-c3dd-4c93-8943-4e2eb062ae7d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:24.383945 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dc7a7bb6-c3dd-4c93-8943-4e2eb062ae7d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:24.384417 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dc7a7bb6-c3dd-4c93-8943-4e2eb062ae7d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:24.385230 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dc7a7bb6-c3dd-4c93-8943-4e2eb062ae7d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:24.385676 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-dc7a7bb6-c3dd-4c93-8943-4e2eb062ae7d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:24.492677 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-cf16ea19-5911-43fd-81d2-e57cf1dfdd96 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:24.493299 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-cf16ea19-5911-43fd-81d2-e57cf1dfdd96 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:24.499386 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cf16ea19-5911-43fd-81d2-e57cf1dfdd96 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:24.499849 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cf16ea19-5911-43fd-81d2-e57cf1dfdd96 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:24.500633 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cf16ea19-5911-43fd-81d2-e57cf1dfdd96 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:24.501076 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cf16ea19-5911-43fd-81d2-e57cf1dfdd96 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:24.526496 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-dc7a7bb6-c3dd-4c93-8943-4e2eb062ae7d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:24.533868 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-dc7a7bb6-c3dd-4c93-8943-4e2eb062ae7d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.161541 Apr 08 11:27:24.538747 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 887/1757] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:24 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:24.560991 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-cf16ea19-5911-43fd-81d2-e57cf1dfdd96 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:24.568897 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-cf16ea19-5911-43fd-81d2-e57cf1dfdd96 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080293 Apr 08 11:27:24.569465 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 871/1758] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:24 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:27:25.117147 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-44335eb6-20d3-40ac-a2e7-985398c39c08 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:25.118112 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-44335eb6-20d3-40ac-a2e7-985398c39c08 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:25.124091 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-44335eb6-20d3-40ac-a2e7-985398c39c08 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:25.124578 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-44335eb6-20d3-40ac-a2e7-985398c39c08 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:25.125363 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-44335eb6-20d3-40ac-a2e7-985398c39c08 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:25.125826 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-44335eb6-20d3-40ac-a2e7-985398c39c08 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:25.154284 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-44335eb6-20d3-40ac-a2e7-985398c39c08 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041942 Apr 08 11:27:25.154849 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 888/1759] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:25 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:25.551067 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0dc150f1-9d11-44d3-a684-b9c3df941b0a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:25.551715 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0dc150f1-9d11-44d3-a684-b9c3df941b0a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:25.558456 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0dc150f1-9d11-44d3-a684-b9c3df941b0a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:25.558903 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0dc150f1-9d11-44d3-a684-b9c3df941b0a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:25.559808 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0dc150f1-9d11-44d3-a684-b9c3df941b0a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:25.560240 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0dc150f1-9d11-44d3-a684-b9c3df941b0a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:25.586350 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a6f290bc-aa67-4fab-a1f9-f2c6b1fef0ca tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:25.587085 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a6f290bc-aa67-4fab-a1f9-f2c6b1fef0ca tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:25.593720 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a6f290bc-aa67-4fab-a1f9-f2c6b1fef0ca tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:25.594215 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a6f290bc-aa67-4fab-a1f9-f2c6b1fef0ca tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:25.595007 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a6f290bc-aa67-4fab-a1f9-f2c6b1fef0ca tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:25.595448 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a6f290bc-aa67-4fab-a1f9-f2c6b1fef0ca tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:25.664687 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a6f290bc-aa67-4fab-a1f9-f2c6b1fef0ca tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:25.673650 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a6f290bc-aa67-4fab-a1f9-f2c6b1fef0ca tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.091789 Apr 08 11:27:25.674331 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 889/1760] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:25 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:27:25.725687 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0dc150f1-9d11-44d3-a684-b9c3df941b0a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:25.733048 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0dc150f1-9d11-44d3-a684-b9c3df941b0a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.185833 Apr 08 11:27:25.733605 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 872/1761] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:25 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:26.166198 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e0a96ab3-fee5-49e0-b496-c97bbf193c87 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:26.167145 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e0a96ab3-fee5-49e0-b496-c97bbf193c87 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:26.173336 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e0a96ab3-fee5-49e0-b496-c97bbf193c87 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:26.173814 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e0a96ab3-fee5-49e0-b496-c97bbf193c87 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:26.174614 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e0a96ab3-fee5-49e0-b496-c97bbf193c87 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:26.175052 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e0a96ab3-fee5-49e0-b496-c97bbf193c87 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:26.207677 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e0a96ab3-fee5-49e0-b496-c97bbf193c87 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045527 Apr 08 11:27:26.208384 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 890/1762] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:26 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:26.690561 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e64e432b-897d-4555-bd29-9069c9b2d80b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:26.691294 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e64e432b-897d-4555-bd29-9069c9b2d80b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:26.697503 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e64e432b-897d-4555-bd29-9069c9b2d80b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:26.698003 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e64e432b-897d-4555-bd29-9069c9b2d80b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:26.703487 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e64e432b-897d-4555-bd29-9069c9b2d80b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:26.703487 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e64e432b-897d-4555-bd29-9069c9b2d80b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:26.750009 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a40c9406-5709-480f-b959-a22eb1a3f93e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:26.750770 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a40c9406-5709-480f-b959-a22eb1a3f93e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:26.757528 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a40c9406-5709-480f-b959-a22eb1a3f93e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:26.757528 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a40c9406-5709-480f-b959-a22eb1a3f93e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:26.761355 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a40c9406-5709-480f-b959-a22eb1a3f93e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:26.761355 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a40c9406-5709-480f-b959-a22eb1a3f93e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:26.764750 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e64e432b-897d-4555-bd29-9069c9b2d80b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:26.774582 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e64e432b-897d-4555-bd29-9069c9b2d80b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.088062 Apr 08 11:27:26.775173 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 873/1763] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:26 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:27:26.897030 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a40c9406-5709-480f-b959-a22eb1a3f93e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:26.904768 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a40c9406-5709-480f-b959-a22eb1a3f93e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.158624 Apr 08 11:27:26.905358 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 891/1764] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:26 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:27:27.219664 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-dfa3b6ba-d68f-4ad6-8b9c-7c2660e0d0d3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:27.220635 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-dfa3b6ba-d68f-4ad6-8b9c-7c2660e0d0d3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:27.227385 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dfa3b6ba-d68f-4ad6-8b9c-7c2660e0d0d3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:27.227837 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dfa3b6ba-d68f-4ad6-8b9c-7c2660e0d0d3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:27.228640 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dfa3b6ba-d68f-4ad6-8b9c-7c2660e0d0d3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:27.229071 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dfa3b6ba-d68f-4ad6-8b9c-7c2660e0d0d3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:27.259590 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-dfa3b6ba-d68f-4ad6-8b9c-7c2660e0d0d3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043891 Apr 08 11:27:27.260188 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 874/1765] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:27 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:27.343606 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-f750b96a-9beb-4ac9-9639-5ac35e5a8cdc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:27.344113 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-f750b96a-9beb-4ac9-9639-5ac35e5a8cdc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:27.350210 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f750b96a-9beb-4ac9-9639-5ac35e5a8cdc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:27.350668 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f750b96a-9beb-4ac9-9639-5ac35e5a8cdc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:27.351446 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f750b96a-9beb-4ac9-9639-5ac35e5a8cdc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:27.351890 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f750b96a-9beb-4ac9-9639-5ac35e5a8cdc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:27.376011 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-f750b96a-9beb-4ac9-9639-5ac35e5a8cdc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Going to try to terminate instance {{(pid=117801) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 08 11:27:27.479009 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.compute.api [None req-f750b96a-9beb-4ac9-9639-5ac35e5a8cdc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Instance is already in deleting state, ignoring this request Apr 08 11:27:27.479867 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-f750b96a-9beb-4ac9-9639-5ac35e5a8cdc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "DELETE /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 204 len: 0 microversion: 2.1 time: 0.140118 Apr 08 11:27:27.480436 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 892/1766] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 8 11:27:27 2022] DELETE /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 11:27:27.488998 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-88e84213-f097-4a11-9374-0ba3bebc7667 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:27.489617 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-88e84213-f097-4a11-9374-0ba3bebc7667 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:27.496084 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-88e84213-f097-4a11-9374-0ba3bebc7667 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:27.496543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-88e84213-f097-4a11-9374-0ba3bebc7667 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:27.497423 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-88e84213-f097-4a11-9374-0ba3bebc7667 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:27.497902 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-88e84213-f097-4a11-9374-0ba3bebc7667 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:27.561543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-88e84213-f097-4a11-9374-0ba3bebc7667 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:27.569790 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-88e84213-f097-4a11-9374-0ba3bebc7667 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.084722 Apr 08 11:27:27.570381 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 875/1767] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:27 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:27.925708 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-ea7f10c8-f183-4f91-a243-0add8828a616 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:27.926296 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-ea7f10c8-f183-4f91-a243-0add8828a616 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:27.933213 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ea7f10c8-f183-4f91-a243-0add8828a616 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:27.933658 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ea7f10c8-f183-4f91-a243-0add8828a616 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:27.934454 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ea7f10c8-f183-4f91-a243-0add8828a616 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:27.934889 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ea7f10c8-f183-4f91-a243-0add8828a616 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:28.099978 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-ea7f10c8-f183-4f91-a243-0add8828a616 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:28.107935 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-ea7f10c8-f183-4f91-a243-0add8828a616 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.186361 Apr 08 11:27:28.108609 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 893/1768] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:27 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:28.271727 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-688d2139-9f8b-4474-8039-54f08d11d70a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:28.272993 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-688d2139-9f8b-4474-8039-54f08d11d70a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:28.280083 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-688d2139-9f8b-4474-8039-54f08d11d70a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:28.280625 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-688d2139-9f8b-4474-8039-54f08d11d70a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:28.281476 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-688d2139-9f8b-4474-8039-54f08d11d70a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:28.282133 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-688d2139-9f8b-4474-8039-54f08d11d70a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:28.316194 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-688d2139-9f8b-4474-8039-54f08d11d70a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048622 Apr 08 11:27:28.317051 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 876/1769] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:28 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:28.587227 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-c3472461-0a73-4656-9044-029d2e4063f1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:28.588014 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-c3472461-0a73-4656-9044-029d2e4063f1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:28.594078 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c3472461-0a73-4656-9044-029d2e4063f1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:28.594530 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c3472461-0a73-4656-9044-029d2e4063f1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:28.595319 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c3472461-0a73-4656-9044-029d2e4063f1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:28.595759 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-c3472461-0a73-4656-9044-029d2e4063f1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:28.657685 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-c3472461-0a73-4656-9044-029d2e4063f1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:28.666007 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-c3472461-0a73-4656-9044-029d2e4063f1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.083092 Apr 08 11:27:28.666592 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 894/1770] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:28 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:29.126563 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1fdea8fc-9f97-4fcb-8014-a29b5dfbe9bf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:29.127181 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1fdea8fc-9f97-4fcb-8014-a29b5dfbe9bf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:29.133388 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1fdea8fc-9f97-4fcb-8014-a29b5dfbe9bf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:29.133872 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1fdea8fc-9f97-4fcb-8014-a29b5dfbe9bf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:29.134659 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1fdea8fc-9f97-4fcb-8014-a29b5dfbe9bf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:29.135099 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1fdea8fc-9f97-4fcb-8014-a29b5dfbe9bf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:29.272651 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1fdea8fc-9f97-4fcb-8014-a29b5dfbe9bf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:29.280074 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1fdea8fc-9f97-4fcb-8014-a29b5dfbe9bf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.157565 Apr 08 11:27:29.280642 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 877/1771] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:29 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:29.328311 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-f6f68bd5-80ef-4fab-a80a-dc8e49f7d492 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:29.329242 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-f6f68bd5-80ef-4fab-a80a-dc8e49f7d492 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:29.336026 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f6f68bd5-80ef-4fab-a80a-dc8e49f7d492 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:29.336483 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f6f68bd5-80ef-4fab-a80a-dc8e49f7d492 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:29.337290 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f6f68bd5-80ef-4fab-a80a-dc8e49f7d492 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:29.337725 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f6f68bd5-80ef-4fab-a80a-dc8e49f7d492 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:29.365756 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-f6f68bd5-80ef-4fab-a80a-dc8e49f7d492 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041432 Apr 08 11:27:29.366335 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 895/1772] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:29 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:29.683275 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7e71692d-a817-47a4-b0af-4c641835451d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:29.683888 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7e71692d-a817-47a4-b0af-4c641835451d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:29.689815 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7e71692d-a817-47a4-b0af-4c641835451d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:29.690271 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7e71692d-a817-47a4-b0af-4c641835451d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:29.691042 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7e71692d-a817-47a4-b0af-4c641835451d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:29.691480 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7e71692d-a817-47a4-b0af-4c641835451d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:29.762300 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7e71692d-a817-47a4-b0af-4c641835451d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:29.769622 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7e71692d-a817-47a4-b0af-4c641835451d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.090236 Apr 08 11:27:29.770213 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 878/1773] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:29 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:30.297793 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-5f7d00c1-3a01-4e08-8c05-64bccd30f288 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:30.298431 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-5f7d00c1-3a01-4e08-8c05-64bccd30f288 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:30.305050 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5f7d00c1-3a01-4e08-8c05-64bccd30f288 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:30.305504 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5f7d00c1-3a01-4e08-8c05-64bccd30f288 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:30.306315 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5f7d00c1-3a01-4e08-8c05-64bccd30f288 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:30.306756 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5f7d00c1-3a01-4e08-8c05-64bccd30f288 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:30.377991 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-556bda22-eee5-417c-998f-683baf3ef11b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:30.379145 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-556bda22-eee5-417c-998f-683baf3ef11b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:30.385695 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-556bda22-eee5-417c-998f-683baf3ef11b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:30.386192 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-556bda22-eee5-417c-998f-683baf3ef11b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:30.386978 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-556bda22-eee5-417c-998f-683baf3ef11b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:30.387450 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-556bda22-eee5-417c-998f-683baf3ef11b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:30.416616 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-556bda22-eee5-417c-998f-683baf3ef11b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042582 Apr 08 11:27:30.417193 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 879/1774] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:30 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:27:30.439836 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-5f7d00c1-3a01-4e08-8c05-64bccd30f288 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:30.447254 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-5f7d00c1-3a01-4e08-8c05-64bccd30f288 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.153368 Apr 08 11:27:30.447816 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 896/1775] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:30 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:30.787414 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-93c697cb-9b2d-4918-b037-925f4bfe3590 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:30.788020 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-93c697cb-9b2d-4918-b037-925f4bfe3590 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:30.794018 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-93c697cb-9b2d-4918-b037-925f4bfe3590 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:30.794473 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-93c697cb-9b2d-4918-b037-925f4bfe3590 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:30.795245 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-93c697cb-9b2d-4918-b037-925f4bfe3590 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:30.795690 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-93c697cb-9b2d-4918-b037-925f4bfe3590 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:30.857284 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-93c697cb-9b2d-4918-b037-925f4bfe3590 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:30.864637 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-93c697cb-9b2d-4918-b037-925f4bfe3590 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081620 Apr 08 11:27:30.865216 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 880/1776] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:30 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:31.429051 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-add3c8c9-59dd-45e4-9212-b0c85e532ad5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:31.430030 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-add3c8c9-59dd-45e4-9212-b0c85e532ad5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:31.436849 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-add3c8c9-59dd-45e4-9212-b0c85e532ad5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:31.437295 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-add3c8c9-59dd-45e4-9212-b0c85e532ad5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:31.438117 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-add3c8c9-59dd-45e4-9212-b0c85e532ad5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:31.438555 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-add3c8c9-59dd-45e4-9212-b0c85e532ad5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:31.464707 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e4fdfe0e-f58a-4ddc-b5bd-682700ac26eb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:31.465290 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e4fdfe0e-f58a-4ddc-b5bd-682700ac26eb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:31.469699 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-add3c8c9-59dd-45e4-9212-b0c85e532ad5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045138 Apr 08 11:27:31.470680 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 897/1777] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:31 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:31.471989 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e4fdfe0e-f58a-4ddc-b5bd-682700ac26eb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:31.472581 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e4fdfe0e-f58a-4ddc-b5bd-682700ac26eb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:31.473254 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e4fdfe0e-f58a-4ddc-b5bd-682700ac26eb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:31.474101 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e4fdfe0e-f58a-4ddc-b5bd-682700ac26eb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:31.612701 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e4fdfe0e-f58a-4ddc-b5bd-682700ac26eb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:31.620836 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e4fdfe0e-f58a-4ddc-b5bd-682700ac26eb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.160198 Apr 08 11:27:31.621609 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 881/1778] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:31 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:27:31.881848 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-f61e5753-cbdf-49a2-bd73-a842c64f1faa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:31.882510 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-f61e5753-cbdf-49a2-bd73-a842c64f1faa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:31.888515 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f61e5753-cbdf-49a2-bd73-a842c64f1faa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:31.889023 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f61e5753-cbdf-49a2-bd73-a842c64f1faa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:31.889903 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f61e5753-cbdf-49a2-bd73-a842c64f1faa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:31.890363 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f61e5753-cbdf-49a2-bd73-a842c64f1faa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:31.965462 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f61e5753-cbdf-49a2-bd73-a842c64f1faa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:31.972987 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-f61e5753-cbdf-49a2-bd73-a842c64f1faa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.095210 Apr 08 11:27:31.974109 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 898/1779] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:31 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:32.482337 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1c12a89d-9467-4f3d-af5d-68ac4ecb7854 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:32.483281 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1c12a89d-9467-4f3d-af5d-68ac4ecb7854 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:32.489577 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1c12a89d-9467-4f3d-af5d-68ac4ecb7854 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:32.490057 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1c12a89d-9467-4f3d-af5d-68ac4ecb7854 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:32.490837 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1c12a89d-9467-4f3d-af5d-68ac4ecb7854 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:32.491277 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1c12a89d-9467-4f3d-af5d-68ac4ecb7854 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:32.519988 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1c12a89d-9467-4f3d-af5d-68ac4ecb7854 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041777 Apr 08 11:27:32.521103 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 882/1780] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:32 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:32.704076 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-cd790f88-467c-4427-b4bd-ef8ad5a2630d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:32.704689 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-cd790f88-467c-4427-b4bd-ef8ad5a2630d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:32.711283 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cd790f88-467c-4427-b4bd-ef8ad5a2630d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:32.711734 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cd790f88-467c-4427-b4bd-ef8ad5a2630d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:32.712499 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cd790f88-467c-4427-b4bd-ef8ad5a2630d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:32.712939 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-cd790f88-467c-4427-b4bd-ef8ad5a2630d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:32.845504 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-cd790f88-467c-4427-b4bd-ef8ad5a2630d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:32.852953 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-cd790f88-467c-4427-b4bd-ef8ad5a2630d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.218185 Apr 08 11:27:32.853523 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 899/1781] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:32 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:27:32.991407 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f8f5ce7d-0c71-4457-913d-b1716d1b7289 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:32.992290 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f8f5ce7d-0c71-4457-913d-b1716d1b7289 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:32.998586 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f8f5ce7d-0c71-4457-913d-b1716d1b7289 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:32.999043 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f8f5ce7d-0c71-4457-913d-b1716d1b7289 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:32.999836 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f8f5ce7d-0c71-4457-913d-b1716d1b7289 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:33.000277 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f8f5ce7d-0c71-4457-913d-b1716d1b7289 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:33.064600 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f8f5ce7d-0c71-4457-913d-b1716d1b7289 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:33.073471 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f8f5ce7d-0c71-4457-913d-b1716d1b7289 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.086739 Apr 08 11:27:33.074239 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 883/1782] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:32 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:33.532120 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-3d185c55-5986-4d66-8b83-82d6aff8d919 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:33.533120 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-3d185c55-5986-4d66-8b83-82d6aff8d919 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:33.539041 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3d185c55-5986-4d66-8b83-82d6aff8d919 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:33.539498 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3d185c55-5986-4d66-8b83-82d6aff8d919 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:33.540274 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3d185c55-5986-4d66-8b83-82d6aff8d919 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:33.540715 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3d185c55-5986-4d66-8b83-82d6aff8d919 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:33.569884 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-3d185c55-5986-4d66-8b83-82d6aff8d919 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041655 Apr 08 11:27:33.570468 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 900/1783] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:33 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:33.872382 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-37c4628d-e712-4cda-9b3f-39fe154d63c4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:33.873431 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-37c4628d-e712-4cda-9b3f-39fe154d63c4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:33.881287 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-37c4628d-e712-4cda-9b3f-39fe154d63c4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:33.881925 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-37c4628d-e712-4cda-9b3f-39fe154d63c4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:33.883116 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-37c4628d-e712-4cda-9b3f-39fe154d63c4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:33.883687 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-37c4628d-e712-4cda-9b3f-39fe154d63c4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:34.028057 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-37c4628d-e712-4cda-9b3f-39fe154d63c4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:34.036517 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-37c4628d-e712-4cda-9b3f-39fe154d63c4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.169016 Apr 08 11:27:34.037103 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 884/1784] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:33 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:34.090570 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-11aefcef-4138-4a7e-9dd8-22dde2554a7d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:34.091227 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-11aefcef-4138-4a7e-9dd8-22dde2554a7d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:34.098089 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-11aefcef-4138-4a7e-9dd8-22dde2554a7d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:34.099202 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-11aefcef-4138-4a7e-9dd8-22dde2554a7d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:34.099999 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-11aefcef-4138-4a7e-9dd8-22dde2554a7d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:34.100441 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-11aefcef-4138-4a7e-9dd8-22dde2554a7d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:34.160522 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-11aefcef-4138-4a7e-9dd8-22dde2554a7d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:34.168333 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-11aefcef-4138-4a7e-9dd8-22dde2554a7d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081627 Apr 08 11:27:34.168906 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 901/1785] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:34 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:34.580669 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d9b7745e-4373-4977-aa3c-af5928457893 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:34.581594 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d9b7745e-4373-4977-aa3c-af5928457893 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:34.588028 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d9b7745e-4373-4977-aa3c-af5928457893 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:34.588503 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d9b7745e-4373-4977-aa3c-af5928457893 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:34.589266 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d9b7745e-4373-4977-aa3c-af5928457893 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:34.589704 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d9b7745e-4373-4977-aa3c-af5928457893 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:34.619364 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d9b7745e-4373-4977-aa3c-af5928457893 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042669 Apr 08 11:27:34.619918 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 885/1786] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:34 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:35.054853 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-1f212181-69b1-49e7-a2ba-5a6b0cca5a7d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:35.055506 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-1f212181-69b1-49e7-a2ba-5a6b0cca5a7d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:35.061577 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1f212181-69b1-49e7-a2ba-5a6b0cca5a7d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:35.062053 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1f212181-69b1-49e7-a2ba-5a6b0cca5a7d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:35.062841 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1f212181-69b1-49e7-a2ba-5a6b0cca5a7d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:35.063286 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-1f212181-69b1-49e7-a2ba-5a6b0cca5a7d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:35.185380 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5af25c26-c574-4bee-88d0-6d385ecb00f7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:35.186007 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5af25c26-c574-4bee-88d0-6d385ecb00f7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:35.192703 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5af25c26-c574-4bee-88d0-6d385ecb00f7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:35.193159 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5af25c26-c574-4bee-88d0-6d385ecb00f7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:35.194028 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5af25c26-c574-4bee-88d0-6d385ecb00f7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:35.194437 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5af25c26-c574-4bee-88d0-6d385ecb00f7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:35.399136 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5af25c26-c574-4bee-88d0-6d385ecb00f7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:35.406607 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5af25c26-c574-4bee-88d0-6d385ecb00f7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.225080 Apr 08 11:27:35.407200 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 886/1787] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:35 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:27:35.468768 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-1f212181-69b1-49e7-a2ba-5a6b0cca5a7d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:35.477703 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-1f212181-69b1-49e7-a2ba-5a6b0cca5a7d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.427487 Apr 08 11:27:35.478325 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 902/1788] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:35 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:35.631620 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9ad0d296-2a87-42d2-8ee9-00d650197d38 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:35.632563 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9ad0d296-2a87-42d2-8ee9-00d650197d38 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:35.638568 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9ad0d296-2a87-42d2-8ee9-00d650197d38 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:35.639025 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9ad0d296-2a87-42d2-8ee9-00d650197d38 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:35.639823 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9ad0d296-2a87-42d2-8ee9-00d650197d38 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:35.640269 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9ad0d296-2a87-42d2-8ee9-00d650197d38 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:35.669700 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9ad0d296-2a87-42d2-8ee9-00d650197d38 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042623 Apr 08 11:27:35.670294 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 887/1789] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:35 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:27:36.424101 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-ef816041-f450-435a-97b6-b8c912c56f1e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:36.424706 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-ef816041-f450-435a-97b6-b8c912c56f1e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:36.431968 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ef816041-f450-435a-97b6-b8c912c56f1e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:36.432420 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ef816041-f450-435a-97b6-b8c912c56f1e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:36.433199 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ef816041-f450-435a-97b6-b8c912c56f1e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:36.433673 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ef816041-f450-435a-97b6-b8c912c56f1e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:36.495323 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-ef816041-f450-435a-97b6-b8c912c56f1e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:36.495892 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-afb27344-945d-45f3-8192-875e9f154b09 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:36.496504 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-afb27344-945d-45f3-8192-875e9f154b09 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:36.502814 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-afb27344-945d-45f3-8192-875e9f154b09 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:36.503016 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-ef816041-f450-435a-97b6-b8c912c56f1e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082700 Apr 08 11:27:36.503262 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-afb27344-945d-45f3-8192-875e9f154b09 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:36.503510 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 903/1790] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:36 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:36.504039 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-afb27344-945d-45f3-8192-875e9f154b09 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:36.504523 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-afb27344-945d-45f3-8192-875e9f154b09 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:36.651533 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-afb27344-945d-45f3-8192-875e9f154b09 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:36.659137 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-afb27344-945d-45f3-8192-875e9f154b09 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.167433 Apr 08 11:27:36.659713 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 888/1791] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:36 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:27:36.680992 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-85f30ba5-1215-47d9-bed8-7d7091f7e0e4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:36.681886 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-85f30ba5-1215-47d9-bed8-7d7091f7e0e4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:36.687895 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-85f30ba5-1215-47d9-bed8-7d7091f7e0e4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:36.688344 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-85f30ba5-1215-47d9-bed8-7d7091f7e0e4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:36.689114 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-85f30ba5-1215-47d9-bed8-7d7091f7e0e4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:36.689546 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-85f30ba5-1215-47d9-bed8-7d7091f7e0e4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:36.718529 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-85f30ba5-1215-47d9-bed8-7d7091f7e0e4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041652 Apr 08 11:27:36.719091 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 904/1792] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:36 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:37.520696 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-040ee2d6-ce45-4fce-b349-e39af60a4d25 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:37.521304 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-040ee2d6-ce45-4fce-b349-e39af60a4d25 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:37.527616 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-040ee2d6-ce45-4fce-b349-e39af60a4d25 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:37.528069 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-040ee2d6-ce45-4fce-b349-e39af60a4d25 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:37.528847 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-040ee2d6-ce45-4fce-b349-e39af60a4d25 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:37.529280 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-040ee2d6-ce45-4fce-b349-e39af60a4d25 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:37.590201 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-040ee2d6-ce45-4fce-b349-e39af60a4d25 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:37.599029 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-040ee2d6-ce45-4fce-b349-e39af60a4d25 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081873 Apr 08 11:27:37.602483 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 889/1793] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:37 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:37.676673 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-3e5ead5b-2331-4d62-8221-5328cfa56f23 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:37.677280 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-3e5ead5b-2331-4d62-8221-5328cfa56f23 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:37.683844 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3e5ead5b-2331-4d62-8221-5328cfa56f23 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:37.684351 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3e5ead5b-2331-4d62-8221-5328cfa56f23 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:37.685087 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3e5ead5b-2331-4d62-8221-5328cfa56f23 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:37.685530 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-3e5ead5b-2331-4d62-8221-5328cfa56f23 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:37.732328 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-05900c8e-bf40-4e68-a0c8-3d6d309ba4fd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:37.733284 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-05900c8e-bf40-4e68-a0c8-3d6d309ba4fd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:37.739297 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-05900c8e-bf40-4e68-a0c8-3d6d309ba4fd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:37.739747 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-05900c8e-bf40-4e68-a0c8-3d6d309ba4fd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:37.740529 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-05900c8e-bf40-4e68-a0c8-3d6d309ba4fd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:37.740971 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-05900c8e-bf40-4e68-a0c8-3d6d309ba4fd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:37.773984 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-05900c8e-bf40-4e68-a0c8-3d6d309ba4fd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046734 Apr 08 11:27:37.774839 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 890/1794] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:37 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:27:37.827194 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-3e5ead5b-2331-4d62-8221-5328cfa56f23 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:37.835297 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-3e5ead5b-2331-4d62-8221-5328cfa56f23 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.162608 Apr 08 11:27:37.835871 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 905/1795] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:37 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:27:38.623461 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-03ccfb4a-618c-43da-8c44-8b59d2190054 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:38.624177 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-03ccfb4a-618c-43da-8c44-8b59d2190054 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:38.633645 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-03ccfb4a-618c-43da-8c44-8b59d2190054 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:38.634290 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-03ccfb4a-618c-43da-8c44-8b59d2190054 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:38.635452 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-03ccfb4a-618c-43da-8c44-8b59d2190054 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:38.636018 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-03ccfb4a-618c-43da-8c44-8b59d2190054 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:38.699475 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-03ccfb4a-618c-43da-8c44-8b59d2190054 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:38.707295 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-03ccfb4a-618c-43da-8c44-8b59d2190054 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.089634 Apr 08 11:27:38.708471 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 891/1796] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:38 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:27:38.785858 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-7cd128ea-fa33-4cbc-8150-58787068705d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:38.786865 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-7cd128ea-fa33-4cbc-8150-58787068705d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:38.793341 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7cd128ea-fa33-4cbc-8150-58787068705d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:38.793824 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7cd128ea-fa33-4cbc-8150-58787068705d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:38.794623 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7cd128ea-fa33-4cbc-8150-58787068705d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:38.795066 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7cd128ea-fa33-4cbc-8150-58787068705d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:38.826726 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-7cd128ea-fa33-4cbc-8150-58787068705d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044841 Apr 08 11:27:38.827323 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 906/1797] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:38 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:38.852445 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-cb8718ee-1e74-4060-9432-5ec3db7d4962 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:38.853059 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-cb8718ee-1e74-4060-9432-5ec3db7d4962 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:38.859161 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cb8718ee-1e74-4060-9432-5ec3db7d4962 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:38.859609 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cb8718ee-1e74-4060-9432-5ec3db7d4962 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:38.860381 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cb8718ee-1e74-4060-9432-5ec3db7d4962 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:38.860815 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cb8718ee-1e74-4060-9432-5ec3db7d4962 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:38.999968 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-cb8718ee-1e74-4060-9432-5ec3db7d4962 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:39.008345 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-cb8718ee-1e74-4060-9432-5ec3db7d4962 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.159677 Apr 08 11:27:39.008940 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 892/1798] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:38 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:39.725334 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-04bda844-8179-47b7-b1ec-9833c94c5db7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:39.725989 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-04bda844-8179-47b7-b1ec-9833c94c5db7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:39.731936 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-04bda844-8179-47b7-b1ec-9833c94c5db7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:39.732386 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-04bda844-8179-47b7-b1ec-9833c94c5db7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:39.733156 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-04bda844-8179-47b7-b1ec-9833c94c5db7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:39.733598 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-04bda844-8179-47b7-b1ec-9833c94c5db7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:39.792013 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-04bda844-8179-47b7-b1ec-9833c94c5db7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:39.799900 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-04bda844-8179-47b7-b1ec-9833c94c5db7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078990 Apr 08 11:27:39.800519 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 907/1799] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:39 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:39.841209 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8c1be61f-d46e-4cd2-bbde-c0c045c46af7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:39.842434 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8c1be61f-d46e-4cd2-bbde-c0c045c46af7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:39.849510 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8c1be61f-d46e-4cd2-bbde-c0c045c46af7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:39.850019 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8c1be61f-d46e-4cd2-bbde-c0c045c46af7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:39.850805 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8c1be61f-d46e-4cd2-bbde-c0c045c46af7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:39.851255 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8c1be61f-d46e-4cd2-bbde-c0c045c46af7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:39.881243 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8c1be61f-d46e-4cd2-bbde-c0c045c46af7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045561 Apr 08 11:27:39.881827 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 893/1800] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:39 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:40.026120 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-5d4f63ef-1ce5-4c4b-a208-90467ad4ce30 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:40.026735 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-5d4f63ef-1ce5-4c4b-a208-90467ad4ce30 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:40.032643 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5d4f63ef-1ce5-4c4b-a208-90467ad4ce30 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:40.033097 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5d4f63ef-1ce5-4c4b-a208-90467ad4ce30 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:40.033903 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5d4f63ef-1ce5-4c4b-a208-90467ad4ce30 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:40.034346 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-5d4f63ef-1ce5-4c4b-a208-90467ad4ce30 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:40.167855 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-5d4f63ef-1ce5-4c4b-a208-90467ad4ce30 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:40.175202 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-5d4f63ef-1ce5-4c4b-a208-90467ad4ce30 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.152921 Apr 08 11:27:40.175759 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 908/1801] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:40 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:40.816482 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-60a41225-e35c-49e3-9843-b40dc9026389 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:40.817098 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-60a41225-e35c-49e3-9843-b40dc9026389 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:40.823254 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-60a41225-e35c-49e3-9843-b40dc9026389 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:40.823707 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-60a41225-e35c-49e3-9843-b40dc9026389 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:40.824496 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-60a41225-e35c-49e3-9843-b40dc9026389 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:40.824941 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-60a41225-e35c-49e3-9843-b40dc9026389 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:40.884407 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-60a41225-e35c-49e3-9843-b40dc9026389 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:40.891945 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-60a41225-e35c-49e3-9843-b40dc9026389 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079316 Apr 08 11:27:40.892297 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-7dab86ed-bef4-4d31-bfcf-6c2904503ebf tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:40.892851 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 894/1802] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:40 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:40.893383 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-7dab86ed-bef4-4d31-bfcf-6c2904503ebf tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:40.899805 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7dab86ed-bef4-4d31-bfcf-6c2904503ebf tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:40.900189 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7dab86ed-bef4-4d31-bfcf-6c2904503ebf tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:40.900966 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7dab86ed-bef4-4d31-bfcf-6c2904503ebf tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:40.901402 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7dab86ed-bef4-4d31-bfcf-6c2904503ebf tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:40.930661 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-7dab86ed-bef4-4d31-bfcf-6c2904503ebf tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042335 Apr 08 11:27:40.942013 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 909/1803] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:40 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:27:41.192335 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-453f561c-9de9-4deb-94c4-9a48e9af5318 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:41.192901 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-453f561c-9de9-4deb-94c4-9a48e9af5318 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:41.198907 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-453f561c-9de9-4deb-94c4-9a48e9af5318 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:41.199364 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-453f561c-9de9-4deb-94c4-9a48e9af5318 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:41.200141 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-453f561c-9de9-4deb-94c4-9a48e9af5318 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:41.200584 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-453f561c-9de9-4deb-94c4-9a48e9af5318 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:41.333324 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-453f561c-9de9-4deb-94c4-9a48e9af5318 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:41.340722 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-453f561c-9de9-4deb-94c4-9a48e9af5318 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.152400 Apr 08 11:27:41.341296 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 895/1804] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:41 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:41.908884 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-f3a5609b-2270-4334-912b-e1fb4667ac8b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:41.909436 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-f3a5609b-2270-4334-912b-e1fb4667ac8b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:41.915920 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f3a5609b-2270-4334-912b-e1fb4667ac8b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:41.916382 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f3a5609b-2270-4334-912b-e1fb4667ac8b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:41.917164 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f3a5609b-2270-4334-912b-e1fb4667ac8b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:41.917607 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f3a5609b-2270-4334-912b-e1fb4667ac8b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:41.951943 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-fdbb0327-8ad5-4eff-92c0-dd81af5f483f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:41.952891 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-fdbb0327-8ad5-4eff-92c0-dd81af5f483f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:41.959902 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fdbb0327-8ad5-4eff-92c0-dd81af5f483f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:41.960704 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fdbb0327-8ad5-4eff-92c0-dd81af5f483f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:41.962064 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fdbb0327-8ad5-4eff-92c0-dd81af5f483f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:41.962814 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fdbb0327-8ad5-4eff-92c0-dd81af5f483f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:41.983860 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f3a5609b-2270-4334-912b-e1fb4667ac8b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:41.995333 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-f3a5609b-2270-4334-912b-e1fb4667ac8b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.090370 Apr 08 11:27:41.996310 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 910/1805] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:41 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:42.011500 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-fdbb0327-8ad5-4eff-92c0-dd81af5f483f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063463 Apr 08 11:27:42.012090 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 896/1806] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:41 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:27:42.358377 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-0e913c56-ca06-495f-beaa-3f616d254957 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:42.358995 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-0e913c56-ca06-495f-beaa-3f616d254957 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:42.365516 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0e913c56-ca06-495f-beaa-3f616d254957 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:42.365997 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0e913c56-ca06-495f-beaa-3f616d254957 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:42.367027 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0e913c56-ca06-495f-beaa-3f616d254957 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:42.367468 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-0e913c56-ca06-495f-beaa-3f616d254957 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:42.500797 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-0e913c56-ca06-495f-beaa-3f616d254957 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:42.508354 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-0e913c56-ca06-495f-beaa-3f616d254957 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.153864 Apr 08 11:27:42.508934 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 911/1807] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:42 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:43.011950 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-20e2b50e-66b9-402f-9794-26221374d163 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:43.012568 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-20e2b50e-66b9-402f-9794-26221374d163 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:43.019014 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-20e2b50e-66b9-402f-9794-26221374d163 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:43.019470 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-20e2b50e-66b9-402f-9794-26221374d163 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:43.020752 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-20e2b50e-66b9-402f-9794-26221374d163 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:43.021227 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-20e2b50e-66b9-402f-9794-26221374d163 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:43.023499 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-9a136dc6-49e6-482f-9104-a98984821c8c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:43.024429 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-9a136dc6-49e6-482f-9104-a98984821c8c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:43.030627 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9a136dc6-49e6-482f-9104-a98984821c8c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:43.031077 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9a136dc6-49e6-482f-9104-a98984821c8c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:43.031847 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9a136dc6-49e6-482f-9104-a98984821c8c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:43.032282 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9a136dc6-49e6-482f-9104-a98984821c8c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:43.061982 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-9a136dc6-49e6-482f-9104-a98984821c8c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042872 Apr 08 11:27:43.065234 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 912/1808] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:43 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:27:43.082059 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-20e2b50e-66b9-402f-9794-26221374d163 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:43.090087 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-20e2b50e-66b9-402f-9794-26221374d163 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081969 Apr 08 11:27:43.090659 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 897/1809] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:43 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:43.525643 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-8b824520-0c09-4502-9a24-619cd163bb16 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:43.526291 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-8b824520-0c09-4502-9a24-619cd163bb16 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:43.532217 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8b824520-0c09-4502-9a24-619cd163bb16 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:43.532666 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8b824520-0c09-4502-9a24-619cd163bb16 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:43.533434 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8b824520-0c09-4502-9a24-619cd163bb16 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:43.533912 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-8b824520-0c09-4502-9a24-619cd163bb16 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:43.667954 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-8b824520-0c09-4502-9a24-619cd163bb16 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:43.675312 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-8b824520-0c09-4502-9a24-619cd163bb16 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.153517 Apr 08 11:27:43.675880 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 913/1810] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:43 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:44.073715 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-061f35c9-9e72-40ad-909c-c153838df962 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:44.074678 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-061f35c9-9e72-40ad-909c-c153838df962 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:44.080920 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-061f35c9-9e72-40ad-909c-c153838df962 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:44.081353 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-061f35c9-9e72-40ad-909c-c153838df962 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:44.082147 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-061f35c9-9e72-40ad-909c-c153838df962 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:44.082583 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-061f35c9-9e72-40ad-909c-c153838df962 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:44.106584 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-4ed5b7f5-e966-4f19-bc7a-55dcf7774e51 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:44.107207 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-4ed5b7f5-e966-4f19-bc7a-55dcf7774e51 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:44.110785 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-061f35c9-9e72-40ad-909c-c153838df962 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041078 Apr 08 11:27:44.111355 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 898/1811] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:44 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:44.113336 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4ed5b7f5-e966-4f19-bc7a-55dcf7774e51 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:44.114393 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4ed5b7f5-e966-4f19-bc7a-55dcf7774e51 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:44.115167 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4ed5b7f5-e966-4f19-bc7a-55dcf7774e51 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:44.115602 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-4ed5b7f5-e966-4f19-bc7a-55dcf7774e51 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:44.174428 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-4ed5b7f5-e966-4f19-bc7a-55dcf7774e51 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:44.181883 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-4ed5b7f5-e966-4f19-bc7a-55dcf7774e51 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079019 Apr 08 11:27:44.182460 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 914/1812] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:44 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:27:44.693303 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-33c0326a-39e7-4680-896d-a64d5269e7a9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:44.693952 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-33c0326a-39e7-4680-896d-a64d5269e7a9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:44.699930 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-33c0326a-39e7-4680-896d-a64d5269e7a9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:44.700381 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-33c0326a-39e7-4680-896d-a64d5269e7a9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:44.701153 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-33c0326a-39e7-4680-896d-a64d5269e7a9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:44.701592 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-33c0326a-39e7-4680-896d-a64d5269e7a9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:44.831893 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-33c0326a-39e7-4680-896d-a64d5269e7a9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:44.842271 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-33c0326a-39e7-4680-896d-a64d5269e7a9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.153302 Apr 08 11:27:44.842845 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 899/1813] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:44 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:45.123333 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-9d07bf15-8026-4e8b-a1a9-993c8a2c3cf8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:45.124274 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-9d07bf15-8026-4e8b-a1a9-993c8a2c3cf8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:45.131191 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9d07bf15-8026-4e8b-a1a9-993c8a2c3cf8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:45.131642 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9d07bf15-8026-4e8b-a1a9-993c8a2c3cf8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:45.132474 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9d07bf15-8026-4e8b-a1a9-993c8a2c3cf8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:45.132908 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-9d07bf15-8026-4e8b-a1a9-993c8a2c3cf8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:45.161091 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-9d07bf15-8026-4e8b-a1a9-993c8a2c3cf8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041623 Apr 08 11:27:45.161651 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 915/1814] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:45 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:45.199914 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5f6ab5de-c8d6-40b2-bf40-2ef3d6089e36 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:45.200527 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5f6ab5de-c8d6-40b2-bf40-2ef3d6089e36 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:45.206965 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5f6ab5de-c8d6-40b2-bf40-2ef3d6089e36 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:45.207475 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5f6ab5de-c8d6-40b2-bf40-2ef3d6089e36 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:45.208245 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5f6ab5de-c8d6-40b2-bf40-2ef3d6089e36 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:45.208684 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5f6ab5de-c8d6-40b2-bf40-2ef3d6089e36 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:45.284099 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5f6ab5de-c8d6-40b2-bf40-2ef3d6089e36 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:45.292134 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5f6ab5de-c8d6-40b2-bf40-2ef3d6089e36 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.096016 Apr 08 11:27:45.292730 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 900/1815] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:45 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:45.840903 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a86de029-1d7a-44e7-bc0b-f753747443e0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:45.842122 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a86de029-1d7a-44e7-bc0b-f753747443e0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:45.850097 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a86de029-1d7a-44e7-bc0b-f753747443e0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:45.850610 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a86de029-1d7a-44e7-bc0b-f753747443e0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:45.851456 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a86de029-1d7a-44e7-bc0b-f753747443e0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:45.852090 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a86de029-1d7a-44e7-bc0b-f753747443e0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:45.877812 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a86de029-1d7a-44e7-bc0b-f753747443e0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Going to try to terminate instance {{(pid=117801) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 08 11:27:45.930764 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-869d8de4-1678-44a0-870f-716c3e8f9e80 req-a046c569-76a5-4058-870c-ac6a5968274b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6031de3c-c187-4e54-b340-ad53edbe9ee6", "tag": "58170f46-0bda-4d91-90b4-61e81203f4f5"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:27:45.938689 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-869d8de4-1678-44a0-870f-716c3e8f9e80 req-a046c569-76a5-4058-870c-ac6a5968274b service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:45.939134 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-869d8de4-1678-44a0-870f-716c3e8f9e80 req-a046c569-76a5-4058-870c-ac6a5968274b service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:45.950041 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-869d8de4-1678-44a0-870f-716c3e8f9e80 req-a046c569-76a5-4058-870c-ac6a5968274b service nova] Creating event network-changed:58170f46-0bda-4d91-90b4-61e81203f4f5 for instance 6031de3c-c187-4e54-b340-ad53edbe9ee6 on hv-cinder-83607 Apr 08 11:27:45.956187 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-869d8de4-1678-44a0-870f-716c3e8f9e80 req-a046c569-76a5-4058-870c-ac6a5968274b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117157 Apr 08 11:27:45.956800 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 901/1816] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:46.173452 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c3b1a72a-0d52-416c-89f9-da2eeaa97855 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:46.174634 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c3b1a72a-0d52-416c-89f9-da2eeaa97855 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:46.178991 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a86de029-1d7a-44e7-bc0b-f753747443e0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 204 len: 0 microversion: 2.1 time: 0.342130 Apr 08 11:27:46.182740 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 916/1817] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 8 11:27:45 2022] DELETE /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 11:27:46.188199 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-403ee097-2818-41bb-9782-1f9856d2dc8e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:46.188909 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-403ee097-2818-41bb-9782-1f9856d2dc8e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:46.196875 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c3b1a72a-0d52-416c-89f9-da2eeaa97855 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:46.197460 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c3b1a72a-0d52-416c-89f9-da2eeaa97855 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:46.198592 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c3b1a72a-0d52-416c-89f9-da2eeaa97855 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:46.199254 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-403ee097-2818-41bb-9782-1f9856d2dc8e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:46.199533 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c3b1a72a-0d52-416c-89f9-da2eeaa97855 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:46.200114 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-403ee097-2818-41bb-9782-1f9856d2dc8e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:46.201085 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-403ee097-2818-41bb-9782-1f9856d2dc8e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:46.201697 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-403ee097-2818-41bb-9782-1f9856d2dc8e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:46.237875 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c3b1a72a-0d52-416c-89f9-da2eeaa97855 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068762 Apr 08 11:27:46.242181 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 902/1818] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:46 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:27:46.309567 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9c77973b-e1ee-4abb-8b22-db47c4e55eed tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:46.310289 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9c77973b-e1ee-4abb-8b22-db47c4e55eed tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:46.317390 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9c77973b-e1ee-4abb-8b22-db47c4e55eed tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:46.318152 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9c77973b-e1ee-4abb-8b22-db47c4e55eed tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:46.319148 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9c77973b-e1ee-4abb-8b22-db47c4e55eed tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:46.319753 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9c77973b-e1ee-4abb-8b22-db47c4e55eed tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:46.384888 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-403ee097-2818-41bb-9782-1f9856d2dc8e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:46.396197 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-403ee097-2818-41bb-9782-1f9856d2dc8e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1568 microversion: 2.1 time: 0.212130 Apr 08 11:27:46.397650 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 917/1819] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:46 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1568 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:46.399260 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9c77973b-e1ee-4abb-8b22-db47c4e55eed tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:46.406843 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9c77973b-e1ee-4abb-8b22-db47c4e55eed tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.101370 Apr 08 11:27:46.407351 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 903/1820] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:46 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:47.250166 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-ce909c67-de15-4fd0-9a9d-b929260e7206 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:47.251094 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-ce909c67-de15-4fd0-9a9d-b929260e7206 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:47.258056 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ce909c67-de15-4fd0-9a9d-b929260e7206 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:47.258515 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ce909c67-de15-4fd0-9a9d-b929260e7206 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:47.259290 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ce909c67-de15-4fd0-9a9d-b929260e7206 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:47.259732 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-ce909c67-de15-4fd0-9a9d-b929260e7206 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:47.288479 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-ce909c67-de15-4fd0-9a9d-b929260e7206 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042282 Apr 08 11:27:47.289049 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 918/1821] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:47 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:47.414618 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5ee3e16d-3700-401b-bed4-b107e41c68ee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:47.415240 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5ee3e16d-3700-401b-bed4-b107e41c68ee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:47.422140 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5ee3e16d-3700-401b-bed4-b107e41c68ee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:47.422601 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5ee3e16d-3700-401b-bed4-b107e41c68ee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:47.422742 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-eb83034e-0c46-4d11-b6ce-e1cc8be0c7e6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:47.423262 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-eb83034e-0c46-4d11-b6ce-e1cc8be0c7e6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:47.423416 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5ee3e16d-3700-401b-bed4-b107e41c68ee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:47.423807 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5ee3e16d-3700-401b-bed4-b107e41c68ee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:47.430194 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-eb83034e-0c46-4d11-b6ce-e1cc8be0c7e6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:47.430658 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-eb83034e-0c46-4d11-b6ce-e1cc8be0c7e6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:47.431438 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-eb83034e-0c46-4d11-b6ce-e1cc8be0c7e6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:47.431872 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-eb83034e-0c46-4d11-b6ce-e1cc8be0c7e6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:47.506584 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-eb83034e-0c46-4d11-b6ce-e1cc8be0c7e6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:47.514126 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-eb83034e-0c46-4d11-b6ce-e1cc8be0c7e6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.095372 Apr 08 11:27:47.514702 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 919/1822] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:47 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:27:47.581862 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5ee3e16d-3700-401b-bed4-b107e41c68ee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:47.590355 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5ee3e16d-3700-401b-bed4-b107e41c68ee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.179554 Apr 08 11:27:47.590940 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 904/1823] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:47 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:48.300242 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-7b935bee-4113-4274-a8e9-0c5d325987a9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:48.301647 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-7b935bee-4113-4274-a8e9-0c5d325987a9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:48.307954 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7b935bee-4113-4274-a8e9-0c5d325987a9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:48.308411 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7b935bee-4113-4274-a8e9-0c5d325987a9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:48.309214 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7b935bee-4113-4274-a8e9-0c5d325987a9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:48.309662 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-7b935bee-4113-4274-a8e9-0c5d325987a9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:48.337199 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-7b935bee-4113-4274-a8e9-0c5d325987a9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041044 Apr 08 11:27:48.337752 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 920/1824] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:48 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:48.531805 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d185e7ef-1475-4fbf-b27c-e4ebea1677bf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:48.532401 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d185e7ef-1475-4fbf-b27c-e4ebea1677bf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:48.538748 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d185e7ef-1475-4fbf-b27c-e4ebea1677bf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:48.539195 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d185e7ef-1475-4fbf-b27c-e4ebea1677bf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:48.539990 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d185e7ef-1475-4fbf-b27c-e4ebea1677bf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:48.540429 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d185e7ef-1475-4fbf-b27c-e4ebea1677bf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:48.602473 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d185e7ef-1475-4fbf-b27c-e4ebea1677bf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:48.608083 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a9487309-77fe-4765-b73e-d05016ec95f0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:48.608700 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a9487309-77fe-4765-b73e-d05016ec95f0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:48.610583 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d185e7ef-1475-4fbf-b27c-e4ebea1677bf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082620 Apr 08 11:27:48.619915 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 905/1825] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:48 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:48.623980 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a9487309-77fe-4765-b73e-d05016ec95f0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:48.624431 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a9487309-77fe-4765-b73e-d05016ec95f0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:48.625324 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a9487309-77fe-4765-b73e-d05016ec95f0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:48.625760 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a9487309-77fe-4765-b73e-d05016ec95f0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:48.761145 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a9487309-77fe-4765-b73e-d05016ec95f0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:48.768468 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a9487309-77fe-4765-b73e-d05016ec95f0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.164253 Apr 08 11:27:48.769047 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 921/1826] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:48 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:27:49.349482 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6528e56f-5d9a-4ddf-9273-dd11d61d9b7c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:49.350506 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6528e56f-5d9a-4ddf-9273-dd11d61d9b7c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:49.356585 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6528e56f-5d9a-4ddf-9273-dd11d61d9b7c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:49.357039 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6528e56f-5d9a-4ddf-9273-dd11d61d9b7c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:49.357857 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6528e56f-5d9a-4ddf-9273-dd11d61d9b7c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:49.358309 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6528e56f-5d9a-4ddf-9273-dd11d61d9b7c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:49.388533 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6528e56f-5d9a-4ddf-9273-dd11d61d9b7c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043577 Apr 08 11:27:49.389112 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 906/1827] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:49 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:49.627818 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a0bf5c99-79ae-4e46-890e-cdb15f4b6c22 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:49.628357 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a0bf5c99-79ae-4e46-890e-cdb15f4b6c22 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:49.634599 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a0bf5c99-79ae-4e46-890e-cdb15f4b6c22 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:49.635045 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a0bf5c99-79ae-4e46-890e-cdb15f4b6c22 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:49.635804 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a0bf5c99-79ae-4e46-890e-cdb15f4b6c22 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:49.636245 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a0bf5c99-79ae-4e46-890e-cdb15f4b6c22 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:49.696038 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-a0bf5c99-79ae-4e46-890e-cdb15f4b6c22 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:49.703362 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a0bf5c99-79ae-4e46-890e-cdb15f4b6c22 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079544 Apr 08 11:27:49.703926 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 922/1828] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:49 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:49.785872 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7d10534b-14ba-431d-a4ec-1b97fb75c0b2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:49.786520 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7d10534b-14ba-431d-a4ec-1b97fb75c0b2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:49.792787 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d10534b-14ba-431d-a4ec-1b97fb75c0b2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:49.793245 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d10534b-14ba-431d-a4ec-1b97fb75c0b2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:49.794045 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d10534b-14ba-431d-a4ec-1b97fb75c0b2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:49.794489 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d10534b-14ba-431d-a4ec-1b97fb75c0b2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:49.933171 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7d10534b-14ba-431d-a4ec-1b97fb75c0b2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:49.940655 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7d10534b-14ba-431d-a4ec-1b97fb75c0b2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.159173 Apr 08 11:27:49.941222 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 907/1829] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:49 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:50.400900 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-fde27866-a6be-4834-a807-0d7aec98b01b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:50.401863 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-fde27866-a6be-4834-a807-0d7aec98b01b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:50.407833 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fde27866-a6be-4834-a807-0d7aec98b01b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:50.408373 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fde27866-a6be-4834-a807-0d7aec98b01b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:50.409155 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fde27866-a6be-4834-a807-0d7aec98b01b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:50.409601 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-fde27866-a6be-4834-a807-0d7aec98b01b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:50.438241 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-fde27866-a6be-4834-a807-0d7aec98b01b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041259 Apr 08 11:27:50.438842 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 923/1830] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:50 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:50.720506 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-09cfd1d8-e243-4508-800c-a795cd6fba34 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:50.721037 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-09cfd1d8-e243-4508-800c-a795cd6fba34 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:50.726922 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-09cfd1d8-e243-4508-800c-a795cd6fba34 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:50.727373 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-09cfd1d8-e243-4508-800c-a795cd6fba34 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:50.728163 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-09cfd1d8-e243-4508-800c-a795cd6fba34 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:50.728596 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-09cfd1d8-e243-4508-800c-a795cd6fba34 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:50.786820 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-09cfd1d8-e243-4508-800c-a795cd6fba34 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:50.794483 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-09cfd1d8-e243-4508-800c-a795cd6fba34 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077935 Apr 08 11:27:50.795045 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 908/1831] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:50 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:50.960338 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-f5cbaa2e-c5f7-4fc5-8aae-0a6a50485022 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:50.960947 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-f5cbaa2e-c5f7-4fc5-8aae-0a6a50485022 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:50.966825 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f5cbaa2e-c5f7-4fc5-8aae-0a6a50485022 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:50.967279 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f5cbaa2e-c5f7-4fc5-8aae-0a6a50485022 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:50.968042 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f5cbaa2e-c5f7-4fc5-8aae-0a6a50485022 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:50.968479 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-f5cbaa2e-c5f7-4fc5-8aae-0a6a50485022 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:51.098503 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-f5cbaa2e-c5f7-4fc5-8aae-0a6a50485022 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:51.105907 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-f5cbaa2e-c5f7-4fc5-8aae-0a6a50485022 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.149392 Apr 08 11:27:51.106485 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 924/1832] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:50 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:51.449407 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ef0f5846-5713-40bd-ac65-1267a0fc3a9e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:51.450508 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ef0f5846-5713-40bd-ac65-1267a0fc3a9e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:51.457873 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ef0f5846-5713-40bd-ac65-1267a0fc3a9e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:51.458330 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ef0f5846-5713-40bd-ac65-1267a0fc3a9e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:51.459109 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ef0f5846-5713-40bd-ac65-1267a0fc3a9e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:51.459544 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ef0f5846-5713-40bd-ac65-1267a0fc3a9e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:51.492635 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ef0f5846-5713-40bd-ac65-1267a0fc3a9e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047217 Apr 08 11:27:51.493207 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 909/1833] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:51 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:51.811256 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-68a9dfa7-9ffd-49fd-801c-e2c178657c2a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:51.811868 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-68a9dfa7-9ffd-49fd-801c-e2c178657c2a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:51.819088 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-68a9dfa7-9ffd-49fd-801c-e2c178657c2a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:51.819545 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-68a9dfa7-9ffd-49fd-801c-e2c178657c2a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:51.820356 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-68a9dfa7-9ffd-49fd-801c-e2c178657c2a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:51.822108 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-68a9dfa7-9ffd-49fd-801c-e2c178657c2a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:51.888460 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-68a9dfa7-9ffd-49fd-801c-e2c178657c2a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:51.896046 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-68a9dfa7-9ffd-49fd-801c-e2c178657c2a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.088701 Apr 08 11:27:51.896620 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 925/1834] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:51 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:52.123826 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6fff5849-a13e-472a-9292-bbd0264934fb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:52.124388 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6fff5849-a13e-472a-9292-bbd0264934fb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:52.130660 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6fff5849-a13e-472a-9292-bbd0264934fb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:52.131113 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6fff5849-a13e-472a-9292-bbd0264934fb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:52.131887 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6fff5849-a13e-472a-9292-bbd0264934fb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:52.132323 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6fff5849-a13e-472a-9292-bbd0264934fb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:52.278626 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6fff5849-a13e-472a-9292-bbd0264934fb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:52.286655 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6fff5849-a13e-472a-9292-bbd0264934fb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.166788 Apr 08 11:27:52.287209 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 910/1835] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:52 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:52.504315 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-89a846ff-8519-4f46-a83d-85f7b90a4dfc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:52.505146 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-89a846ff-8519-4f46-a83d-85f7b90a4dfc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:52.511270 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-89a846ff-8519-4f46-a83d-85f7b90a4dfc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:52.511815 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-89a846ff-8519-4f46-a83d-85f7b90a4dfc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:52.512592 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-89a846ff-8519-4f46-a83d-85f7b90a4dfc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:52.513038 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-89a846ff-8519-4f46-a83d-85f7b90a4dfc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:52.542275 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-89a846ff-8519-4f46-a83d-85f7b90a4dfc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041905 Apr 08 11:27:52.542846 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 926/1836] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:52 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:52.913415 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b5d692c2-a2fc-47e1-b4be-2f1160fcbb9d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:52.914055 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b5d692c2-a2fc-47e1-b4be-2f1160fcbb9d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:52.920004 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b5d692c2-a2fc-47e1-b4be-2f1160fcbb9d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:52.920450 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b5d692c2-a2fc-47e1-b4be-2f1160fcbb9d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:52.921217 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b5d692c2-a2fc-47e1-b4be-2f1160fcbb9d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:52.921660 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b5d692c2-a2fc-47e1-b4be-2f1160fcbb9d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:52.980487 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b5d692c2-a2fc-47e1-b4be-2f1160fcbb9d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:52.987796 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b5d692c2-a2fc-47e1-b4be-2f1160fcbb9d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078282 Apr 08 11:27:52.988366 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 911/1837] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:52 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:53.303558 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-e7cafa95-264c-4b30-9b5a-3465f8699cf8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:53.304160 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-e7cafa95-264c-4b30-9b5a-3465f8699cf8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:53.310578 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e7cafa95-264c-4b30-9b5a-3465f8699cf8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:53.311023 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e7cafa95-264c-4b30-9b5a-3465f8699cf8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:53.311778 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e7cafa95-264c-4b30-9b5a-3465f8699cf8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:53.312212 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-e7cafa95-264c-4b30-9b5a-3465f8699cf8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:53.459048 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-e7cafa95-264c-4b30-9b5a-3465f8699cf8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:53.466381 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-e7cafa95-264c-4b30-9b5a-3465f8699cf8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.166717 Apr 08 11:27:53.466941 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 927/1838] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:53 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:53.554739 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-34c06f16-e79e-4404-b8c0-b0db7cd44420 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:53.555675 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-34c06f16-e79e-4404-b8c0-b0db7cd44420 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:53.562124 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-34c06f16-e79e-4404-b8c0-b0db7cd44420 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:53.562584 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-34c06f16-e79e-4404-b8c0-b0db7cd44420 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:53.563362 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-34c06f16-e79e-4404-b8c0-b0db7cd44420 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:53.563802 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-34c06f16-e79e-4404-b8c0-b0db7cd44420 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:53.592106 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-34c06f16-e79e-4404-b8c0-b0db7cd44420 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042003 Apr 08 11:27:53.592652 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 912/1839] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:53 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:54.004924 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-14ce4043-ab99-4378-8c94-cb56e5e35ba7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:54.005539 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-14ce4043-ab99-4378-8c94-cb56e5e35ba7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:54.011486 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-14ce4043-ab99-4378-8c94-cb56e5e35ba7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:54.011939 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-14ce4043-ab99-4378-8c94-cb56e5e35ba7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:54.012722 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-14ce4043-ab99-4378-8c94-cb56e5e35ba7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:54.013166 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-14ce4043-ab99-4378-8c94-cb56e5e35ba7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:54.071095 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-14ce4043-ab99-4378-8c94-cb56e5e35ba7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:54.079423 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-14ce4043-ab99-4378-8c94-cb56e5e35ba7 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078492 Apr 08 11:27:54.080012 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 928/1840] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:53 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:54.483407 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-959f6fdb-24e7-449e-961a-e94425433fa3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:54.484025 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-959f6fdb-24e7-449e-961a-e94425433fa3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:54.489907 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-959f6fdb-24e7-449e-961a-e94425433fa3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:54.490465 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-959f6fdb-24e7-449e-961a-e94425433fa3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:54.491239 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-959f6fdb-24e7-449e-961a-e94425433fa3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:54.492024 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-959f6fdb-24e7-449e-961a-e94425433fa3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:54.604380 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-692c0026-ac82-4fed-8ab5-8abf972cd82a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:54.605198 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-692c0026-ac82-4fed-8ab5-8abf972cd82a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:54.611505 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-692c0026-ac82-4fed-8ab5-8abf972cd82a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:54.611961 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-692c0026-ac82-4fed-8ab5-8abf972cd82a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:54.612740 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-692c0026-ac82-4fed-8ab5-8abf972cd82a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:54.613185 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-692c0026-ac82-4fed-8ab5-8abf972cd82a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:54.626930 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-959f6fdb-24e7-449e-961a-e94425433fa3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:54.634887 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-959f6fdb-24e7-449e-961a-e94425433fa3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.155294 Apr 08 11:27:54.638846 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 913/1841] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:54 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:54.643314 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-692c0026-ac82-4fed-8ab5-8abf972cd82a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042971 Apr 08 11:27:54.644101 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 929/1842] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:54 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:55.096517 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0d3f49bb-c1cf-4799-a6d9-64e9ea5bbef9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:55.097131 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0d3f49bb-c1cf-4799-a6d9-64e9ea5bbef9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:55.103717 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0d3f49bb-c1cf-4799-a6d9-64e9ea5bbef9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:55.104167 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0d3f49bb-c1cf-4799-a6d9-64e9ea5bbef9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:55.104938 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0d3f49bb-c1cf-4799-a6d9-64e9ea5bbef9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:55.105378 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0d3f49bb-c1cf-4799-a6d9-64e9ea5bbef9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:55.163671 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0d3f49bb-c1cf-4799-a6d9-64e9ea5bbef9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:55.170946 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0d3f49bb-c1cf-4799-a6d9-64e9ea5bbef9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078302 Apr 08 11:27:55.171512 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 914/1843] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:55 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:55.652682 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-b2a9b587-04d6-4d1b-84ef-9896aae5cce5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:55.653297 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-b2a9b587-04d6-4d1b-84ef-9896aae5cce5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:55.655501 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1120b704-47c2-4873-8279-5b8176f93371 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:55.656447 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1120b704-47c2-4873-8279-5b8176f93371 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:55.660616 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b2a9b587-04d6-4d1b-84ef-9896aae5cce5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:55.661069 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b2a9b587-04d6-4d1b-84ef-9896aae5cce5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:55.661874 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b2a9b587-04d6-4d1b-84ef-9896aae5cce5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:55.662311 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-b2a9b587-04d6-4d1b-84ef-9896aae5cce5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:55.663282 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1120b704-47c2-4873-8279-5b8176f93371 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:55.663742 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1120b704-47c2-4873-8279-5b8176f93371 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:55.664522 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1120b704-47c2-4873-8279-5b8176f93371 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:55.665173 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1120b704-47c2-4873-8279-5b8176f93371 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:55.693521 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1120b704-47c2-4873-8279-5b8176f93371 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041914 Apr 08 11:27:55.694129 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 915/1844] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:55 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:27:55.808943 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-b2a9b587-04d6-4d1b-84ef-9896aae5cce5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:55.816963 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-b2a9b587-04d6-4d1b-84ef-9896aae5cce5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.167641 Apr 08 11:27:55.817521 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 930/1845] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:55 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:56.188347 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4382f5c1-6ce4-46fe-87fe-5d33d98c5660 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:56.188955 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4382f5c1-6ce4-46fe-87fe-5d33d98c5660 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:56.195671 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4382f5c1-6ce4-46fe-87fe-5d33d98c5660 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:56.196113 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4382f5c1-6ce4-46fe-87fe-5d33d98c5660 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:56.196883 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4382f5c1-6ce4-46fe-87fe-5d33d98c5660 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:56.197317 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4382f5c1-6ce4-46fe-87fe-5d33d98c5660 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:56.257118 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4382f5c1-6ce4-46fe-87fe-5d33d98c5660 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:56.264671 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4382f5c1-6ce4-46fe-87fe-5d33d98c5660 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080245 Apr 08 11:27:56.265237 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 916/1846] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:56 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:56.705507 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-6f4925a5-8a48-4788-80a2-22bcc03c989e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:56.706493 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-6f4925a5-8a48-4788-80a2-22bcc03c989e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:56.713037 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6f4925a5-8a48-4788-80a2-22bcc03c989e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:56.713611 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6f4925a5-8a48-4788-80a2-22bcc03c989e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:56.714421 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6f4925a5-8a48-4788-80a2-22bcc03c989e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:56.714860 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6f4925a5-8a48-4788-80a2-22bcc03c989e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:56.744751 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-6f4925a5-8a48-4788-80a2-22bcc03c989e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043622 Apr 08 11:27:56.745313 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 931/1847] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:56 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:56.833103 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d7b71406-1f58-4179-be1d-08f0ad036ca2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:56.833789 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d7b71406-1f58-4179-be1d-08f0ad036ca2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:56.839684 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d7b71406-1f58-4179-be1d-08f0ad036ca2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:56.840197 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d7b71406-1f58-4179-be1d-08f0ad036ca2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:56.840967 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d7b71406-1f58-4179-be1d-08f0ad036ca2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:56.841403 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d7b71406-1f58-4179-be1d-08f0ad036ca2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:56.978136 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d7b71406-1f58-4179-be1d-08f0ad036ca2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:56.985584 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d7b71406-1f58-4179-be1d-08f0ad036ca2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.156455 Apr 08 11:27:56.986221 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 917/1848] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:56 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:57.281346 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-15111cd2-27d8-433d-887d-207dfa3f934f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:57.282005 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-15111cd2-27d8-433d-887d-207dfa3f934f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:57.288662 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-15111cd2-27d8-433d-887d-207dfa3f934f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:57.289127 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-15111cd2-27d8-433d-887d-207dfa3f934f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:57.289936 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-15111cd2-27d8-433d-887d-207dfa3f934f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:57.290383 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-15111cd2-27d8-433d-887d-207dfa3f934f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:57.348931 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-15111cd2-27d8-433d-887d-207dfa3f934f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:57.356428 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-15111cd2-27d8-433d-887d-207dfa3f934f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079096 Apr 08 11:27:57.356993 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 932/1849] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:57 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:57.757258 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-830e3067-d09d-4a59-b6d8-72d7ae03adb0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:57.758233 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-830e3067-d09d-4a59-b6d8-72d7ae03adb0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:57.764548 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-830e3067-d09d-4a59-b6d8-72d7ae03adb0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:57.765105 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-830e3067-d09d-4a59-b6d8-72d7ae03adb0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:57.765909 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-830e3067-d09d-4a59-b6d8-72d7ae03adb0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:57.766254 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-830e3067-d09d-4a59-b6d8-72d7ae03adb0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:57.794359 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-830e3067-d09d-4a59-b6d8-72d7ae03adb0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041681 Apr 08 11:27:57.794921 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 918/1850] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:57 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:58.003590 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-d506363c-eb04-427b-86be-0f338b9d2368 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:58.004708 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-d506363c-eb04-427b-86be-0f338b9d2368 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:58.011088 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d506363c-eb04-427b-86be-0f338b9d2368 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:58.011543 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d506363c-eb04-427b-86be-0f338b9d2368 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:58.012326 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d506363c-eb04-427b-86be-0f338b9d2368 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:58.012767 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-d506363c-eb04-427b-86be-0f338b9d2368 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:58.160906 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-d506363c-eb04-427b-86be-0f338b9d2368 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:58.168801 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-d506363c-eb04-427b-86be-0f338b9d2368 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.169446 Apr 08 11:27:58.169374 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 933/1851] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:57 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:58.373632 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-65b9c4bc-3f25-4c2a-bc8e-0e78db3b86d5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:58.374298 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-65b9c4bc-3f25-4c2a-bc8e-0e78db3b86d5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:58.380190 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-65b9c4bc-3f25-4c2a-bc8e-0e78db3b86d5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:58.380635 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-65b9c4bc-3f25-4c2a-bc8e-0e78db3b86d5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:58.381405 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-65b9c4bc-3f25-4c2a-bc8e-0e78db3b86d5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:58.381861 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-65b9c4bc-3f25-4c2a-bc8e-0e78db3b86d5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:58.440040 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-65b9c4bc-3f25-4c2a-bc8e-0e78db3b86d5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:58.447741 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-65b9c4bc-3f25-4c2a-bc8e-0e78db3b86d5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078051 Apr 08 11:27:58.448306 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 919/1852] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:58 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:58.806177 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-a75de3cf-c259-4b14-94db-7be85a2a426d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:58.807113 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-a75de3cf-c259-4b14-94db-7be85a2a426d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:58.812968 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a75de3cf-c259-4b14-94db-7be85a2a426d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:58.813414 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a75de3cf-c259-4b14-94db-7be85a2a426d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:58.814214 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a75de3cf-c259-4b14-94db-7be85a2a426d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:58.814653 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-a75de3cf-c259-4b14-94db-7be85a2a426d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:58.844536 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-a75de3cf-c259-4b14-94db-7be85a2a426d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042361 Apr 08 11:27:58.845095 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 934/1853] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:58 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:27:59.186955 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d6d16053-fdb0-4da6-9825-63e9606b0cf8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:59.187578 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d6d16053-fdb0-4da6-9825-63e9606b0cf8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:59.194561 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d6d16053-fdb0-4da6-9825-63e9606b0cf8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:59.195018 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d6d16053-fdb0-4da6-9825-63e9606b0cf8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:59.195792 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d6d16053-fdb0-4da6-9825-63e9606b0cf8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:59.196237 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d6d16053-fdb0-4da6-9825-63e9606b0cf8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:59.332254 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d6d16053-fdb0-4da6-9825-63e9606b0cf8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:59.339796 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d6d16053-fdb0-4da6-9825-63e9606b0cf8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.156739 Apr 08 11:27:59.340381 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 920/1854] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:59 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:59.464783 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-00241b5e-9129-4df8-a4b0-1d9b28ebce95 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:59.465332 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-00241b5e-9129-4df8-a4b0-1d9b28ebce95 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:59.471687 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-00241b5e-9129-4df8-a4b0-1d9b28ebce95 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:59.472139 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-00241b5e-9129-4df8-a4b0-1d9b28ebce95 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:59.477477 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-00241b5e-9129-4df8-a4b0-1d9b28ebce95 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:59.477477 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-00241b5e-9129-4df8-a4b0-1d9b28ebce95 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:59.532747 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-00241b5e-9129-4df8-a4b0-1d9b28ebce95 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:27:59.540569 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-00241b5e-9129-4df8-a4b0-1d9b28ebce95 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079732 Apr 08 11:27:59.541148 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 935/1855] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:27:59 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:27:59.856362 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-918fe8c0-0762-4713-ae78-3557cee3cd4f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:27:59.857292 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-918fe8c0-0762-4713-ae78-3557cee3cd4f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:27:59.863825 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-918fe8c0-0762-4713-ae78-3557cee3cd4f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:59.864279 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-918fe8c0-0762-4713-ae78-3557cee3cd4f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:59.865045 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-918fe8c0-0762-4713-ae78-3557cee3cd4f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:27:59.865484 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-918fe8c0-0762-4713-ae78-3557cee3cd4f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:27:59.894599 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-918fe8c0-0762-4713-ae78-3557cee3cd4f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041785 Apr 08 11:27:59.895137 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 921/1856] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:27:59 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:28:00.356784 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.api.openstack.wsgi [None req-6018d931-82b1-44bb-a8b3-b1ab8c70339a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:00.357391 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.compute.api [None req-6018d931-82b1-44bb-a8b3-b1ab8c70339a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117801) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:00.363351 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6018d931-82b1-44bb-a8b3-b1ab8c70339a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:00.363794 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6018d931-82b1-44bb-a8b3-b1ab8c70339a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:00.364550 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6018d931-82b1-44bb-a8b3-b1ab8c70339a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:00.364982 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG oslo_concurrency.lockutils [None req-6018d931-82b1-44bb-a8b3-b1ab8c70339a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:00.498062 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: DEBUG nova.policy [None req-6018d931-82b1-44bb-a8b3-b1ab8c70339a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117801) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:00.505976 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: INFO nova.api.openstack.requestlog [None req-6018d931-82b1-44bb-a8b3-b1ab8c70339a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.153029 Apr 08 11:28:00.506974 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: [pid: 117801|app: 0|req: 936/1857] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:00 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:00.557068 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-00e9c318-629c-462d-a128-4a648f5cee17 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:00.557681 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-00e9c318-629c-462d-a128-4a648f5cee17 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:00.564428 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-00e9c318-629c-462d-a128-4a648f5cee17 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:00.564936 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-00e9c318-629c-462d-a128-4a648f5cee17 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:00.565722 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-00e9c318-629c-462d-a128-4a648f5cee17 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:00.566768 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-00e9c318-629c-462d-a128-4a648f5cee17 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:00.629561 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-00e9c318-629c-462d-a128-4a648f5cee17 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:00.637030 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-00e9c318-629c-462d-a128-4a648f5cee17 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.083756 Apr 08 11:28:00.643919 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 922/1858] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:00 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:00.913107 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: Traceback (most recent call last): Apr 08 11:28:00.913107 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Apr 08 11:28:00.913107 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: timer() Apr 08 11:28:00.913107 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Apr 08 11:28:00.913107 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: cb(*args, **kw) Apr 08 11:28:00.913107 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire Apr 08 11:28:00.913107 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: waiter.switch() Apr 08 11:28:00.913107 dv-cinder-836074-3-iscsi devstack@n-api.service[117801]: greenlet.error: cannot switch to a different thread Apr 08 11:28:01.523205 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e438c815-bda3-4de7-88a5-86998aba84a2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:01.523818 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e438c815-bda3-4de7-88a5-86998aba84a2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:01.530025 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e438c815-bda3-4de7-88a5-86998aba84a2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:01.530473 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e438c815-bda3-4de7-88a5-86998aba84a2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:01.531263 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e438c815-bda3-4de7-88a5-86998aba84a2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:01.531701 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e438c815-bda3-4de7-88a5-86998aba84a2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:01.667270 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e438c815-bda3-4de7-88a5-86998aba84a2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:01.674678 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e438c815-bda3-4de7-88a5-86998aba84a2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.155881 Apr 08 11:28:01.675323 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 923/1859] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:01 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:01.679680 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-eea066bc-00b3-4917-8850-90df62e1012a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:01.680295 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-eea066bc-00b3-4917-8850-90df62e1012a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:01.685876 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-eea066bc-00b3-4917-8850-90df62e1012a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:01.686333 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-eea066bc-00b3-4917-8850-90df62e1012a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:01.687117 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-eea066bc-00b3-4917-8850-90df62e1012a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:01.687560 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-eea066bc-00b3-4917-8850-90df62e1012a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:01.746197 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-eea066bc-00b3-4917-8850-90df62e1012a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:01.753525 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-eea066bc-00b3-4917-8850-90df62e1012a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077251 Apr 08 11:28:01.754140 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 924/1860] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:01 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:02.692554 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e2ade6e4-4641-4ba2-b6fb-f75954bf2499 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:02.693251 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e2ade6e4-4641-4ba2-b6fb-f75954bf2499 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:02.699753 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e2ade6e4-4641-4ba2-b6fb-f75954bf2499 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:02.700201 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e2ade6e4-4641-4ba2-b6fb-f75954bf2499 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:02.700962 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e2ade6e4-4641-4ba2-b6fb-f75954bf2499 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:02.701401 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e2ade6e4-4641-4ba2-b6fb-f75954bf2499 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:02.836665 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e2ade6e4-4641-4ba2-b6fb-f75954bf2499 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:02.844826 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e2ade6e4-4641-4ba2-b6fb-f75954bf2499 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.156658 Apr 08 11:28:02.845599 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 925/1861] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:02 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:02.853903 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6d9846e1-ed43-412d-b286-ea83350b9b12 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:02.854510 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6d9846e1-ed43-412d-b286-ea83350b9b12 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:02.860579 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6d9846e1-ed43-412d-b286-ea83350b9b12 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:02.861033 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6d9846e1-ed43-412d-b286-ea83350b9b12 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:02.861839 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6d9846e1-ed43-412d-b286-ea83350b9b12 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:02.862283 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6d9846e1-ed43-412d-b286-ea83350b9b12 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:02.921760 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6d9846e1-ed43-412d-b286-ea83350b9b12 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:02.929138 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6d9846e1-ed43-412d-b286-ea83350b9b12 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082482 Apr 08 11:28:02.929705 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 926/1862] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:02 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:03.863145 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2bc21238-08ee-4afc-80cb-e5140ce18755 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:03.863788 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2bc21238-08ee-4afc-80cb-e5140ce18755 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:03.870425 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2bc21238-08ee-4afc-80cb-e5140ce18755 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:03.870878 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2bc21238-08ee-4afc-80cb-e5140ce18755 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:03.871655 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2bc21238-08ee-4afc-80cb-e5140ce18755 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:03.872098 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2bc21238-08ee-4afc-80cb-e5140ce18755 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:04.004013 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2bc21238-08ee-4afc-80cb-e5140ce18755 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:04.011242 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2bc21238-08ee-4afc-80cb-e5140ce18755 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.152496 Apr 08 11:28:04.011811 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 927/1863] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:03 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:04.016195 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6739d04c-d833-4fb9-8d45-b6d410052501 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:04.016797 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6739d04c-d833-4fb9-8d45-b6d410052501 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:04.022211 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6739d04c-d833-4fb9-8d45-b6d410052501 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:04.022664 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6739d04c-d833-4fb9-8d45-b6d410052501 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:04.023426 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6739d04c-d833-4fb9-8d45-b6d410052501 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:04.023864 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6739d04c-d833-4fb9-8d45-b6d410052501 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:04.085812 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6739d04c-d833-4fb9-8d45-b6d410052501 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:04.093088 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6739d04c-d833-4fb9-8d45-b6d410052501 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080339 Apr 08 11:28:04.093663 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 928/1864] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:04 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:05.028429 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-68aeaa0c-0ba7-4e27-b326-9c9d9684fa81 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:05.029543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-68aeaa0c-0ba7-4e27-b326-9c9d9684fa81 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:05.036111 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-68aeaa0c-0ba7-4e27-b326-9c9d9684fa81 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:05.036561 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-68aeaa0c-0ba7-4e27-b326-9c9d9684fa81 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:05.037339 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-68aeaa0c-0ba7-4e27-b326-9c9d9684fa81 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:05.037789 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-68aeaa0c-0ba7-4e27-b326-9c9d9684fa81 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:05.172626 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-68aeaa0c-0ba7-4e27-b326-9c9d9684fa81 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:05.180024 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-68aeaa0c-0ba7-4e27-b326-9c9d9684fa81 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.155417 Apr 08 11:28:05.180597 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 929/1865] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:05 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:05.185181 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6b2119cb-6ebd-4d43-9837-32ce37832dab tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:05.185615 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6b2119cb-6ebd-4d43-9837-32ce37832dab tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:05.191207 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6b2119cb-6ebd-4d43-9837-32ce37832dab tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:05.191649 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6b2119cb-6ebd-4d43-9837-32ce37832dab tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:05.192415 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6b2119cb-6ebd-4d43-9837-32ce37832dab tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:05.192850 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6b2119cb-6ebd-4d43-9837-32ce37832dab tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:05.251338 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6b2119cb-6ebd-4d43-9837-32ce37832dab tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:05.258648 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6b2119cb-6ebd-4d43-9837-32ce37832dab tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077125 Apr 08 11:28:05.259224 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 930/1866] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:05 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:06.197538 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-be64f128-81a7-41a6-a7eb-3f0e67d56c1b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:06.198242 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-be64f128-81a7-41a6-a7eb-3f0e67d56c1b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:06.204641 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-be64f128-81a7-41a6-a7eb-3f0e67d56c1b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:06.205091 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-be64f128-81a7-41a6-a7eb-3f0e67d56c1b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:06.205894 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-be64f128-81a7-41a6-a7eb-3f0e67d56c1b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:06.206868 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-be64f128-81a7-41a6-a7eb-3f0e67d56c1b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:06.343202 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-be64f128-81a7-41a6-a7eb-3f0e67d56c1b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:06.350601 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-be64f128-81a7-41a6-a7eb-3f0e67d56c1b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.156997 Apr 08 11:28:06.351175 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 931/1867] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:06 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:06.355596 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f465c9e7-5241-4054-ae8f-ffe1f8af9bd3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:06.356193 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f465c9e7-5241-4054-ae8f-ffe1f8af9bd3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:06.361955 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f465c9e7-5241-4054-ae8f-ffe1f8af9bd3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:06.362414 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f465c9e7-5241-4054-ae8f-ffe1f8af9bd3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:06.363196 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f465c9e7-5241-4054-ae8f-ffe1f8af9bd3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:06.363639 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f465c9e7-5241-4054-ae8f-ffe1f8af9bd3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:06.422704 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f465c9e7-5241-4054-ae8f-ffe1f8af9bd3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:06.430003 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f465c9e7-5241-4054-ae8f-ffe1f8af9bd3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077873 Apr 08 11:28:06.430578 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 932/1868] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:06 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:07.368633 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2e29378c-07cc-4f9d-a4ff-edb77d820a54 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:07.369318 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2e29378c-07cc-4f9d-a4ff-edb77d820a54 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:07.375527 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2e29378c-07cc-4f9d-a4ff-edb77d820a54 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:07.375983 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2e29378c-07cc-4f9d-a4ff-edb77d820a54 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:07.376747 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2e29378c-07cc-4f9d-a4ff-edb77d820a54 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:07.377189 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2e29378c-07cc-4f9d-a4ff-edb77d820a54 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:07.517126 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2e29378c-07cc-4f9d-a4ff-edb77d820a54 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:07.525125 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2e29378c-07cc-4f9d-a4ff-edb77d820a54 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.160597 Apr 08 11:28:07.525703 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 933/1869] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:07 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:07.530224 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b7c86e40-06e6-4877-aa99-0a9b5099db81 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:07.530829 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b7c86e40-06e6-4877-aa99-0a9b5099db81 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:07.538047 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b7c86e40-06e6-4877-aa99-0a9b5099db81 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:07.538500 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b7c86e40-06e6-4877-aa99-0a9b5099db81 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:07.539282 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b7c86e40-06e6-4877-aa99-0a9b5099db81 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:07.539723 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b7c86e40-06e6-4877-aa99-0a9b5099db81 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:07.598160 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b7c86e40-06e6-4877-aa99-0a9b5099db81 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:07.605753 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b7c86e40-06e6-4877-aa99-0a9b5099db81 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079062 Apr 08 11:28:07.606355 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 934/1870] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:07 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:08.541896 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-47c6f27e-2faa-4780-8666-56bceab32257 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:08.542573 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-47c6f27e-2faa-4780-8666-56bceab32257 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:08.548794 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-47c6f27e-2faa-4780-8666-56bceab32257 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:08.549243 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-47c6f27e-2faa-4780-8666-56bceab32257 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:08.550586 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-47c6f27e-2faa-4780-8666-56bceab32257 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:08.551037 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-47c6f27e-2faa-4780-8666-56bceab32257 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:08.687394 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-47c6f27e-2faa-4780-8666-56bceab32257 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:08.694714 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-47c6f27e-2faa-4780-8666-56bceab32257 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.156733 Apr 08 11:28:08.695284 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 935/1871] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:08 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:08.699710 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-47bafd77-b969-478b-bb97-2438b0532546 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:08.700309 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-47bafd77-b969-478b-bb97-2438b0532546 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:08.706036 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-47bafd77-b969-478b-bb97-2438b0532546 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:08.706486 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-47bafd77-b969-478b-bb97-2438b0532546 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:08.707252 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-47bafd77-b969-478b-bb97-2438b0532546 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:08.707690 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-47bafd77-b969-478b-bb97-2438b0532546 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:08.765709 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-47bafd77-b969-478b-bb97-2438b0532546 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:08.773054 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-47bafd77-b969-478b-bb97-2438b0532546 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.076838 Apr 08 11:28:08.773626 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 936/1872] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:08 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:09.711710 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-cb9ae955-7dcc-4f41-9bc6-f7a15b437c44 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:09.712340 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-cb9ae955-7dcc-4f41-9bc6-f7a15b437c44 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:09.718585 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cb9ae955-7dcc-4f41-9bc6-f7a15b437c44 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:09.719039 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cb9ae955-7dcc-4f41-9bc6-f7a15b437c44 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:09.719803 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cb9ae955-7dcc-4f41-9bc6-f7a15b437c44 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:09.720265 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cb9ae955-7dcc-4f41-9bc6-f7a15b437c44 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:09.857494 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-cb9ae955-7dcc-4f41-9bc6-f7a15b437c44 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:09.865540 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-cb9ae955-7dcc-4f41-9bc6-f7a15b437c44 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.157670 Apr 08 11:28:09.866146 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 937/1873] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:09 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:09.870887 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b99498cf-f982-42e2-913f-7b7e5f2d13ed tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:09.871496 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b99498cf-f982-42e2-913f-7b7e5f2d13ed tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:09.877164 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b99498cf-f982-42e2-913f-7b7e5f2d13ed tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:09.877620 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b99498cf-f982-42e2-913f-7b7e5f2d13ed tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:09.878997 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b99498cf-f982-42e2-913f-7b7e5f2d13ed tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:09.879445 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b99498cf-f982-42e2-913f-7b7e5f2d13ed tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:09.937284 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b99498cf-f982-42e2-913f-7b7e5f2d13ed tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:09.945568 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b99498cf-f982-42e2-913f-7b7e5f2d13ed tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078160 Apr 08 11:28:09.946195 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 938/1874] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:09 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:10.883746 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ed1bc335-c523-429d-9ad8-b67b02cb11d0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:10.884491 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ed1bc335-c523-429d-9ad8-b67b02cb11d0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:10.890592 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ed1bc335-c523-429d-9ad8-b67b02cb11d0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:10.891040 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ed1bc335-c523-429d-9ad8-b67b02cb11d0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:10.891808 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ed1bc335-c523-429d-9ad8-b67b02cb11d0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:10.892246 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ed1bc335-c523-429d-9ad8-b67b02cb11d0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:11.025285 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ed1bc335-c523-429d-9ad8-b67b02cb11d0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:11.032669 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ed1bc335-c523-429d-9ad8-b67b02cb11d0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.152773 Apr 08 11:28:11.033239 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 939/1875] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:10 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:11.038253 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a3ce255e-649f-40a3-8fca-27c2c14ecd8f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:11.038896 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a3ce255e-649f-40a3-8fca-27c2c14ecd8f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:11.044337 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a3ce255e-649f-40a3-8fca-27c2c14ecd8f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:11.044790 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a3ce255e-649f-40a3-8fca-27c2c14ecd8f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:11.045563 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a3ce255e-649f-40a3-8fca-27c2c14ecd8f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:11.046034 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a3ce255e-649f-40a3-8fca-27c2c14ecd8f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:11.103759 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a3ce255e-649f-40a3-8fca-27c2c14ecd8f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:11.111018 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a3ce255e-649f-40a3-8fca-27c2c14ecd8f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.076852 Apr 08 11:28:11.111587 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 940/1876] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:11 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:12.050816 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7d562ca9-a38e-430d-8c52-51ac9ea633fb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:12.051420 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7d562ca9-a38e-430d-8c52-51ac9ea633fb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:12.058010 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d562ca9-a38e-430d-8c52-51ac9ea633fb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:12.058441 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d562ca9-a38e-430d-8c52-51ac9ea633fb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:12.059217 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d562ca9-a38e-430d-8c52-51ac9ea633fb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:12.059650 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d562ca9-a38e-430d-8c52-51ac9ea633fb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:12.198456 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7d562ca9-a38e-430d-8c52-51ac9ea633fb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:12.206122 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7d562ca9-a38e-430d-8c52-51ac9ea633fb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.159617 Apr 08 11:28:12.206698 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 941/1877] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:12 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:12.211602 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-635b1b5c-07e7-45f2-aed6-a32c20d75cb9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:12.212191 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-635b1b5c-07e7-45f2-aed6-a32c20d75cb9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:12.217820 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-635b1b5c-07e7-45f2-aed6-a32c20d75cb9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:12.218270 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-635b1b5c-07e7-45f2-aed6-a32c20d75cb9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:12.219034 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-635b1b5c-07e7-45f2-aed6-a32c20d75cb9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:12.219465 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-635b1b5c-07e7-45f2-aed6-a32c20d75cb9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:12.279528 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-635b1b5c-07e7-45f2-aed6-a32c20d75cb9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:12.287475 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-635b1b5c-07e7-45f2-aed6-a32c20d75cb9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079786 Apr 08 11:28:12.287979 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 942/1878] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:12 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:13.223764 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-cced4065-2fcc-406a-8fe8-0b42c60487ea tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:13.224455 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-cced4065-2fcc-406a-8fe8-0b42c60487ea tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:13.230772 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cced4065-2fcc-406a-8fe8-0b42c60487ea tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:13.231218 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cced4065-2fcc-406a-8fe8-0b42c60487ea tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:13.231988 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cced4065-2fcc-406a-8fe8-0b42c60487ea tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:13.232416 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cced4065-2fcc-406a-8fe8-0b42c60487ea tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:13.363427 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-cced4065-2fcc-406a-8fe8-0b42c60487ea tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:13.371007 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-cced4065-2fcc-406a-8fe8-0b42c60487ea tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.151257 Apr 08 11:28:13.371601 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 943/1879] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:13 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:13.376108 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-fb66b8e1-a3a7-4e62-9414-6d4b5ee8738d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:13.376711 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-fb66b8e1-a3a7-4e62-9414-6d4b5ee8738d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:13.383176 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fb66b8e1-a3a7-4e62-9414-6d4b5ee8738d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:13.383626 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fb66b8e1-a3a7-4e62-9414-6d4b5ee8738d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:13.384401 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fb66b8e1-a3a7-4e62-9414-6d4b5ee8738d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:13.384839 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fb66b8e1-a3a7-4e62-9414-6d4b5ee8738d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:13.447341 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-fb66b8e1-a3a7-4e62-9414-6d4b5ee8738d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:13.454720 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-fb66b8e1-a3a7-4e62-9414-6d4b5ee8738d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082187 Apr 08 11:28:13.455291 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 944/1880] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:13 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:14.388760 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e637722c-38b0-4710-ba77-64869a7af19a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:14.389399 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e637722c-38b0-4710-ba77-64869a7af19a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:14.395681 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e637722c-38b0-4710-ba77-64869a7af19a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:14.396141 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e637722c-38b0-4710-ba77-64869a7af19a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:14.396916 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e637722c-38b0-4710-ba77-64869a7af19a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:14.397357 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e637722c-38b0-4710-ba77-64869a7af19a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:14.531481 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e637722c-38b0-4710-ba77-64869a7af19a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:14.539718 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e637722c-38b0-4710-ba77-64869a7af19a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.155008 Apr 08 11:28:14.540301 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 945/1881] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:14 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:14.544702 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e268a698-8d0f-4ee3-a33d-2c3f31661ccf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:14.545315 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e268a698-8d0f-4ee3-a33d-2c3f31661ccf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:14.551658 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e268a698-8d0f-4ee3-a33d-2c3f31661ccf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:14.552111 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e268a698-8d0f-4ee3-a33d-2c3f31661ccf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:14.552884 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e268a698-8d0f-4ee3-a33d-2c3f31661ccf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:14.553324 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e268a698-8d0f-4ee3-a33d-2c3f31661ccf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:14.611705 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e268a698-8d0f-4ee3-a33d-2c3f31661ccf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:14.619922 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e268a698-8d0f-4ee3-a33d-2c3f31661ccf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078630 Apr 08 11:28:14.620494 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 946/1882] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:14 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:15.557093 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0d8542e9-1578-42aa-bf86-948a4c9581a0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:15.557754 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0d8542e9-1578-42aa-bf86-948a4c9581a0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:15.564138 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0d8542e9-1578-42aa-bf86-948a4c9581a0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:15.564596 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0d8542e9-1578-42aa-bf86-948a4c9581a0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:15.565467 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0d8542e9-1578-42aa-bf86-948a4c9581a0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:15.565846 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0d8542e9-1578-42aa-bf86-948a4c9581a0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:15.704447 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0d8542e9-1578-42aa-bf86-948a4c9581a0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:15.712563 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0d8542e9-1578-42aa-bf86-948a4c9581a0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.159323 Apr 08 11:28:15.713132 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 947/1883] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:15 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:15.717531 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a7b25132-6114-45bc-9fea-4ffed7532d8d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:15.718165 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a7b25132-6114-45bc-9fea-4ffed7532d8d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:15.724718 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a7b25132-6114-45bc-9fea-4ffed7532d8d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:15.725172 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a7b25132-6114-45bc-9fea-4ffed7532d8d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:15.725974 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a7b25132-6114-45bc-9fea-4ffed7532d8d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:15.726415 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a7b25132-6114-45bc-9fea-4ffed7532d8d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:15.784870 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a7b25132-6114-45bc-9fea-4ffed7532d8d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:15.792197 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a7b25132-6114-45bc-9fea-4ffed7532d8d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078119 Apr 08 11:28:15.792763 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 948/1884] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:15 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:16.730194 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-77a4a1f1-579e-478e-9fc6-ae2c166f396f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:16.730880 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-77a4a1f1-579e-478e-9fc6-ae2c166f396f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:16.737135 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-77a4a1f1-579e-478e-9fc6-ae2c166f396f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:16.737579 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-77a4a1f1-579e-478e-9fc6-ae2c166f396f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:16.738433 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-77a4a1f1-579e-478e-9fc6-ae2c166f396f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:16.738867 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-77a4a1f1-579e-478e-9fc6-ae2c166f396f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:16.869105 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-77a4a1f1-579e-478e-9fc6-ae2c166f396f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:16.876386 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-77a4a1f1-579e-478e-9fc6-ae2c166f396f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.149990 Apr 08 11:28:16.876962 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 949/1885] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:16 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:16.881809 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-deda3ae7-4060-4859-b2b6-4b3d42bcdfe6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:16.882419 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-deda3ae7-4060-4859-b2b6-4b3d42bcdfe6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:16.887895 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-deda3ae7-4060-4859-b2b6-4b3d42bcdfe6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:16.888343 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-deda3ae7-4060-4859-b2b6-4b3d42bcdfe6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:16.889108 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-deda3ae7-4060-4859-b2b6-4b3d42bcdfe6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:16.889547 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-deda3ae7-4060-4859-b2b6-4b3d42bcdfe6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:16.950393 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-deda3ae7-4060-4859-b2b6-4b3d42bcdfe6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:16.958303 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-deda3ae7-4060-4859-b2b6-4b3d42bcdfe6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080408 Apr 08 11:28:16.958868 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 950/1886] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:16 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:17.894520 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e0f1e7a3-9fb1-44e2-a5b1-1f4baa1bc7a9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:17.895198 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e0f1e7a3-9fb1-44e2-a5b1-1f4baa1bc7a9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:17.901581 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e0f1e7a3-9fb1-44e2-a5b1-1f4baa1bc7a9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:17.902041 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e0f1e7a3-9fb1-44e2-a5b1-1f4baa1bc7a9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:17.902817 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e0f1e7a3-9fb1-44e2-a5b1-1f4baa1bc7a9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:17.903261 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e0f1e7a3-9fb1-44e2-a5b1-1f4baa1bc7a9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:18.036391 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e0f1e7a3-9fb1-44e2-a5b1-1f4baa1bc7a9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:18.043933 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e0f1e7a3-9fb1-44e2-a5b1-1f4baa1bc7a9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.153860 Apr 08 11:28:18.044500 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 951/1887] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:17 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:18.048977 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b2d5a3f5-62f3-4efd-8c99-1210886436fd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:18.050142 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b2d5a3f5-62f3-4efd-8c99-1210886436fd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:18.055744 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b2d5a3f5-62f3-4efd-8c99-1210886436fd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:18.056191 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b2d5a3f5-62f3-4efd-8c99-1210886436fd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:18.056951 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b2d5a3f5-62f3-4efd-8c99-1210886436fd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:18.057385 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b2d5a3f5-62f3-4efd-8c99-1210886436fd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:18.116010 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b2d5a3f5-62f3-4efd-8c99-1210886436fd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:18.123678 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b2d5a3f5-62f3-4efd-8c99-1210886436fd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078245 Apr 08 11:28:18.124243 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 952/1888] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:18 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:19.061413 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-55af29a5-c20f-4a90-8106-69a43ec73ca0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:19.062114 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-55af29a5-c20f-4a90-8106-69a43ec73ca0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:19.068899 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-55af29a5-c20f-4a90-8106-69a43ec73ca0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:19.069355 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-55af29a5-c20f-4a90-8106-69a43ec73ca0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:19.070162 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-55af29a5-c20f-4a90-8106-69a43ec73ca0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:19.070608 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-55af29a5-c20f-4a90-8106-69a43ec73ca0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:19.206334 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-55af29a5-c20f-4a90-8106-69a43ec73ca0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:19.213660 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-55af29a5-c20f-4a90-8106-69a43ec73ca0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.156121 Apr 08 11:28:19.214252 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 953/1889] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:19 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:19.218543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-dc1d2e84-83f0-48ba-8061-34e17b102409 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:19.219140 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-dc1d2e84-83f0-48ba-8061-34e17b102409 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:19.224600 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dc1d2e84-83f0-48ba-8061-34e17b102409 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:19.225049 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dc1d2e84-83f0-48ba-8061-34e17b102409 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:19.225839 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dc1d2e84-83f0-48ba-8061-34e17b102409 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:19.226273 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dc1d2e84-83f0-48ba-8061-34e17b102409 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:19.285141 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-dc1d2e84-83f0-48ba-8061-34e17b102409 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:19.292453 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-dc1d2e84-83f0-48ba-8061-34e17b102409 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077268 Apr 08 11:28:19.293022 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 954/1890] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:19 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:20.230714 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1c0e6ab3-e21e-4621-9039-e0e9a46d6249 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:20.231391 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1c0e6ab3-e21e-4621-9039-e0e9a46d6249 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:20.237941 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1c0e6ab3-e21e-4621-9039-e0e9a46d6249 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:20.238389 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1c0e6ab3-e21e-4621-9039-e0e9a46d6249 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:20.239172 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1c0e6ab3-e21e-4621-9039-e0e9a46d6249 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:20.239619 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1c0e6ab3-e21e-4621-9039-e0e9a46d6249 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:20.373347 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1c0e6ab3-e21e-4621-9039-e0e9a46d6249 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:20.380739 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1c0e6ab3-e21e-4621-9039-e0e9a46d6249 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.153902 Apr 08 11:28:20.381311 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 955/1891] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:20 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:20.385635 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ce1b49e2-fce9-4303-b049-34fe12337994 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:20.386268 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ce1b49e2-fce9-4303-b049-34fe12337994 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:20.391719 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ce1b49e2-fce9-4303-b049-34fe12337994 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:20.392175 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ce1b49e2-fce9-4303-b049-34fe12337994 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:20.392936 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ce1b49e2-fce9-4303-b049-34fe12337994 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:20.393918 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ce1b49e2-fce9-4303-b049-34fe12337994 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:20.461246 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ce1b49e2-fce9-4303-b049-34fe12337994 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:20.468667 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ce1b49e2-fce9-4303-b049-34fe12337994 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.086374 Apr 08 11:28:20.469251 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 956/1892] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:20 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:21.397600 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-96ed90db-c50e-4af8-a3af-e34a7fd265b9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:21.398308 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-96ed90db-c50e-4af8-a3af-e34a7fd265b9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:21.404543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-96ed90db-c50e-4af8-a3af-e34a7fd265b9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:21.404992 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-96ed90db-c50e-4af8-a3af-e34a7fd265b9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:21.405760 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-96ed90db-c50e-4af8-a3af-e34a7fd265b9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:21.406293 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-96ed90db-c50e-4af8-a3af-e34a7fd265b9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:21.540334 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-96ed90db-c50e-4af8-a3af-e34a7fd265b9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:21.547716 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-96ed90db-c50e-4af8-a3af-e34a7fd265b9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.153983 Apr 08 11:28:21.548291 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 957/1893] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:21 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:21.553684 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-11b28e8c-e5f6-42ce-b3b3-b7524b57a4b3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:21.554321 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-11b28e8c-e5f6-42ce-b3b3-b7524b57a4b3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:21.559931 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-11b28e8c-e5f6-42ce-b3b3-b7524b57a4b3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:21.560383 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-11b28e8c-e5f6-42ce-b3b3-b7524b57a4b3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:21.561157 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-11b28e8c-e5f6-42ce-b3b3-b7524b57a4b3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:21.561601 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-11b28e8c-e5f6-42ce-b3b3-b7524b57a4b3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:21.619813 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-11b28e8c-e5f6-42ce-b3b3-b7524b57a4b3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:21.627172 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-11b28e8c-e5f6-42ce-b3b3-b7524b57a4b3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077952 Apr 08 11:28:21.627739 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 958/1894] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:21 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:22.564148 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f6530b76-fdf4-456e-9a26-df51dd705d13 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:22.564843 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f6530b76-fdf4-456e-9a26-df51dd705d13 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:22.571649 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f6530b76-fdf4-456e-9a26-df51dd705d13 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:22.572103 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f6530b76-fdf4-456e-9a26-df51dd705d13 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:22.572874 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f6530b76-fdf4-456e-9a26-df51dd705d13 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:22.573317 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f6530b76-fdf4-456e-9a26-df51dd705d13 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:22.720253 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f6530b76-fdf4-456e-9a26-df51dd705d13 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:22.727732 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f6530b76-fdf4-456e-9a26-df51dd705d13 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.167455 Apr 08 11:28:22.728614 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 959/1895] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:22 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:22.732952 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-376705fb-73e0-4416-8013-abd4fc69f646 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:22.733571 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-376705fb-73e0-4416-8013-abd4fc69f646 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:22.739809 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-376705fb-73e0-4416-8013-abd4fc69f646 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:22.740264 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-376705fb-73e0-4416-8013-abd4fc69f646 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:22.741060 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-376705fb-73e0-4416-8013-abd4fc69f646 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:22.741483 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-376705fb-73e0-4416-8013-abd4fc69f646 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:22.800821 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-376705fb-73e0-4416-8013-abd4fc69f646 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:22.808121 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-376705fb-73e0-4416-8013-abd4fc69f646 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078749 Apr 08 11:28:22.808688 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 960/1896] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:22 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:23.744887 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6818a554-2eb3-4e08-8760-8690a0e89be7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:23.745537 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6818a554-2eb3-4e08-8760-8690a0e89be7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:23.751974 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6818a554-2eb3-4e08-8760-8690a0e89be7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:23.752934 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6818a554-2eb3-4e08-8760-8690a0e89be7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:23.753711 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6818a554-2eb3-4e08-8760-8690a0e89be7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:23.754179 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6818a554-2eb3-4e08-8760-8690a0e89be7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:23.885425 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6818a554-2eb3-4e08-8760-8690a0e89be7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:23.892871 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6818a554-2eb3-4e08-8760-8690a0e89be7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.152171 Apr 08 11:28:23.894082 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 961/1897] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:23 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:23.898454 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-20475795-012e-4ebf-83dc-141ee9786744 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:23.899058 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-20475795-012e-4ebf-83dc-141ee9786744 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:23.904653 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-20475795-012e-4ebf-83dc-141ee9786744 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:23.905107 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-20475795-012e-4ebf-83dc-141ee9786744 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:23.905907 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-20475795-012e-4ebf-83dc-141ee9786744 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:23.906351 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-20475795-012e-4ebf-83dc-141ee9786744 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:23.968220 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-20475795-012e-4ebf-83dc-141ee9786744 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:23.975720 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-20475795-012e-4ebf-83dc-141ee9786744 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080654 Apr 08 11:28:23.976294 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 962/1898] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:23 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:24.911657 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-46d6c71b-9db1-45ac-a848-4a6b16ad2795 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:24.912282 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-46d6c71b-9db1-45ac-a848-4a6b16ad2795 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:24.918568 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-46d6c71b-9db1-45ac-a848-4a6b16ad2795 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:24.919022 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-46d6c71b-9db1-45ac-a848-4a6b16ad2795 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:24.919914 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-46d6c71b-9db1-45ac-a848-4a6b16ad2795 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:24.920361 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-46d6c71b-9db1-45ac-a848-4a6b16ad2795 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:25.053087 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-46d6c71b-9db1-45ac-a848-4a6b16ad2795 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:25.060395 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-46d6c71b-9db1-45ac-a848-4a6b16ad2795 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.153290 Apr 08 11:28:25.060968 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 963/1899] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:24 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:25.066177 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a381dd6b-9687-446f-b032-a473f92b18bb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:25.066719 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a381dd6b-9687-446f-b032-a473f92b18bb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:25.072193 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a381dd6b-9687-446f-b032-a473f92b18bb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:25.072642 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a381dd6b-9687-446f-b032-a473f92b18bb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:25.073403 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a381dd6b-9687-446f-b032-a473f92b18bb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:25.073866 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a381dd6b-9687-446f-b032-a473f92b18bb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:25.132092 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a381dd6b-9687-446f-b032-a473f92b18bb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:25.140715 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a381dd6b-9687-446f-b032-a473f92b18bb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078812 Apr 08 11:28:25.141282 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 964/1900] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:25 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:26.077940 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-36b748c2-3409-4567-bdf1-7bd993d52a3d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:26.078691 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-36b748c2-3409-4567-bdf1-7bd993d52a3d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:26.085628 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-36b748c2-3409-4567-bdf1-7bd993d52a3d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:26.086114 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-36b748c2-3409-4567-bdf1-7bd993d52a3d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:26.086891 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-36b748c2-3409-4567-bdf1-7bd993d52a3d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:26.087336 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-36b748c2-3409-4567-bdf1-7bd993d52a3d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:26.219502 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-36b748c2-3409-4567-bdf1-7bd993d52a3d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:26.227049 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-36b748c2-3409-4567-bdf1-7bd993d52a3d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.152961 Apr 08 11:28:26.227625 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 965/1901] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:26 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:26.232055 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2ec91dbe-8f33-478c-9f31-993a633d06e0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:26.232660 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2ec91dbe-8f33-478c-9f31-993a633d06e0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:26.239166 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2ec91dbe-8f33-478c-9f31-993a633d06e0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:26.239614 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2ec91dbe-8f33-478c-9f31-993a633d06e0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:26.240387 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2ec91dbe-8f33-478c-9f31-993a633d06e0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:26.240823 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2ec91dbe-8f33-478c-9f31-993a633d06e0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:26.301799 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2ec91dbe-8f33-478c-9f31-993a633d06e0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:26.309080 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2ec91dbe-8f33-478c-9f31-993a633d06e0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080514 Apr 08 11:28:26.309643 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 966/1902] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:26 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:27.244270 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-46faecc6-6332-45b7-aa76-e65f31a24078 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:27.244952 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-46faecc6-6332-45b7-aa76-e65f31a24078 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:27.251312 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-46faecc6-6332-45b7-aa76-e65f31a24078 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:27.251768 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-46faecc6-6332-45b7-aa76-e65f31a24078 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:27.253193 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-46faecc6-6332-45b7-aa76-e65f31a24078 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:27.253635 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-46faecc6-6332-45b7-aa76-e65f31a24078 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:27.387120 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-46faecc6-6332-45b7-aa76-e65f31a24078 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:27.394456 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-46faecc6-6332-45b7-aa76-e65f31a24078 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.154314 Apr 08 11:28:27.395025 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 967/1903] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:27 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:27.399526 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-65081e73-ac91-4a06-861c-f190680c28ea tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:27.400139 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-65081e73-ac91-4a06-861c-f190680c28ea tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:27.405556 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-65081e73-ac91-4a06-861c-f190680c28ea tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:27.406044 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-65081e73-ac91-4a06-861c-f190680c28ea tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:27.406817 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-65081e73-ac91-4a06-861c-f190680c28ea tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:27.407261 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-65081e73-ac91-4a06-861c-f190680c28ea tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:27.464739 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-65081e73-ac91-4a06-861c-f190680c28ea tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:27.472530 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-65081e73-ac91-4a06-861c-f190680c28ea tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.076563 Apr 08 11:28:27.473101 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 968/1904] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:27 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:28.411695 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d95f8834-97e5-4ded-ab25-22add7f3a5df tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:28.412333 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d95f8834-97e5-4ded-ab25-22add7f3a5df tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:28.418647 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d95f8834-97e5-4ded-ab25-22add7f3a5df tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:28.419102 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d95f8834-97e5-4ded-ab25-22add7f3a5df tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:28.419875 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d95f8834-97e5-4ded-ab25-22add7f3a5df tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:28.420316 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d95f8834-97e5-4ded-ab25-22add7f3a5df tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:28.566937 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d95f8834-97e5-4ded-ab25-22add7f3a5df tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:28.575022 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d95f8834-97e5-4ded-ab25-22add7f3a5df tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.167472 Apr 08 11:28:28.575924 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 969/1905] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:28 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:28.580370 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-38d89834-0950-45fc-a865-eabef677354a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:28.580977 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-38d89834-0950-45fc-a865-eabef677354a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:28.587189 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-38d89834-0950-45fc-a865-eabef677354a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:28.587325 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-38d89834-0950-45fc-a865-eabef677354a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:28.588095 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-38d89834-0950-45fc-a865-eabef677354a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:28.588535 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-38d89834-0950-45fc-a865-eabef677354a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:28.655089 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-38d89834-0950-45fc-a865-eabef677354a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:28.659397 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-38d89834-0950-45fc-a865-eabef677354a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082462 Apr 08 11:28:28.659979 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 970/1906] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:28 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:29.592128 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3bda2900-c4c7-4081-a3f3-75b56fb3fdfb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:29.592815 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3bda2900-c4c7-4081-a3f3-75b56fb3fdfb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:29.599296 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3bda2900-c4c7-4081-a3f3-75b56fb3fdfb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:29.599840 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3bda2900-c4c7-4081-a3f3-75b56fb3fdfb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:29.600530 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3bda2900-c4c7-4081-a3f3-75b56fb3fdfb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:29.600976 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3bda2900-c4c7-4081-a3f3-75b56fb3fdfb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:29.733933 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3bda2900-c4c7-4081-a3f3-75b56fb3fdfb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:29.741562 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3bda2900-c4c7-4081-a3f3-75b56fb3fdfb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.153269 Apr 08 11:28:29.742406 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 971/1907] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:29 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:29.747078 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8dbd9846-c2be-496f-b276-9c81854da599 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:29.747693 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8dbd9846-c2be-496f-b276-9c81854da599 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:29.754228 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8dbd9846-c2be-496f-b276-9c81854da599 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:29.754678 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8dbd9846-c2be-496f-b276-9c81854da599 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:29.755440 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8dbd9846-c2be-496f-b276-9c81854da599 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:29.755882 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8dbd9846-c2be-496f-b276-9c81854da599 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:29.819324 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8dbd9846-c2be-496f-b276-9c81854da599 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:29.827243 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8dbd9846-c2be-496f-b276-9c81854da599 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.083674 Apr 08 11:28:29.828363 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 972/1908] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:29 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:30.758785 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-90c62d03-4b05-45a7-8662-466f60cea782 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:30.759477 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-90c62d03-4b05-45a7-8662-466f60cea782 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:30.765758 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-90c62d03-4b05-45a7-8662-466f60cea782 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:30.766229 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-90c62d03-4b05-45a7-8662-466f60cea782 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:30.766995 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-90c62d03-4b05-45a7-8662-466f60cea782 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:30.767432 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-90c62d03-4b05-45a7-8662-466f60cea782 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:30.901137 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-90c62d03-4b05-45a7-8662-466f60cea782 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:30.910844 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-90c62d03-4b05-45a7-8662-466f60cea782 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.155854 Apr 08 11:28:30.911428 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 973/1909] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:30 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:30.915872 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f0b243c3-c9e7-4aec-8c92-bbe9b02a8a29 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:30.916477 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f0b243c3-c9e7-4aec-8c92-bbe9b02a8a29 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:30.922105 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f0b243c3-c9e7-4aec-8c92-bbe9b02a8a29 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:30.922556 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f0b243c3-c9e7-4aec-8c92-bbe9b02a8a29 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:30.923323 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f0b243c3-c9e7-4aec-8c92-bbe9b02a8a29 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:30.923762 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f0b243c3-c9e7-4aec-8c92-bbe9b02a8a29 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:30.984342 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f0b243c3-c9e7-4aec-8c92-bbe9b02a8a29 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:30.992091 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f0b243c3-c9e7-4aec-8c92-bbe9b02a8a29 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079412 Apr 08 11:28:30.992666 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 974/1910] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:30 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:31.928486 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-da381395-c886-4edd-9eef-513c9f90c565 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:31.929171 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-da381395-c886-4edd-9eef-513c9f90c565 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:31.935390 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-da381395-c886-4edd-9eef-513c9f90c565 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:31.935843 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-da381395-c886-4edd-9eef-513c9f90c565 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:31.936622 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-da381395-c886-4edd-9eef-513c9f90c565 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:31.937067 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-da381395-c886-4edd-9eef-513c9f90c565 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:32.075937 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-da381395-c886-4edd-9eef-513c9f90c565 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:32.083582 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-da381395-c886-4edd-9eef-513c9f90c565 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.159559 Apr 08 11:28:32.084273 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 975/1911] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:31 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:32.088753 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-03a39cdc-fd8e-420d-9d09-3f701a3d9d4e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:32.089360 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-03a39cdc-fd8e-420d-9d09-3f701a3d9d4e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:32.096299 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-03a39cdc-fd8e-420d-9d09-3f701a3d9d4e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:32.096803 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-03a39cdc-fd8e-420d-9d09-3f701a3d9d4e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:32.097588 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-03a39cdc-fd8e-420d-9d09-3f701a3d9d4e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:32.098054 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-03a39cdc-fd8e-420d-9d09-3f701a3d9d4e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:32.156858 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-03a39cdc-fd8e-420d-9d09-3f701a3d9d4e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:32.164843 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-03a39cdc-fd8e-420d-9d09-3f701a3d9d4e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079629 Apr 08 11:28:32.165412 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 976/1912] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:32 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:33.099922 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3b709b75-1524-44b9-8aa5-3b6ccd9c54d7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:33.100744 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3b709b75-1524-44b9-8aa5-3b6ccd9c54d7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:33.107130 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3b709b75-1524-44b9-8aa5-3b6ccd9c54d7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:33.108790 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3b709b75-1524-44b9-8aa5-3b6ccd9c54d7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:33.108790 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3b709b75-1524-44b9-8aa5-3b6ccd9c54d7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:33.108790 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3b709b75-1524-44b9-8aa5-3b6ccd9c54d7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:33.243797 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3b709b75-1524-44b9-8aa5-3b6ccd9c54d7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:33.251358 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3b709b75-1524-44b9-8aa5-3b6ccd9c54d7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.155326 Apr 08 11:28:33.251936 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 977/1913] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:33 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:33.256789 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f12bfc5c-4979-4722-99da-39b8b7b754f5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:33.257395 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f12bfc5c-4979-4722-99da-39b8b7b754f5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:33.263174 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f12bfc5c-4979-4722-99da-39b8b7b754f5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:33.263627 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f12bfc5c-4979-4722-99da-39b8b7b754f5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:33.264400 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f12bfc5c-4979-4722-99da-39b8b7b754f5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:33.264843 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f12bfc5c-4979-4722-99da-39b8b7b754f5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:33.322845 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f12bfc5c-4979-4722-99da-39b8b7b754f5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:33.330115 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f12bfc5c-4979-4722-99da-39b8b7b754f5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077187 Apr 08 11:28:33.330713 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 978/1914] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:33 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:34.268956 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e4b6d275-5698-4e36-ba25-84ec90b117f7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:34.269646 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e4b6d275-5698-4e36-ba25-84ec90b117f7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:34.275763 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e4b6d275-5698-4e36-ba25-84ec90b117f7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:34.276206 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e4b6d275-5698-4e36-ba25-84ec90b117f7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:34.276960 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e4b6d275-5698-4e36-ba25-84ec90b117f7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:34.277391 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e4b6d275-5698-4e36-ba25-84ec90b117f7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:34.424459 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e4b6d275-5698-4e36-ba25-84ec90b117f7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:34.432761 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e4b6d275-5698-4e36-ba25-84ec90b117f7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.167621 Apr 08 11:28:34.433329 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 979/1915] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:34 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:34.437655 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-511e3585-18d5-458f-8d1a-4d78430b8169 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:34.438284 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-511e3585-18d5-458f-8d1a-4d78430b8169 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:34.443995 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-511e3585-18d5-458f-8d1a-4d78430b8169 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:34.444473 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-511e3585-18d5-458f-8d1a-4d78430b8169 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:34.445302 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-511e3585-18d5-458f-8d1a-4d78430b8169 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:34.445746 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-511e3585-18d5-458f-8d1a-4d78430b8169 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:34.504410 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-511e3585-18d5-458f-8d1a-4d78430b8169 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:34.511722 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-511e3585-18d5-458f-8d1a-4d78430b8169 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077431 Apr 08 11:28:34.512289 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 980/1916] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:34 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:35.450231 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4018ab20-be9b-4909-a76c-cb30db6f70e5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:35.450899 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4018ab20-be9b-4909-a76c-cb30db6f70e5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:35.457735 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4018ab20-be9b-4909-a76c-cb30db6f70e5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:35.458221 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4018ab20-be9b-4909-a76c-cb30db6f70e5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:35.458991 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4018ab20-be9b-4909-a76c-cb30db6f70e5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:35.459435 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4018ab20-be9b-4909-a76c-cb30db6f70e5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:35.594054 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4018ab20-be9b-4909-a76c-cb30db6f70e5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:35.601652 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4018ab20-be9b-4909-a76c-cb30db6f70e5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.155289 Apr 08 11:28:35.602265 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 981/1917] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:35 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:35.606672 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ec350845-5653-4943-8d81-bfc84cb0b524 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:35.607281 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ec350845-5653-4943-8d81-bfc84cb0b524 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:35.612848 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ec350845-5653-4943-8d81-bfc84cb0b524 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:35.613274 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ec350845-5653-4943-8d81-bfc84cb0b524 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:35.614081 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ec350845-5653-4943-8d81-bfc84cb0b524 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:35.614526 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ec350845-5653-4943-8d81-bfc84cb0b524 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:35.673475 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ec350845-5653-4943-8d81-bfc84cb0b524 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:35.680963 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ec350845-5653-4943-8d81-bfc84cb0b524 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077737 Apr 08 11:28:35.681542 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 982/1918] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:35 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:36.619136 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-071eb1f1-4fd2-4dde-9822-2cf3fe311e7c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:36.619836 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-071eb1f1-4fd2-4dde-9822-2cf3fe311e7c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:36.626075 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-071eb1f1-4fd2-4dde-9822-2cf3fe311e7c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:36.626531 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-071eb1f1-4fd2-4dde-9822-2cf3fe311e7c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:36.627311 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-071eb1f1-4fd2-4dde-9822-2cf3fe311e7c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:36.627755 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-071eb1f1-4fd2-4dde-9822-2cf3fe311e7c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:36.763243 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-071eb1f1-4fd2-4dde-9822-2cf3fe311e7c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:36.771129 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-071eb1f1-4fd2-4dde-9822-2cf3fe311e7c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.156205 Apr 08 11:28:36.771700 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 983/1919] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:36 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:36.776063 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2f45e7b2-af75-4779-937c-3b822adcd985 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:36.776669 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2f45e7b2-af75-4779-937c-3b822adcd985 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:36.782146 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2f45e7b2-af75-4779-937c-3b822adcd985 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:36.782601 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2f45e7b2-af75-4779-937c-3b822adcd985 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:36.783965 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2f45e7b2-af75-4779-937c-3b822adcd985 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:36.784407 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2f45e7b2-af75-4779-937c-3b822adcd985 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:36.841279 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2f45e7b2-af75-4779-937c-3b822adcd985 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:36.849400 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2f45e7b2-af75-4779-937c-3b822adcd985 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.076733 Apr 08 11:28:36.850044 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 984/1920] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:36 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:37.788856 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b297a81a-ff9d-49c7-82e9-2aa313c394eb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:37.789562 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b297a81a-ff9d-49c7-82e9-2aa313c394eb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:37.795928 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b297a81a-ff9d-49c7-82e9-2aa313c394eb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:37.796379 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b297a81a-ff9d-49c7-82e9-2aa313c394eb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:37.797154 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b297a81a-ff9d-49c7-82e9-2aa313c394eb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:37.797595 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b297a81a-ff9d-49c7-82e9-2aa313c394eb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:37.935059 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b297a81a-ff9d-49c7-82e9-2aa313c394eb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:37.942459 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b297a81a-ff9d-49c7-82e9-2aa313c394eb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.157505 Apr 08 11:28:37.943028 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 985/1921] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:37 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:37.947428 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-61048790-7e19-4fa4-90f4-577dbfbcb078 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:37.948035 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-61048790-7e19-4fa4-90f4-577dbfbcb078 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:37.955129 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-61048790-7e19-4fa4-90f4-577dbfbcb078 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:37.955591 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-61048790-7e19-4fa4-90f4-577dbfbcb078 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:37.956377 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-61048790-7e19-4fa4-90f4-577dbfbcb078 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:37.956822 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-61048790-7e19-4fa4-90f4-577dbfbcb078 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:38.016568 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-61048790-7e19-4fa4-90f4-577dbfbcb078 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:38.024090 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-61048790-7e19-4fa4-90f4-577dbfbcb078 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080090 Apr 08 11:28:38.024677 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 986/1922] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:37 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:38.959570 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-844f7ee5-3c08-41e0-87dd-7afe1bfa8526 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:38.960260 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-844f7ee5-3c08-41e0-87dd-7afe1bfa8526 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:38.966544 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-844f7ee5-3c08-41e0-87dd-7afe1bfa8526 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:38.966986 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-844f7ee5-3c08-41e0-87dd-7afe1bfa8526 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:38.967745 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-844f7ee5-3c08-41e0-87dd-7afe1bfa8526 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:38.968178 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-844f7ee5-3c08-41e0-87dd-7afe1bfa8526 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:39.108126 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-844f7ee5-3c08-41e0-87dd-7afe1bfa8526 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:39.115976 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-844f7ee5-3c08-41e0-87dd-7afe1bfa8526 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.160425 Apr 08 11:28:39.116542 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 987/1923] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:38 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:39.121437 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-96bdf7c6-0351-41a4-ab69-487095677611 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:39.122069 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-96bdf7c6-0351-41a4-ab69-487095677611 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:39.128147 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-96bdf7c6-0351-41a4-ab69-487095677611 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:39.128601 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-96bdf7c6-0351-41a4-ab69-487095677611 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:39.129380 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-96bdf7c6-0351-41a4-ab69-487095677611 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:39.129850 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-96bdf7c6-0351-41a4-ab69-487095677611 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:39.190968 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-96bdf7c6-0351-41a4-ab69-487095677611 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:39.198241 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-96bdf7c6-0351-41a4-ab69-487095677611 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080475 Apr 08 11:28:39.198806 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 988/1924] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:39 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:40.134907 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-33b37532-da7b-4494-be58-892048fc2340 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:40.135597 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-33b37532-da7b-4494-be58-892048fc2340 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:40.142796 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-33b37532-da7b-4494-be58-892048fc2340 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:40.143256 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-33b37532-da7b-4494-be58-892048fc2340 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:40.144047 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-33b37532-da7b-4494-be58-892048fc2340 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:40.144490 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-33b37532-da7b-4494-be58-892048fc2340 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:40.276277 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-33b37532-da7b-4494-be58-892048fc2340 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:40.284234 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-33b37532-da7b-4494-be58-892048fc2340 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.154289 Apr 08 11:28:40.284802 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 989/1925] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:40 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:40.289113 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-45e517f8-6866-4b61-b1ac-20fdd29d8d61 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:40.289715 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-45e517f8-6866-4b61-b1ac-20fdd29d8d61 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:40.295444 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-45e517f8-6866-4b61-b1ac-20fdd29d8d61 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:40.295899 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-45e517f8-6866-4b61-b1ac-20fdd29d8d61 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:40.296679 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-45e517f8-6866-4b61-b1ac-20fdd29d8d61 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:40.297120 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-45e517f8-6866-4b61-b1ac-20fdd29d8d61 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:40.355172 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-45e517f8-6866-4b61-b1ac-20fdd29d8d61 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:40.363000 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-45e517f8-6866-4b61-b1ac-20fdd29d8d61 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077263 Apr 08 11:28:40.363592 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 990/1926] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:40 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:41.300983 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ac54554d-d221-4eb4-9844-c023eff56bdf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:41.301671 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ac54554d-d221-4eb4-9844-c023eff56bdf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:41.307985 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ac54554d-d221-4eb4-9844-c023eff56bdf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:41.308431 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ac54554d-d221-4eb4-9844-c023eff56bdf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:41.309189 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ac54554d-d221-4eb4-9844-c023eff56bdf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:41.309620 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ac54554d-d221-4eb4-9844-c023eff56bdf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:41.447790 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ac54554d-d221-4eb4-9844-c023eff56bdf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:41.455502 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ac54554d-d221-4eb4-9844-c023eff56bdf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.158819 Apr 08 11:28:41.456089 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 991/1927] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:41 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:41.460522 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d6d280af-3ab5-4933-a0fc-12897066adb8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:41.461127 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d6d280af-3ab5-4933-a0fc-12897066adb8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:41.467030 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d6d280af-3ab5-4933-a0fc-12897066adb8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:41.467481 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d6d280af-3ab5-4933-a0fc-12897066adb8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:41.468251 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d6d280af-3ab5-4933-a0fc-12897066adb8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:41.468692 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d6d280af-3ab5-4933-a0fc-12897066adb8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:41.528410 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d6d280af-3ab5-4933-a0fc-12897066adb8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:41.536379 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d6d280af-3ab5-4933-a0fc-12897066adb8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079351 Apr 08 11:28:41.536957 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 992/1928] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:41 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:42.473085 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-eead919d-8ca1-4eeb-a101-75bf33a6bae0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:42.473807 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-eead919d-8ca1-4eeb-a101-75bf33a6bae0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:42.480039 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-eead919d-8ca1-4eeb-a101-75bf33a6bae0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:42.480487 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-eead919d-8ca1-4eeb-a101-75bf33a6bae0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:42.481268 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-eead919d-8ca1-4eeb-a101-75bf33a6bae0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:42.481706 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-eead919d-8ca1-4eeb-a101-75bf33a6bae0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:42.627677 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-eead919d-8ca1-4eeb-a101-75bf33a6bae0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:42.635581 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-eead919d-8ca1-4eeb-a101-75bf33a6bae0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.166406 Apr 08 11:28:42.636164 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 993/1929] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:42 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:42.641847 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-447bddc6-513c-40c6-9749-bbc421eb3c80 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:42.641847 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-447bddc6-513c-40c6-9749-bbc421eb3c80 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:42.649073 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-447bddc6-513c-40c6-9749-bbc421eb3c80 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:42.649522 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-447bddc6-513c-40c6-9749-bbc421eb3c80 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:42.650881 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-447bddc6-513c-40c6-9749-bbc421eb3c80 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:42.650881 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-447bddc6-513c-40c6-9749-bbc421eb3c80 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:42.881330 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-447bddc6-513c-40c6-9749-bbc421eb3c80 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:42.888670 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-447bddc6-513c-40c6-9749-bbc421eb3c80 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.251549 Apr 08 11:28:42.889248 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 994/1930] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:42 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:43.653278 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-84afdc03-68bb-4101-aff4-7d7ae03a6e85 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:43.653929 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-84afdc03-68bb-4101-aff4-7d7ae03a6e85 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:43.661172 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-84afdc03-68bb-4101-aff4-7d7ae03a6e85 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:43.661631 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-84afdc03-68bb-4101-aff4-7d7ae03a6e85 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:43.662428 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-84afdc03-68bb-4101-aff4-7d7ae03a6e85 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:43.662873 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-84afdc03-68bb-4101-aff4-7d7ae03a6e85 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:43.794095 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-84afdc03-68bb-4101-aff4-7d7ae03a6e85 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:43.801375 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-84afdc03-68bb-4101-aff4-7d7ae03a6e85 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.151944 Apr 08 11:28:43.801973 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 995/1931] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:43 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:43.905615 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1afb3c2c-fcca-486a-b113-c9ca3c24cae5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:43.906208 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1afb3c2c-fcca-486a-b113-c9ca3c24cae5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:43.912090 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1afb3c2c-fcca-486a-b113-c9ca3c24cae5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:43.912533 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1afb3c2c-fcca-486a-b113-c9ca3c24cae5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:43.913288 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1afb3c2c-fcca-486a-b113-c9ca3c24cae5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:43.913718 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1afb3c2c-fcca-486a-b113-c9ca3c24cae5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:43.972129 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1afb3c2c-fcca-486a-b113-c9ca3c24cae5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:43.979499 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1afb3c2c-fcca-486a-b113-c9ca3c24cae5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077804 Apr 08 11:28:43.980061 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 996/1932] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:43 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:44.818631 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-200a24c1-ba92-4567-918e-5d027dd361c0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:44.819324 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-200a24c1-ba92-4567-918e-5d027dd361c0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:44.825759 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-200a24c1-ba92-4567-918e-5d027dd361c0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:44.826245 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-200a24c1-ba92-4567-918e-5d027dd361c0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:44.827029 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-200a24c1-ba92-4567-918e-5d027dd361c0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:44.827468 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-200a24c1-ba92-4567-918e-5d027dd361c0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:45.203342 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-200a24c1-ba92-4567-918e-5d027dd361c0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:45.211235 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-200a24c1-ba92-4567-918e-5d027dd361c0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.396484 Apr 08 11:28:45.211807 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 997/1933] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:44 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:45.216227 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e1af926b-231e-4db1-8b06-9466e31699d4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:45.216860 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e1af926b-231e-4db1-8b06-9466e31699d4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:45.223024 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e1af926b-231e-4db1-8b06-9466e31699d4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:45.223476 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e1af926b-231e-4db1-8b06-9466e31699d4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:45.224258 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e1af926b-231e-4db1-8b06-9466e31699d4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:45.224701 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e1af926b-231e-4db1-8b06-9466e31699d4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:45.282993 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e1af926b-231e-4db1-8b06-9466e31699d4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:45.290218 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e1af926b-231e-4db1-8b06-9466e31699d4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077439 Apr 08 11:28:45.290780 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 998/1934] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:45 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:46.228734 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-db6c0bba-5afb-4549-8a2b-2837350b347f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:46.229419 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-db6c0bba-5afb-4549-8a2b-2837350b347f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:46.236006 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-db6c0bba-5afb-4549-8a2b-2837350b347f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:46.236452 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-db6c0bba-5afb-4549-8a2b-2837350b347f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:46.237943 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-db6c0bba-5afb-4549-8a2b-2837350b347f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:46.238386 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-db6c0bba-5afb-4549-8a2b-2837350b347f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:46.370119 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-db6c0bba-5afb-4549-8a2b-2837350b347f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:46.377543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-db6c0bba-5afb-4549-8a2b-2837350b347f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.152830 Apr 08 11:28:46.378147 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 999/1935] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:46 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:46.382527 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3efbdbb7-476f-4268-91a9-a44c9d56e445 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:46.383136 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3efbdbb7-476f-4268-91a9-a44c9d56e445 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:46.389096 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3efbdbb7-476f-4268-91a9-a44c9d56e445 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:46.389555 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3efbdbb7-476f-4268-91a9-a44c9d56e445 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:46.390360 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3efbdbb7-476f-4268-91a9-a44c9d56e445 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:46.390806 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3efbdbb7-476f-4268-91a9-a44c9d56e445 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:46.453475 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3efbdbb7-476f-4268-91a9-a44c9d56e445 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:46.461564 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3efbdbb7-476f-4268-91a9-a44c9d56e445 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082453 Apr 08 11:28:46.462176 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1000/1936] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:46 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:47.394877 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-25c1d6c5-24f0-4aca-beb5-df04a439db64 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:47.395568 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-25c1d6c5-24f0-4aca-beb5-df04a439db64 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:47.401829 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-25c1d6c5-24f0-4aca-beb5-df04a439db64 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:47.402291 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-25c1d6c5-24f0-4aca-beb5-df04a439db64 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:47.403123 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-25c1d6c5-24f0-4aca-beb5-df04a439db64 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:47.403506 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-25c1d6c5-24f0-4aca-beb5-df04a439db64 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:47.534602 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-25c1d6c5-24f0-4aca-beb5-df04a439db64 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:47.541844 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-25c1d6c5-24f0-4aca-beb5-df04a439db64 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.150882 Apr 08 11:28:47.542414 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1001/1937] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:47 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:47.546829 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-109ebda0-1583-4b85-9a43-2bd79e1676b1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:47.547431 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-109ebda0-1583-4b85-9a43-2bd79e1676b1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:47.553648 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-109ebda0-1583-4b85-9a43-2bd79e1676b1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:47.554127 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-109ebda0-1583-4b85-9a43-2bd79e1676b1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:47.554900 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-109ebda0-1583-4b85-9a43-2bd79e1676b1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:47.555341 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-109ebda0-1583-4b85-9a43-2bd79e1676b1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:47.615070 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-109ebda0-1583-4b85-9a43-2bd79e1676b1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:47.623004 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-109ebda0-1583-4b85-9a43-2bd79e1676b1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079626 Apr 08 11:28:47.623573 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1002/1938] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:47 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:48.559498 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-12ddc4e1-86d3-4504-8805-012c0fc8bcd5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:48.560180 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-12ddc4e1-86d3-4504-8805-012c0fc8bcd5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:48.566968 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-12ddc4e1-86d3-4504-8805-012c0fc8bcd5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:48.567424 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-12ddc4e1-86d3-4504-8805-012c0fc8bcd5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:48.568205 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-12ddc4e1-86d3-4504-8805-012c0fc8bcd5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:48.568646 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-12ddc4e1-86d3-4504-8805-012c0fc8bcd5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:48.705559 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-12ddc4e1-86d3-4504-8805-012c0fc8bcd5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:48.713526 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-12ddc4e1-86d3-4504-8805-012c0fc8bcd5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.158121 Apr 08 11:28:48.714133 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1003/1939] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:48 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:48.718531 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7c92d359-5b8f-41f7-897f-45a1c5901200 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:48.719135 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7c92d359-5b8f-41f7-897f-45a1c5901200 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:48.725262 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7c92d359-5b8f-41f7-897f-45a1c5901200 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:48.725743 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7c92d359-5b8f-41f7-897f-45a1c5901200 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:48.726531 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7c92d359-5b8f-41f7-897f-45a1c5901200 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:48.726971 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7c92d359-5b8f-41f7-897f-45a1c5901200 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:48.795260 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7c92d359-5b8f-41f7-897f-45a1c5901200 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:48.802581 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7c92d359-5b8f-41f7-897f-45a1c5901200 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.087520 Apr 08 11:28:48.803149 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1004/1940] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:48 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:49.730817 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-294a5d47-78d3-4436-9b19-341b2b52caeb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:49.731494 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-294a5d47-78d3-4436-9b19-341b2b52caeb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:49.737880 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-294a5d47-78d3-4436-9b19-341b2b52caeb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:49.738340 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-294a5d47-78d3-4436-9b19-341b2b52caeb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:49.739764 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-294a5d47-78d3-4436-9b19-341b2b52caeb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:49.740215 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-294a5d47-78d3-4436-9b19-341b2b52caeb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:49.876268 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-294a5d47-78d3-4436-9b19-341b2b52caeb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:49.883555 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-294a5d47-78d3-4436-9b19-341b2b52caeb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.156776 Apr 08 11:28:49.884120 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1005/1941] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:49 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:49.888410 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8d307598-722b-49d1-912d-c7ed61b41565 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:49.889006 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8d307598-722b-49d1-912d-c7ed61b41565 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:49.894503 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8d307598-722b-49d1-912d-c7ed61b41565 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:49.894946 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8d307598-722b-49d1-912d-c7ed61b41565 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:49.895760 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8d307598-722b-49d1-912d-c7ed61b41565 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:49.896130 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8d307598-722b-49d1-912d-c7ed61b41565 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:49.954850 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8d307598-722b-49d1-912d-c7ed61b41565 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:49.962217 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8d307598-722b-49d1-912d-c7ed61b41565 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077126 Apr 08 11:28:49.962779 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1006/1942] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:49 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:50.900954 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2092be96-b3de-41aa-9de7-81292f660098 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:50.901599 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2092be96-b3de-41aa-9de7-81292f660098 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:50.908011 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2092be96-b3de-41aa-9de7-81292f660098 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:50.908470 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2092be96-b3de-41aa-9de7-81292f660098 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:50.909265 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2092be96-b3de-41aa-9de7-81292f660098 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:50.909702 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2092be96-b3de-41aa-9de7-81292f660098 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:51.047374 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2092be96-b3de-41aa-9de7-81292f660098 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:51.055311 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2092be96-b3de-41aa-9de7-81292f660098 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.158539 Apr 08 11:28:51.055882 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1007/1943] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:50 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:51.060257 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-838422d6-850e-4ecf-b01c-bf88c25874dc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:51.060983 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-838422d6-850e-4ecf-b01c-bf88c25874dc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:51.066871 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-838422d6-850e-4ecf-b01c-bf88c25874dc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:51.067879 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-838422d6-850e-4ecf-b01c-bf88c25874dc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:51.068668 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-838422d6-850e-4ecf-b01c-bf88c25874dc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:51.069116 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-838422d6-850e-4ecf-b01c-bf88c25874dc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:51.134379 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-838422d6-850e-4ecf-b01c-bf88c25874dc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:51.142109 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-838422d6-850e-4ecf-b01c-bf88c25874dc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.085172 Apr 08 11:28:51.142697 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1008/1944] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:51 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:52.072933 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9052926e-269a-4fd9-aa83-d1c0ce0138bd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:52.073552 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9052926e-269a-4fd9-aa83-d1c0ce0138bd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:52.080079 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9052926e-269a-4fd9-aa83-d1c0ce0138bd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:52.080534 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9052926e-269a-4fd9-aa83-d1c0ce0138bd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:52.081312 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9052926e-269a-4fd9-aa83-d1c0ce0138bd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:52.081755 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9052926e-269a-4fd9-aa83-d1c0ce0138bd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:52.225448 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9052926e-269a-4fd9-aa83-d1c0ce0138bd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:52.235771 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9052926e-269a-4fd9-aa83-d1c0ce0138bd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.166640 Apr 08 11:28:52.236366 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1009/1945] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:52 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:52.243791 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ee0e7924-6890-4789-820d-ebc05bbd6bb6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:52.244434 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ee0e7924-6890-4789-820d-ebc05bbd6bb6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:52.250891 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ee0e7924-6890-4789-820d-ebc05bbd6bb6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:52.253861 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ee0e7924-6890-4789-820d-ebc05bbd6bb6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:52.255312 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ee0e7924-6890-4789-820d-ebc05bbd6bb6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:52.255750 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ee0e7924-6890-4789-820d-ebc05bbd6bb6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:52.322094 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ee0e7924-6890-4789-820d-ebc05bbd6bb6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:52.329703 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ee0e7924-6890-4789-820d-ebc05bbd6bb6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.092287 Apr 08 11:28:52.330311 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1010/1946] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:52 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:53.252724 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-aef8b99e-6547-4126-be04-3d664059eb96 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:53.253383 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-aef8b99e-6547-4126-be04-3d664059eb96 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:53.260416 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aef8b99e-6547-4126-be04-3d664059eb96 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:53.260931 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aef8b99e-6547-4126-be04-3d664059eb96 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:53.261709 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aef8b99e-6547-4126-be04-3d664059eb96 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:53.262180 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aef8b99e-6547-4126-be04-3d664059eb96 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:53.416608 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-aef8b99e-6547-4126-be04-3d664059eb96 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:53.424605 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-aef8b99e-6547-4126-be04-3d664059eb96 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.175731 Apr 08 11:28:53.425174 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1011/1947] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:53 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:53.430169 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-dba66d1e-2f2c-4dd1-a0f9-9eaba1f4da11 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:53.430772 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-dba66d1e-2f2c-4dd1-a0f9-9eaba1f4da11 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:53.437155 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dba66d1e-2f2c-4dd1-a0f9-9eaba1f4da11 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:53.437619 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dba66d1e-2f2c-4dd1-a0f9-9eaba1f4da11 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:53.438633 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dba66d1e-2f2c-4dd1-a0f9-9eaba1f4da11 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:53.439080 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dba66d1e-2f2c-4dd1-a0f9-9eaba1f4da11 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:53.500917 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-dba66d1e-2f2c-4dd1-a0f9-9eaba1f4da11 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:53.509016 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-dba66d1e-2f2c-4dd1-a0f9-9eaba1f4da11 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082730 Apr 08 11:28:53.509741 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1012/1948] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:53 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:54.442989 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-48499c54-e62e-4081-8927-c01678e746fc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:54.443734 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-48499c54-e62e-4081-8927-c01678e746fc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:54.450044 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-48499c54-e62e-4081-8927-c01678e746fc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:54.450487 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-48499c54-e62e-4081-8927-c01678e746fc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:54.451255 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-48499c54-e62e-4081-8927-c01678e746fc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:54.451684 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-48499c54-e62e-4081-8927-c01678e746fc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:54.608930 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-48499c54-e62e-4081-8927-c01678e746fc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:54.617645 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-48499c54-e62e-4081-8927-c01678e746fc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.178792 Apr 08 11:28:54.618255 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1013/1949] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:54 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:54.622951 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-937ff319-fe0a-40ce-86bb-3f08b6963198 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:54.624098 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-937ff319-fe0a-40ce-86bb-3f08b6963198 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:54.630284 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-937ff319-fe0a-40ce-86bb-3f08b6963198 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:54.630823 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-937ff319-fe0a-40ce-86bb-3f08b6963198 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:54.631604 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-937ff319-fe0a-40ce-86bb-3f08b6963198 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:54.632050 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-937ff319-fe0a-40ce-86bb-3f08b6963198 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:54.693958 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-937ff319-fe0a-40ce-86bb-3f08b6963198 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:54.701661 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-937ff319-fe0a-40ce-86bb-3f08b6963198 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082445 Apr 08 11:28:54.702266 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1014/1950] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:54 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:55.634694 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-93d2e535-b598-483b-a1b9-ecf7332c8e5f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:55.635347 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-93d2e535-b598-483b-a1b9-ecf7332c8e5f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:55.641944 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-93d2e535-b598-483b-a1b9-ecf7332c8e5f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:55.642395 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-93d2e535-b598-483b-a1b9-ecf7332c8e5f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:55.643330 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-93d2e535-b598-483b-a1b9-ecf7332c8e5f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:55.643774 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-93d2e535-b598-483b-a1b9-ecf7332c8e5f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:55.778942 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-93d2e535-b598-483b-a1b9-ecf7332c8e5f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:55.786714 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-93d2e535-b598-483b-a1b9-ecf7332c8e5f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.155334 Apr 08 11:28:55.787273 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1015/1951] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:55 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:55.791677 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7c2e9f59-d9cb-4ebe-889a-bb3f7c83727c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:55.792275 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7c2e9f59-d9cb-4ebe-889a-bb3f7c83727c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:55.797840 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7c2e9f59-d9cb-4ebe-889a-bb3f7c83727c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:55.798292 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7c2e9f59-d9cb-4ebe-889a-bb3f7c83727c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:55.799046 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7c2e9f59-d9cb-4ebe-889a-bb3f7c83727c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:55.799482 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7c2e9f59-d9cb-4ebe-889a-bb3f7c83727c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:55.861804 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7c2e9f59-d9cb-4ebe-889a-bb3f7c83727c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:55.870141 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7c2e9f59-d9cb-4ebe-889a-bb3f7c83727c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081844 Apr 08 11:28:55.870703 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1016/1952] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:55 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:56.804224 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4c754e19-02e9-4e08-b496-c8d879e31c03 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:56.804939 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4c754e19-02e9-4e08-b496-c8d879e31c03 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:56.810992 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4c754e19-02e9-4e08-b496-c8d879e31c03 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:56.811446 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4c754e19-02e9-4e08-b496-c8d879e31c03 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:56.812211 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4c754e19-02e9-4e08-b496-c8d879e31c03 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:56.812650 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4c754e19-02e9-4e08-b496-c8d879e31c03 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:56.958882 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4c754e19-02e9-4e08-b496-c8d879e31c03 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:56.966312 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4c754e19-02e9-4e08-b496-c8d879e31c03 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.166425 Apr 08 11:28:56.966884 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1017/1953] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:56 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:56.971242 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1036c2cb-3a40-4d38-aad8-fbfed41881ac tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:56.971849 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1036c2cb-3a40-4d38-aad8-fbfed41881ac tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:56.977369 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1036c2cb-3a40-4d38-aad8-fbfed41881ac tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:56.977865 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1036c2cb-3a40-4d38-aad8-fbfed41881ac tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:56.978637 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1036c2cb-3a40-4d38-aad8-fbfed41881ac tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:56.979098 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1036c2cb-3a40-4d38-aad8-fbfed41881ac tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:57.038675 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1036c2cb-3a40-4d38-aad8-fbfed41881ac tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:57.046098 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1036c2cb-3a40-4d38-aad8-fbfed41881ac tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078230 Apr 08 11:28:57.046671 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1018/1954] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:56 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:57.983600 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-709c4111-f053-4215-85d8-c6b290434f19 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:57.984261 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-709c4111-f053-4215-85d8-c6b290434f19 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:57.990420 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-709c4111-f053-4215-85d8-c6b290434f19 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:57.990873 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-709c4111-f053-4215-85d8-c6b290434f19 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:57.991639 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-709c4111-f053-4215-85d8-c6b290434f19 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:57.992346 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-709c4111-f053-4215-85d8-c6b290434f19 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:58.130242 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-709c4111-f053-4215-85d8-c6b290434f19 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:58.137660 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-709c4111-f053-4215-85d8-c6b290434f19 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.158087 Apr 08 11:28:58.138279 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1019/1955] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:57 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:58.142707 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-78c376ce-c6e4-447f-99ac-4eb0b09bf6a1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:58.143321 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-78c376ce-c6e4-447f-99ac-4eb0b09bf6a1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:58.149472 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-78c376ce-c6e4-447f-99ac-4eb0b09bf6a1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:58.163698 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-78c376ce-c6e4-447f-99ac-4eb0b09bf6a1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:58.163698 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-78c376ce-c6e4-447f-99ac-4eb0b09bf6a1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:58.163698 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-78c376ce-c6e4-447f-99ac-4eb0b09bf6a1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:58.210122 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-78c376ce-c6e4-447f-99ac-4eb0b09bf6a1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:58.217367 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-78c376ce-c6e4-447f-99ac-4eb0b09bf6a1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078158 Apr 08 11:28:58.217952 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1020/1956] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:58 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:28:59.155088 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8ecc489b-0432-4985-89dc-791ea6b6efc4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:59.155768 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8ecc489b-0432-4985-89dc-791ea6b6efc4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:59.162945 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8ecc489b-0432-4985-89dc-791ea6b6efc4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:59.163403 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8ecc489b-0432-4985-89dc-791ea6b6efc4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:59.164184 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8ecc489b-0432-4985-89dc-791ea6b6efc4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:59.164630 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8ecc489b-0432-4985-89dc-791ea6b6efc4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:59.297384 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8ecc489b-0432-4985-89dc-791ea6b6efc4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:59.304766 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8ecc489b-0432-4985-89dc-791ea6b6efc4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.153533 Apr 08 11:28:59.305344 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1021/1957] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:59 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:28:59.309683 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-27bbaea1-264f-4d27-bafa-136141af0aae tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:28:59.310309 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-27bbaea1-264f-4d27-bafa-136141af0aae tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:28:59.315796 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-27bbaea1-264f-4d27-bafa-136141af0aae tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:59.316235 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-27bbaea1-264f-4d27-bafa-136141af0aae tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:59.316994 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-27bbaea1-264f-4d27-bafa-136141af0aae tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:28:59.317469 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-27bbaea1-264f-4d27-bafa-136141af0aae tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:28:59.375650 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-27bbaea1-264f-4d27-bafa-136141af0aae tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:28:59.382946 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-27bbaea1-264f-4d27-bafa-136141af0aae tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.076654 Apr 08 11:28:59.383503 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1022/1958] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:28:59 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:00.325269 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-528a055a-956a-45ef-b3c7-fce716339398 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:00.326560 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-528a055a-956a-45ef-b3c7-fce716339398 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:00.334598 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-528a055a-956a-45ef-b3c7-fce716339398 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:00.335054 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-528a055a-956a-45ef-b3c7-fce716339398 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:00.335839 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-528a055a-956a-45ef-b3c7-fce716339398 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:00.336282 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-528a055a-956a-45ef-b3c7-fce716339398 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:00.486825 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-528a055a-956a-45ef-b3c7-fce716339398 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:00.495142 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-528a055a-956a-45ef-b3c7-fce716339398 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.176672 Apr 08 11:29:00.495711 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1023/1959] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:00 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:00.500119 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1da72dd8-60f8-400a-b9c9-d484078d9c34 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:00.500719 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1da72dd8-60f8-400a-b9c9-d484078d9c34 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:00.506169 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1da72dd8-60f8-400a-b9c9-d484078d9c34 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:00.506626 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1da72dd8-60f8-400a-b9c9-d484078d9c34 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:00.507393 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1da72dd8-60f8-400a-b9c9-d484078d9c34 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:00.507838 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1da72dd8-60f8-400a-b9c9-d484078d9c34 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:00.566055 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1da72dd8-60f8-400a-b9c9-d484078d9c34 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:00.573391 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1da72dd8-60f8-400a-b9c9-d484078d9c34 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.076736 Apr 08 11:29:00.574015 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1024/1960] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:00 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:00.965789 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8976a1eb-6986-48d7-8733-7a873b864c9e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:00.966634 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8976a1eb-6986-48d7-8733-7a873b864c9e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:00.972452 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8976a1eb-6986-48d7-8733-7a873b864c9e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:00.972901 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8976a1eb-6986-48d7-8733-7a873b864c9e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:00.973656 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8976a1eb-6986-48d7-8733-7a873b864c9e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:00.974113 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8976a1eb-6986-48d7-8733-7a873b864c9e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:01.002633 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8976a1eb-6986-48d7-8733-7a873b864c9e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040792 Apr 08 11:29:01.003179 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1025/1961] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:29:00 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:29:01.516145 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-29081177-bfe9-4511-a34c-827d4aced2bb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:01.516824 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-29081177-bfe9-4511-a34c-827d4aced2bb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:01.523456 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-29081177-bfe9-4511-a34c-827d4aced2bb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:01.523900 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-29081177-bfe9-4511-a34c-827d4aced2bb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:01.524716 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-29081177-bfe9-4511-a34c-827d4aced2bb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:01.525211 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-29081177-bfe9-4511-a34c-827d4aced2bb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:01.685832 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-29081177-bfe9-4511-a34c-827d4aced2bb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:01.693801 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-29081177-bfe9-4511-a34c-827d4aced2bb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.185454 Apr 08 11:29:01.694396 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1026/1962] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:01 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:01.698780 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-869b34f4-6a17-4ddf-b4c5-4999eceb780a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:01.699394 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-869b34f4-6a17-4ddf-b4c5-4999eceb780a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:01.705020 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-869b34f4-6a17-4ddf-b4c5-4999eceb780a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:01.705476 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-869b34f4-6a17-4ddf-b4c5-4999eceb780a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:01.706280 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-869b34f4-6a17-4ddf-b4c5-4999eceb780a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:01.706727 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-869b34f4-6a17-4ddf-b4c5-4999eceb780a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:01.765365 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-869b34f4-6a17-4ddf-b4c5-4999eceb780a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:01.773730 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-869b34f4-6a17-4ddf-b4c5-4999eceb780a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078255 Apr 08 11:29:01.774302 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1027/1963] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:01 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:02.014788 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2bc437a3-d401-4afb-8cd1-e9b85438aa28 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:29:02.015820 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2bc437a3-d401-4afb-8cd1-e9b85438aa28 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:02.021816 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2bc437a3-d401-4afb-8cd1-e9b85438aa28 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:02.022275 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2bc437a3-d401-4afb-8cd1-e9b85438aa28 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:02.023060 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2bc437a3-d401-4afb-8cd1-e9b85438aa28 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:02.023508 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2bc437a3-d401-4afb-8cd1-e9b85438aa28 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:02.121893 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2bc437a3-d401-4afb-8cd1-e9b85438aa28 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "POST /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/action" status: 200 len: 76517 microversion: 2.1 time: 0.110800 Apr 08 11:29:02.122558 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1028/1964] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Apr 8 11:29:02 2022] POST /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47/action => generated 76517 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 08 11:29:02.712393 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3f008d45-5ea6-42d0-a608-942d1ef9a0f9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:02.713745 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3f008d45-5ea6-42d0-a608-942d1ef9a0f9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:02.724744 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3f008d45-5ea6-42d0-a608-942d1ef9a0f9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:02.725209 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3f008d45-5ea6-42d0-a608-942d1ef9a0f9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:02.726070 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3f008d45-5ea6-42d0-a608-942d1ef9a0f9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:02.726585 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3f008d45-5ea6-42d0-a608-942d1ef9a0f9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:02.875948 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3f008d45-5ea6-42d0-a608-942d1ef9a0f9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:02.883938 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3f008d45-5ea6-42d0-a608-942d1ef9a0f9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.175871 Apr 08 11:29:02.884497 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1029/1965] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:02 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:02.889286 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-616e03ff-1e8a-4746-8450-d81ea8f7eb81 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:02.889916 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-616e03ff-1e8a-4746-8450-d81ea8f7eb81 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:02.895932 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-616e03ff-1e8a-4746-8450-d81ea8f7eb81 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:02.896433 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-616e03ff-1e8a-4746-8450-d81ea8f7eb81 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:02.897158 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-616e03ff-1e8a-4746-8450-d81ea8f7eb81 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:02.897893 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-616e03ff-1e8a-4746-8450-d81ea8f7eb81 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:02.979306 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-616e03ff-1e8a-4746-8450-d81ea8f7eb81 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:02.992001 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-616e03ff-1e8a-4746-8450-d81ea8f7eb81 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.106268 Apr 08 11:29:02.992893 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1030/1966] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:02 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:03.901640 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2c27cca6-e0f0-4340-bb1e-37158887d5b5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:03.902329 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2c27cca6-e0f0-4340-bb1e-37158887d5b5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:03.908608 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2c27cca6-e0f0-4340-bb1e-37158887d5b5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:03.909056 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2c27cca6-e0f0-4340-bb1e-37158887d5b5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:03.909840 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2c27cca6-e0f0-4340-bb1e-37158887d5b5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:03.910275 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2c27cca6-e0f0-4340-bb1e-37158887d5b5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:04.049064 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2c27cca6-e0f0-4340-bb1e-37158887d5b5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:04.056506 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2c27cca6-e0f0-4340-bb1e-37158887d5b5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.158808 Apr 08 11:29:04.057298 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1031/1967] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:03 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:04.061672 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3b323260-df4d-4599-ac9b-e6dc17d2e921 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:04.062306 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3b323260-df4d-4599-ac9b-e6dc17d2e921 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:04.068462 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3b323260-df4d-4599-ac9b-e6dc17d2e921 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:04.068935 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3b323260-df4d-4599-ac9b-e6dc17d2e921 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:04.069715 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3b323260-df4d-4599-ac9b-e6dc17d2e921 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:04.070186 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3b323260-df4d-4599-ac9b-e6dc17d2e921 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:04.128759 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3b323260-df4d-4599-ac9b-e6dc17d2e921 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:04.136845 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3b323260-df4d-4599-ac9b-e6dc17d2e921 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078517 Apr 08 11:29:04.137425 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1032/1968] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:04 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:05.073469 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-84125b91-d135-41a8-b719-5ae9fbdfd5bd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:05.074181 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-84125b91-d135-41a8-b719-5ae9fbdfd5bd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:05.080366 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-84125b91-d135-41a8-b719-5ae9fbdfd5bd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:05.080807 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-84125b91-d135-41a8-b719-5ae9fbdfd5bd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:05.081557 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-84125b91-d135-41a8-b719-5ae9fbdfd5bd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:05.082022 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-84125b91-d135-41a8-b719-5ae9fbdfd5bd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:05.216148 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-84125b91-d135-41a8-b719-5ae9fbdfd5bd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:05.223517 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-84125b91-d135-41a8-b719-5ae9fbdfd5bd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.153896 Apr 08 11:29:05.224081 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1033/1969] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:05 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:05.229182 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-18e6ede3-e59b-4fc1-a41e-2062cc99d8dc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:05.229800 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-18e6ede3-e59b-4fc1-a41e-2062cc99d8dc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:05.235618 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-18e6ede3-e59b-4fc1-a41e-2062cc99d8dc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:05.236062 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-18e6ede3-e59b-4fc1-a41e-2062cc99d8dc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:05.236836 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-18e6ede3-e59b-4fc1-a41e-2062cc99d8dc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:05.237262 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-18e6ede3-e59b-4fc1-a41e-2062cc99d8dc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:05.299759 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-18e6ede3-e59b-4fc1-a41e-2062cc99d8dc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:05.307478 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-18e6ede3-e59b-4fc1-a41e-2062cc99d8dc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082428 Apr 08 11:29:05.308048 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1034/1970] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:05 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:06.241315 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-001208b2-f13c-400a-b58e-748798918760 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:06.242308 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-001208b2-f13c-400a-b58e-748798918760 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:06.249401 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-001208b2-f13c-400a-b58e-748798918760 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:06.249889 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-001208b2-f13c-400a-b58e-748798918760 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:06.250671 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-001208b2-f13c-400a-b58e-748798918760 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:06.251111 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-001208b2-f13c-400a-b58e-748798918760 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:06.386659 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-001208b2-f13c-400a-b58e-748798918760 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:06.394163 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-001208b2-f13c-400a-b58e-748798918760 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.156720 Apr 08 11:29:06.394729 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1035/1971] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:06 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:06.399242 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e63ab9b1-1aae-4c3b-be40-b0a17c666e25 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:06.399853 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e63ab9b1-1aae-4c3b-be40-b0a17c666e25 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:06.405546 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e63ab9b1-1aae-4c3b-be40-b0a17c666e25 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:06.406031 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e63ab9b1-1aae-4c3b-be40-b0a17c666e25 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:06.406803 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e63ab9b1-1aae-4c3b-be40-b0a17c666e25 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:06.407245 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e63ab9b1-1aae-4c3b-be40-b0a17c666e25 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:06.466657 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e63ab9b1-1aae-4c3b-be40-b0a17c666e25 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:06.474396 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e63ab9b1-1aae-4c3b-be40-b0a17c666e25 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078648 Apr 08 11:29:06.474981 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1036/1972] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:06 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:07.410853 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-496d755e-2079-4a18-9e0c-b405d7175f12 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:07.411526 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-496d755e-2079-4a18-9e0c-b405d7175f12 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:07.417877 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-496d755e-2079-4a18-9e0c-b405d7175f12 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:07.418338 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-496d755e-2079-4a18-9e0c-b405d7175f12 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:07.419125 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-496d755e-2079-4a18-9e0c-b405d7175f12 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:07.419562 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-496d755e-2079-4a18-9e0c-b405d7175f12 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:07.562026 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-496d755e-2079-4a18-9e0c-b405d7175f12 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:07.569570 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-496d755e-2079-4a18-9e0c-b405d7175f12 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.162563 Apr 08 11:29:07.570745 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1037/1973] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:07 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:07.575405 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c42b735c-c4da-49b7-a702-2d0d6eaa23a0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:07.576015 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c42b735c-c4da-49b7-a702-2d0d6eaa23a0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:07.581621 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c42b735c-c4da-49b7-a702-2d0d6eaa23a0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:07.583151 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c42b735c-c4da-49b7-a702-2d0d6eaa23a0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:07.583151 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c42b735c-c4da-49b7-a702-2d0d6eaa23a0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:07.583489 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c42b735c-c4da-49b7-a702-2d0d6eaa23a0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:07.643422 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c42b735c-c4da-49b7-a702-2d0d6eaa23a0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:07.651658 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c42b735c-c4da-49b7-a702-2d0d6eaa23a0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079786 Apr 08 11:29:07.652202 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1038/1974] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:07 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:08.587926 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d30b2b94-210b-4358-9876-600aece75677 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:08.588614 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d30b2b94-210b-4358-9876-600aece75677 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:08.594838 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d30b2b94-210b-4358-9876-600aece75677 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:08.595291 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d30b2b94-210b-4358-9876-600aece75677 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:08.596062 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d30b2b94-210b-4358-9876-600aece75677 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:08.596501 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d30b2b94-210b-4358-9876-600aece75677 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:08.731794 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d30b2b94-210b-4358-9876-600aece75677 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:08.739122 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d30b2b94-210b-4358-9876-600aece75677 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.155737 Apr 08 11:29:08.739689 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1039/1975] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:08 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:08.744811 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-81e610de-5380-41c3-a4b6-292c4aa37357 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:08.745971 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-81e610de-5380-41c3-a4b6-292c4aa37357 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:08.753874 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-81e610de-5380-41c3-a4b6-292c4aa37357 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:08.754333 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-81e610de-5380-41c3-a4b6-292c4aa37357 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:08.755119 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-81e610de-5380-41c3-a4b6-292c4aa37357 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:08.755571 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-81e610de-5380-41c3-a4b6-292c4aa37357 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:08.818107 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-81e610de-5380-41c3-a4b6-292c4aa37357 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:08.825668 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-81e610de-5380-41c3-a4b6-292c4aa37357 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.085002 Apr 08 11:29:08.826277 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1040/1976] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:08 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:09.756871 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a40fcb7f-07df-4370-bb76-8c10f75f9856 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:09.757558 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a40fcb7f-07df-4370-bb76-8c10f75f9856 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:09.764742 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a40fcb7f-07df-4370-bb76-8c10f75f9856 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:09.765197 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a40fcb7f-07df-4370-bb76-8c10f75f9856 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:09.766045 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a40fcb7f-07df-4370-bb76-8c10f75f9856 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:09.766664 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a40fcb7f-07df-4370-bb76-8c10f75f9856 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:09.922543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a40fcb7f-07df-4370-bb76-8c10f75f9856 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:09.931966 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a40fcb7f-07df-4370-bb76-8c10f75f9856 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.179052 Apr 08 11:29:09.932559 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1041/1977] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:09 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:09.937180 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7a6c2795-6488-41a3-96ec-253e88446df1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:09.937824 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7a6c2795-6488-41a3-96ec-253e88446df1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:09.944124 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7a6c2795-6488-41a3-96ec-253e88446df1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:09.944588 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7a6c2795-6488-41a3-96ec-253e88446df1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:09.945377 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7a6c2795-6488-41a3-96ec-253e88446df1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:09.945841 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7a6c2795-6488-41a3-96ec-253e88446df1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:10.007902 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7a6c2795-6488-41a3-96ec-253e88446df1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:10.015729 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7a6c2795-6488-41a3-96ec-253e88446df1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082089 Apr 08 11:29:10.016307 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1042/1978] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:09 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:10.956532 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-471c6920-866f-4984-9747-163674aef685 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:10.957186 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-471c6920-866f-4984-9747-163674aef685 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:10.964316 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-471c6920-866f-4984-9747-163674aef685 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:10.964769 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-471c6920-866f-4984-9747-163674aef685 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:10.965564 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-471c6920-866f-4984-9747-163674aef685 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:10.966028 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-471c6920-866f-4984-9747-163674aef685 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:11.110427 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-471c6920-866f-4984-9747-163674aef685 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:11.118936 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-471c6920-866f-4984-9747-163674aef685 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.166333 Apr 08 11:29:11.119523 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1043/1979] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:10 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:11.124132 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8f91091a-f01d-47df-80c0-3b964d806024 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:11.124732 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8f91091a-f01d-47df-80c0-3b964d806024 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:11.130849 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8f91091a-f01d-47df-80c0-3b964d806024 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:11.131383 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8f91091a-f01d-47df-80c0-3b964d806024 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:11.132164 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8f91091a-f01d-47df-80c0-3b964d806024 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:11.132595 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8f91091a-f01d-47df-80c0-3b964d806024 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:11.193397 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8f91091a-f01d-47df-80c0-3b964d806024 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:11.201161 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8f91091a-f01d-47df-80c0-3b964d806024 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080551 Apr 08 11:29:11.201785 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1044/1980] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:11 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:12.137147 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3d15331d-fa0c-410d-a887-2467d062b1d7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:12.137942 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3d15331d-fa0c-410d-a887-2467d062b1d7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:12.144414 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3d15331d-fa0c-410d-a887-2467d062b1d7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:12.144875 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3d15331d-fa0c-410d-a887-2467d062b1d7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:12.145664 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3d15331d-fa0c-410d-a887-2467d062b1d7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:12.146139 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3d15331d-fa0c-410d-a887-2467d062b1d7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:12.286181 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3d15331d-fa0c-410d-a887-2467d062b1d7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:12.293911 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3d15331d-fa0c-410d-a887-2467d062b1d7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.161226 Apr 08 11:29:12.294501 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1045/1981] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:12 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:12.298946 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-315a9b49-38a8-49c0-93df-cd794bd0f513 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:12.299557 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-315a9b49-38a8-49c0-93df-cd794bd0f513 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:12.305312 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-315a9b49-38a8-49c0-93df-cd794bd0f513 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:12.305787 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-315a9b49-38a8-49c0-93df-cd794bd0f513 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:12.306570 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-315a9b49-38a8-49c0-93df-cd794bd0f513 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:12.307018 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-315a9b49-38a8-49c0-93df-cd794bd0f513 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:12.367635 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-315a9b49-38a8-49c0-93df-cd794bd0f513 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:12.375260 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-315a9b49-38a8-49c0-93df-cd794bd0f513 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079772 Apr 08 11:29:12.375843 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1046/1982] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:12 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:13.311143 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-18a2b4da-668a-4191-ac14-2da1c5a7dae6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:13.311859 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-18a2b4da-668a-4191-ac14-2da1c5a7dae6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:13.318374 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-18a2b4da-668a-4191-ac14-2da1c5a7dae6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:13.318834 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-18a2b4da-668a-4191-ac14-2da1c5a7dae6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:13.319621 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-18a2b4da-668a-4191-ac14-2da1c5a7dae6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:13.320058 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-18a2b4da-668a-4191-ac14-2da1c5a7dae6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:13.464934 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-18a2b4da-668a-4191-ac14-2da1c5a7dae6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:13.473072 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-18a2b4da-668a-4191-ac14-2da1c5a7dae6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.165839 Apr 08 11:29:13.473667 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1047/1983] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:13 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:13.478857 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7fa60b66-cb20-4739-991c-2df93184bff4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:13.479489 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7fa60b66-cb20-4739-991c-2df93184bff4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:13.485940 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7fa60b66-cb20-4739-991c-2df93184bff4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:13.486404 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7fa60b66-cb20-4739-991c-2df93184bff4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:13.487193 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7fa60b66-cb20-4739-991c-2df93184bff4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:13.487633 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7fa60b66-cb20-4739-991c-2df93184bff4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:13.553461 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7fa60b66-cb20-4739-991c-2df93184bff4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:13.561313 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7fa60b66-cb20-4739-991c-2df93184bff4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.086513 Apr 08 11:29:13.561857 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1048/1984] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:13 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:14.491097 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-023e029a-39ea-410e-b011-eebdb30fc433 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:14.491745 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-023e029a-39ea-410e-b011-eebdb30fc433 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:14.498920 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-023e029a-39ea-410e-b011-eebdb30fc433 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:14.499374 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-023e029a-39ea-410e-b011-eebdb30fc433 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:14.500160 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-023e029a-39ea-410e-b011-eebdb30fc433 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:14.500597 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-023e029a-39ea-410e-b011-eebdb30fc433 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:14.640011 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-023e029a-39ea-410e-b011-eebdb30fc433 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:14.648121 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-023e029a-39ea-410e-b011-eebdb30fc433 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.160895 Apr 08 11:29:14.648718 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1049/1985] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:14 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:14.653228 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-10298616-2eac-478f-8d83-dcf17d60cfb8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:14.653862 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-10298616-2eac-478f-8d83-dcf17d60cfb8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:14.659851 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-10298616-2eac-478f-8d83-dcf17d60cfb8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:14.662870 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-10298616-2eac-478f-8d83-dcf17d60cfb8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:14.662870 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-10298616-2eac-478f-8d83-dcf17d60cfb8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:14.662870 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-10298616-2eac-478f-8d83-dcf17d60cfb8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:14.725183 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-10298616-2eac-478f-8d83-dcf17d60cfb8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:14.733523 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-10298616-2eac-478f-8d83-dcf17d60cfb8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.083788 Apr 08 11:29:14.734141 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1050/1986] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:14 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:15.664472 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-558fadbd-1ffe-4bd5-bdaa-868091428d4b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:15.665123 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-558fadbd-1ffe-4bd5-bdaa-868091428d4b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:15.671459 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-558fadbd-1ffe-4bd5-bdaa-868091428d4b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:15.671918 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-558fadbd-1ffe-4bd5-bdaa-868091428d4b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:15.672688 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-558fadbd-1ffe-4bd5-bdaa-868091428d4b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:15.673128 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-558fadbd-1ffe-4bd5-bdaa-868091428d4b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:15.807218 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-558fadbd-1ffe-4bd5-bdaa-868091428d4b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:15.814479 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-558fadbd-1ffe-4bd5-bdaa-868091428d4b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.153894 Apr 08 11:29:15.815042 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1051/1987] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:15 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:15.819327 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0b30b272-2533-48bd-b5fc-e90beb095810 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:15.819919 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0b30b272-2533-48bd-b5fc-e90beb095810 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:15.825335 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0b30b272-2533-48bd-b5fc-e90beb095810 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:15.825797 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0b30b272-2533-48bd-b5fc-e90beb095810 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:15.826578 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0b30b272-2533-48bd-b5fc-e90beb095810 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:15.827012 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0b30b272-2533-48bd-b5fc-e90beb095810 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:15.885129 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0b30b272-2533-48bd-b5fc-e90beb095810 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:15.892346 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0b30b272-2533-48bd-b5fc-e90beb095810 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.076371 Apr 08 11:29:15.892908 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1052/1988] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:15 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:16.838168 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2ea356ce-69b8-4b4c-a8df-15d361b50591 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:16.838862 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2ea356ce-69b8-4b4c-a8df-15d361b50591 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:16.848167 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2ea356ce-69b8-4b4c-a8df-15d361b50591 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:16.848636 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2ea356ce-69b8-4b4c-a8df-15d361b50591 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:16.849427 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2ea356ce-69b8-4b4c-a8df-15d361b50591 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:16.849907 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2ea356ce-69b8-4b4c-a8df-15d361b50591 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:16.985659 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2ea356ce-69b8-4b4c-a8df-15d361b50591 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:16.993842 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2ea356ce-69b8-4b4c-a8df-15d361b50591 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.166404 Apr 08 11:29:16.994424 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1053/1989] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:16 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:16.999471 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1ead5254-109a-4ad2-834a-41dc55d820d2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:17.000083 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1ead5254-109a-4ad2-834a-41dc55d820d2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:17.005795 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ead5254-109a-4ad2-834a-41dc55d820d2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:17.006250 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ead5254-109a-4ad2-834a-41dc55d820d2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:17.007036 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ead5254-109a-4ad2-834a-41dc55d820d2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:17.007469 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ead5254-109a-4ad2-834a-41dc55d820d2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:17.071175 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1ead5254-109a-4ad2-834a-41dc55d820d2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:17.079853 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1ead5254-109a-4ad2-834a-41dc55d820d2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.083700 Apr 08 11:29:17.080445 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1054/1990] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:16 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:18.011294 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0cae4b09-56b9-499c-81b2-8cbe56581ea6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:18.012518 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0cae4b09-56b9-499c-81b2-8cbe56581ea6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:18.019268 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0cae4b09-56b9-499c-81b2-8cbe56581ea6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:18.019762 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0cae4b09-56b9-499c-81b2-8cbe56581ea6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:18.020558 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0cae4b09-56b9-499c-81b2-8cbe56581ea6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:18.021041 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0cae4b09-56b9-499c-81b2-8cbe56581ea6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:18.157328 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0cae4b09-56b9-499c-81b2-8cbe56581ea6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:18.164588 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0cae4b09-56b9-499c-81b2-8cbe56581ea6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.157159 Apr 08 11:29:18.165159 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1055/1991] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:18 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:18.169546 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-31de563d-346e-4c27-9f90-c4cfb0480003 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:18.170254 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-31de563d-346e-4c27-9f90-c4cfb0480003 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:18.175887 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-31de563d-346e-4c27-9f90-c4cfb0480003 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:18.176344 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-31de563d-346e-4c27-9f90-c4cfb0480003 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:18.177148 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-31de563d-346e-4c27-9f90-c4cfb0480003 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:18.177594 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-31de563d-346e-4c27-9f90-c4cfb0480003 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:18.240102 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-31de563d-346e-4c27-9f90-c4cfb0480003 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:18.247901 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-31de563d-346e-4c27-9f90-c4cfb0480003 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081803 Apr 08 11:29:18.248472 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1056/1992] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:18 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:19.182042 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-311e5d5b-bbda-43bd-96b7-31c969cc8cc6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:19.182812 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-311e5d5b-bbda-43bd-96b7-31c969cc8cc6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:19.189552 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-311e5d5b-bbda-43bd-96b7-31c969cc8cc6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:19.190033 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-311e5d5b-bbda-43bd-96b7-31c969cc8cc6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:19.190814 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-311e5d5b-bbda-43bd-96b7-31c969cc8cc6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:19.191256 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-311e5d5b-bbda-43bd-96b7-31c969cc8cc6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:19.325284 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-311e5d5b-bbda-43bd-96b7-31c969cc8cc6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:19.332593 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-311e5d5b-bbda-43bd-96b7-31c969cc8cc6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.154466 Apr 08 11:29:19.333163 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1057/1993] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:19 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:19.337563 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-32dc5315-974d-46ac-ac61-e4562d33cd4c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:19.338191 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-32dc5315-974d-46ac-ac61-e4562d33cd4c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:19.343628 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-32dc5315-974d-46ac-ac61-e4562d33cd4c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:19.344090 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-32dc5315-974d-46ac-ac61-e4562d33cd4c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:19.344889 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-32dc5315-974d-46ac-ac61-e4562d33cd4c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:19.345335 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-32dc5315-974d-46ac-ac61-e4562d33cd4c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:19.405132 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-32dc5315-974d-46ac-ac61-e4562d33cd4c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:19.412549 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-32dc5315-974d-46ac-ac61-e4562d33cd4c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078426 Apr 08 11:29:19.413135 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1058/1994] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:19 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:20.349815 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-848f8954-f63d-4db6-a57a-37ab2a5aef8d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:20.350464 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-848f8954-f63d-4db6-a57a-37ab2a5aef8d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:20.357194 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-848f8954-f63d-4db6-a57a-37ab2a5aef8d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:20.357648 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-848f8954-f63d-4db6-a57a-37ab2a5aef8d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:20.358439 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-848f8954-f63d-4db6-a57a-37ab2a5aef8d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:20.358884 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-848f8954-f63d-4db6-a57a-37ab2a5aef8d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:20.493104 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-848f8954-f63d-4db6-a57a-37ab2a5aef8d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:20.501076 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-848f8954-f63d-4db6-a57a-37ab2a5aef8d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.155211 Apr 08 11:29:20.501668 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1059/1995] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:20 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:20.506194 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-cec8e5b0-5c8f-40dc-b4cb-7d3f36a3390c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:20.506804 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-cec8e5b0-5c8f-40dc-b4cb-7d3f36a3390c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:20.512305 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cec8e5b0-5c8f-40dc-b4cb-7d3f36a3390c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:20.512790 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cec8e5b0-5c8f-40dc-b4cb-7d3f36a3390c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:20.513570 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cec8e5b0-5c8f-40dc-b4cb-7d3f36a3390c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:20.514108 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cec8e5b0-5c8f-40dc-b4cb-7d3f36a3390c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:20.572711 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-cec8e5b0-5c8f-40dc-b4cb-7d3f36a3390c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:20.580142 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-cec8e5b0-5c8f-40dc-b4cb-7d3f36a3390c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077456 Apr 08 11:29:20.580717 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1060/1996] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:20 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:21.518775 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-df03e11b-d323-41c7-9ca0-88960328d9db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:21.519457 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-df03e11b-d323-41c7-9ca0-88960328d9db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:21.525715 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-df03e11b-d323-41c7-9ca0-88960328d9db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:21.526197 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-df03e11b-d323-41c7-9ca0-88960328d9db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:21.526972 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-df03e11b-d323-41c7-9ca0-88960328d9db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:21.527917 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-df03e11b-d323-41c7-9ca0-88960328d9db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:21.663281 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-df03e11b-d323-41c7-9ca0-88960328d9db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:21.671316 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-df03e11b-d323-41c7-9ca0-88960328d9db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.156473 Apr 08 11:29:21.671922 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1061/1997] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:21 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:21.676272 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3ab95451-d4b1-4fe2-84d9-8f4d5cad916e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:21.676874 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3ab95451-d4b1-4fe2-84d9-8f4d5cad916e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:21.682473 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3ab95451-d4b1-4fe2-84d9-8f4d5cad916e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:21.682921 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3ab95451-d4b1-4fe2-84d9-8f4d5cad916e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:21.683799 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3ab95451-d4b1-4fe2-84d9-8f4d5cad916e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:21.684313 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3ab95451-d4b1-4fe2-84d9-8f4d5cad916e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:21.747209 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3ab95451-d4b1-4fe2-84d9-8f4d5cad916e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:21.754659 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3ab95451-d4b1-4fe2-84d9-8f4d5cad916e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081805 Apr 08 11:29:21.755229 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1062/1998] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:21 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:22.688464 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9883ec4c-62b4-4d85-bf83-64579ef7cf92 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:22.689164 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9883ec4c-62b4-4d85-bf83-64579ef7cf92 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:22.695601 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9883ec4c-62b4-4d85-bf83-64579ef7cf92 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:22.706315 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9883ec4c-62b4-4d85-bf83-64579ef7cf92 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:22.706315 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9883ec4c-62b4-4d85-bf83-64579ef7cf92 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:22.706315 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9883ec4c-62b4-4d85-bf83-64579ef7cf92 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:22.833114 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9883ec4c-62b4-4d85-bf83-64579ef7cf92 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:22.841592 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9883ec4c-62b4-4d85-bf83-64579ef7cf92 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.157204 Apr 08 11:29:22.842204 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1063/1999] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:22 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:22.846784 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-36bd4c63-b65f-432e-ba4c-3c2a3c8e8646 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:22.851881 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-36bd4c63-b65f-432e-ba4c-3c2a3c8e8646 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:22.853378 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-36bd4c63-b65f-432e-ba4c-3c2a3c8e8646 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:22.853863 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-36bd4c63-b65f-432e-ba4c-3c2a3c8e8646 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:22.854756 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-36bd4c63-b65f-432e-ba4c-3c2a3c8e8646 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:22.855129 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-36bd4c63-b65f-432e-ba4c-3c2a3c8e8646 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:22.915040 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-36bd4c63-b65f-432e-ba4c-3c2a3c8e8646 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:22.923062 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-36bd4c63-b65f-432e-ba4c-3c2a3c8e8646 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079881 Apr 08 11:29:22.923640 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1064/2000] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:22 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:23.859232 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9f79ff65-ba1b-454c-9c6f-34f8b66b9e7e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:23.859907 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9f79ff65-ba1b-454c-9c6f-34f8b66b9e7e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:23.866162 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9f79ff65-ba1b-454c-9c6f-34f8b66b9e7e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:23.866608 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9f79ff65-ba1b-454c-9c6f-34f8b66b9e7e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:23.867633 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9f79ff65-ba1b-454c-9c6f-34f8b66b9e7e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:23.868066 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9f79ff65-ba1b-454c-9c6f-34f8b66b9e7e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:24.003374 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9f79ff65-ba1b-454c-9c6f-34f8b66b9e7e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:24.010763 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9f79ff65-ba1b-454c-9c6f-34f8b66b9e7e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.155960 Apr 08 11:29:24.011828 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1065/2001] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:23 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:24.016183 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-61a8f820-f247-4b6a-8aa6-6b216dd61008 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:24.016793 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-61a8f820-f247-4b6a-8aa6-6b216dd61008 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:24.022324 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-61a8f820-f247-4b6a-8aa6-6b216dd61008 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:24.022784 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-61a8f820-f247-4b6a-8aa6-6b216dd61008 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:24.023557 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-61a8f820-f247-4b6a-8aa6-6b216dd61008 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:24.023999 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-61a8f820-f247-4b6a-8aa6-6b216dd61008 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:24.082864 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-61a8f820-f247-4b6a-8aa6-6b216dd61008 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:24.090991 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-61a8f820-f247-4b6a-8aa6-6b216dd61008 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078189 Apr 08 11:29:24.091571 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1066/2002] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:24 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:25.028326 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-cae10573-6fd2-485d-959f-9694a5470939 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:25.028971 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-cae10573-6fd2-485d-959f-9694a5470939 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:25.035308 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cae10573-6fd2-485d-959f-9694a5470939 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:25.035777 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cae10573-6fd2-485d-959f-9694a5470939 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:25.036528 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cae10573-6fd2-485d-959f-9694a5470939 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:25.036997 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cae10573-6fd2-485d-959f-9694a5470939 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:25.179361 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-cae10573-6fd2-485d-959f-9694a5470939 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:25.186792 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-cae10573-6fd2-485d-959f-9694a5470939 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.162353 Apr 08 11:29:25.187364 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1067/2003] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:25 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:25.191870 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d983051b-585f-46bc-8b56-f805ddfd5efa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:25.192473 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d983051b-585f-46bc-8b56-f805ddfd5efa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:25.197988 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d983051b-585f-46bc-8b56-f805ddfd5efa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:25.198444 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d983051b-585f-46bc-8b56-f805ddfd5efa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:25.199226 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d983051b-585f-46bc-8b56-f805ddfd5efa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:25.199668 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d983051b-585f-46bc-8b56-f805ddfd5efa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:25.263005 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d983051b-585f-46bc-8b56-f805ddfd5efa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:25.270451 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d983051b-585f-46bc-8b56-f805ddfd5efa tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082143 Apr 08 11:29:25.271032 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1068/2004] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:25 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:26.203502 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0ec0cf39-6cd2-4fcd-a72d-1c276c3b862f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:26.204159 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0ec0cf39-6cd2-4fcd-a72d-1c276c3b862f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:26.210355 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0ec0cf39-6cd2-4fcd-a72d-1c276c3b862f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:26.210799 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0ec0cf39-6cd2-4fcd-a72d-1c276c3b862f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:26.211560 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0ec0cf39-6cd2-4fcd-a72d-1c276c3b862f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:26.211998 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0ec0cf39-6cd2-4fcd-a72d-1c276c3b862f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:26.365123 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0ec0cf39-6cd2-4fcd-a72d-1c276c3b862f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:26.373660 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0ec0cf39-6cd2-4fcd-a72d-1c276c3b862f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.174729 Apr 08 11:29:26.374272 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1069/2005] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:26 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:26.378793 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d914be3e-99f2-48f8-aafb-86df84301c6d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:26.379401 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d914be3e-99f2-48f8-aafb-86df84301c6d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:26.385076 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d914be3e-99f2-48f8-aafb-86df84301c6d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:26.385532 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d914be3e-99f2-48f8-aafb-86df84301c6d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:26.386385 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d914be3e-99f2-48f8-aafb-86df84301c6d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:26.386827 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d914be3e-99f2-48f8-aafb-86df84301c6d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:26.446441 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d914be3e-99f2-48f8-aafb-86df84301c6d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:26.453899 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d914be3e-99f2-48f8-aafb-86df84301c6d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078667 Apr 08 11:29:26.454471 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1070/2006] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:26 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:27.390678 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6e88a987-cc4b-45ba-8c37-d50dab12b7a3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:27.391424 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6e88a987-cc4b-45ba-8c37-d50dab12b7a3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:27.397584 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6e88a987-cc4b-45ba-8c37-d50dab12b7a3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:27.398067 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6e88a987-cc4b-45ba-8c37-d50dab12b7a3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:27.398838 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6e88a987-cc4b-45ba-8c37-d50dab12b7a3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:27.399304 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6e88a987-cc4b-45ba-8c37-d50dab12b7a3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:27.534165 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6e88a987-cc4b-45ba-8c37-d50dab12b7a3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:27.541369 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6e88a987-cc4b-45ba-8c37-d50dab12b7a3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.154547 Apr 08 11:29:27.541958 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1071/2007] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:27 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:27.546907 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-89ca0720-3773-41f6-ac4b-e52722556db3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:27.547511 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-89ca0720-3773-41f6-ac4b-e52722556db3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:27.553231 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-89ca0720-3773-41f6-ac4b-e52722556db3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:27.553681 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-89ca0720-3773-41f6-ac4b-e52722556db3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:27.554510 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-89ca0720-3773-41f6-ac4b-e52722556db3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:27.554954 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-89ca0720-3773-41f6-ac4b-e52722556db3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:27.614611 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-89ca0720-3773-41f6-ac4b-e52722556db3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:27.622859 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-89ca0720-3773-41f6-ac4b-e52722556db3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079330 Apr 08 11:29:27.626982 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1072/2008] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:27 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:28.558424 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b59cc531-52cd-499a-bcdb-11b17b8bbee8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:28.559103 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b59cc531-52cd-499a-bcdb-11b17b8bbee8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:28.565400 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b59cc531-52cd-499a-bcdb-11b17b8bbee8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:28.565889 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b59cc531-52cd-499a-bcdb-11b17b8bbee8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:28.566662 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b59cc531-52cd-499a-bcdb-11b17b8bbee8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:28.567104 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b59cc531-52cd-499a-bcdb-11b17b8bbee8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:28.712355 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b59cc531-52cd-499a-bcdb-11b17b8bbee8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:28.720777 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b59cc531-52cd-499a-bcdb-11b17b8bbee8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.166167 Apr 08 11:29:28.724065 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1073/2009] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:28 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:28.725752 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0e37b902-6c39-4eed-8517-0dcc9d36ac94 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:28.726391 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0e37b902-6c39-4eed-8517-0dcc9d36ac94 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:28.732138 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0e37b902-6c39-4eed-8517-0dcc9d36ac94 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:28.732598 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0e37b902-6c39-4eed-8517-0dcc9d36ac94 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:28.733619 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0e37b902-6c39-4eed-8517-0dcc9d36ac94 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:28.733994 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0e37b902-6c39-4eed-8517-0dcc9d36ac94 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:28.796422 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0e37b902-6c39-4eed-8517-0dcc9d36ac94 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:28.804018 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0e37b902-6c39-4eed-8517-0dcc9d36ac94 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081664 Apr 08 11:29:28.804795 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1074/2010] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:28 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:29.738198 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-99967e2f-f6f4-4a47-ae5b-c8712dcf3200 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:29.738892 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-99967e2f-f6f4-4a47-ae5b-c8712dcf3200 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:29.745504 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-99967e2f-f6f4-4a47-ae5b-c8712dcf3200 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:29.746039 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-99967e2f-f6f4-4a47-ae5b-c8712dcf3200 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:29.746815 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-99967e2f-f6f4-4a47-ae5b-c8712dcf3200 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:29.747256 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-99967e2f-f6f4-4a47-ae5b-c8712dcf3200 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:30.049052 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-99967e2f-f6f4-4a47-ae5b-c8712dcf3200 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:30.056389 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-99967e2f-f6f4-4a47-ae5b-c8712dcf3200 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.322190 Apr 08 11:29:30.056971 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1075/2011] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:29 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:30.061954 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-cce6d3fe-b483-40b8-af45-c5e941d817db tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:30.062561 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-cce6d3fe-b483-40b8-af45-c5e941d817db tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:30.068154 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cce6d3fe-b483-40b8-af45-c5e941d817db tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:30.068609 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cce6d3fe-b483-40b8-af45-c5e941d817db tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:30.069379 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cce6d3fe-b483-40b8-af45-c5e941d817db tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:30.069886 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cce6d3fe-b483-40b8-af45-c5e941d817db tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:30.129429 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-cce6d3fe-b483-40b8-af45-c5e941d817db tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:30.137037 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-cce6d3fe-b483-40b8-af45-c5e941d817db tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079118 Apr 08 11:29:30.137604 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1076/2012] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:30 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:31.073886 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-22048ffe-8dd7-41d1-ab13-c27049e4721a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:31.074512 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-22048ffe-8dd7-41d1-ab13-c27049e4721a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:31.080770 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-22048ffe-8dd7-41d1-ab13-c27049e4721a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:31.081220 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-22048ffe-8dd7-41d1-ab13-c27049e4721a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:31.082029 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-22048ffe-8dd7-41d1-ab13-c27049e4721a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:31.082475 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-22048ffe-8dd7-41d1-ab13-c27049e4721a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:31.217686 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-22048ffe-8dd7-41d1-ab13-c27049e4721a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:31.229296 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-22048ffe-8dd7-41d1-ab13-c27049e4721a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.159123 Apr 08 11:29:31.229930 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1077/2013] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:31 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:31.235147 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a8d3457b-3537-470d-ad51-25e69e2937b8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:31.235766 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a8d3457b-3537-470d-ad51-25e69e2937b8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:31.242596 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a8d3457b-3537-470d-ad51-25e69e2937b8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:31.243053 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a8d3457b-3537-470d-ad51-25e69e2937b8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:31.243840 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a8d3457b-3537-470d-ad51-25e69e2937b8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:31.244284 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a8d3457b-3537-470d-ad51-25e69e2937b8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:31.305827 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a8d3457b-3537-470d-ad51-25e69e2937b8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:31.313160 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a8d3457b-3537-470d-ad51-25e69e2937b8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082264 Apr 08 11:29:31.313724 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1078/2014] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:31 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:31.892430 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 11:29:31.892686 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:29:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 11:29:32.248949 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-34440b41-a44d-44ea-bc04-3fce1cf52d5c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:32.249633 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-34440b41-a44d-44ea-bc04-3fce1cf52d5c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:32.255933 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-34440b41-a44d-44ea-bc04-3fce1cf52d5c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:32.256386 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-34440b41-a44d-44ea-bc04-3fce1cf52d5c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:32.257156 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-34440b41-a44d-44ea-bc04-3fce1cf52d5c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:32.257598 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-34440b41-a44d-44ea-bc04-3fce1cf52d5c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:32.390785 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-34440b41-a44d-44ea-bc04-3fce1cf52d5c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:32.398141 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-34440b41-a44d-44ea-bc04-3fce1cf52d5c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.153906 Apr 08 11:29:32.398867 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1079/2015] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:32 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:32.403264 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-45bb9008-e95f-46cd-a5e6-711e3dd11abd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:32.403857 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-45bb9008-e95f-46cd-a5e6-711e3dd11abd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:32.409266 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-45bb9008-e95f-46cd-a5e6-711e3dd11abd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:32.409707 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-45bb9008-e95f-46cd-a5e6-711e3dd11abd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:32.410503 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-45bb9008-e95f-46cd-a5e6-711e3dd11abd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:32.410934 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-45bb9008-e95f-46cd-a5e6-711e3dd11abd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:32.468341 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-45bb9008-e95f-46cd-a5e6-711e3dd11abd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:32.475537 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-45bb9008-e95f-46cd-a5e6-711e3dd11abd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.075736 Apr 08 11:29:32.476096 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1080/2016] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:32 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:33.415319 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-66219d7f-f1a0-4255-8a49-fcdb776ce1e0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:33.416024 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-66219d7f-f1a0-4255-8a49-fcdb776ce1e0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:33.422652 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-66219d7f-f1a0-4255-8a49-fcdb776ce1e0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:33.423108 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-66219d7f-f1a0-4255-8a49-fcdb776ce1e0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:33.423902 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-66219d7f-f1a0-4255-8a49-fcdb776ce1e0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:33.424355 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-66219d7f-f1a0-4255-8a49-fcdb776ce1e0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:33.563090 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-66219d7f-f1a0-4255-8a49-fcdb776ce1e0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:33.570581 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-66219d7f-f1a0-4255-8a49-fcdb776ce1e0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.159102 Apr 08 11:29:33.571176 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1081/2017] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:33 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:33.576350 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-390ae2c4-68b0-4b1b-8c6b-e1670679acbc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:33.577046 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-390ae2c4-68b0-4b1b-8c6b-e1670679acbc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:33.583279 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-390ae2c4-68b0-4b1b-8c6b-e1670679acbc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:33.583723 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-390ae2c4-68b0-4b1b-8c6b-e1670679acbc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:33.584495 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-390ae2c4-68b0-4b1b-8c6b-e1670679acbc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:33.584925 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-390ae2c4-68b0-4b1b-8c6b-e1670679acbc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:33.647363 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-390ae2c4-68b0-4b1b-8c6b-e1670679acbc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:33.655145 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-390ae2c4-68b0-4b1b-8c6b-e1670679acbc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082884 Apr 08 11:29:33.655720 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1082/2018] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:33 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:34.588335 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c3ad099b-9987-4b58-ae64-ce427cbb2f7e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:34.589002 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c3ad099b-9987-4b58-ae64-ce427cbb2f7e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:34.595819 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c3ad099b-9987-4b58-ae64-ce427cbb2f7e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:34.596269 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c3ad099b-9987-4b58-ae64-ce427cbb2f7e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:34.597029 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c3ad099b-9987-4b58-ae64-ce427cbb2f7e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:34.597464 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c3ad099b-9987-4b58-ae64-ce427cbb2f7e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:34.733463 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c3ad099b-9987-4b58-ae64-ce427cbb2f7e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:34.740834 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c3ad099b-9987-4b58-ae64-ce427cbb2f7e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.156358 Apr 08 11:29:34.741389 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1083/2019] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:34 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:34.746049 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-499f8511-fc76-4b18-9c5f-38351560dbf0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:34.746646 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-499f8511-fc76-4b18-9c5f-38351560dbf0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:34.752930 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-499f8511-fc76-4b18-9c5f-38351560dbf0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:34.753389 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-499f8511-fc76-4b18-9c5f-38351560dbf0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:34.754200 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-499f8511-fc76-4b18-9c5f-38351560dbf0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:34.754640 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-499f8511-fc76-4b18-9c5f-38351560dbf0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:34.816239 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-499f8511-fc76-4b18-9c5f-38351560dbf0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:34.823595 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-499f8511-fc76-4b18-9c5f-38351560dbf0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081243 Apr 08 11:29:34.824157 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1084/2020] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:34 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:35.758379 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ca067a95-e006-4876-9c1f-dc011a5a47ee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:35.758999 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ca067a95-e006-4876-9c1f-dc011a5a47ee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:35.765946 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ca067a95-e006-4876-9c1f-dc011a5a47ee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:35.766399 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ca067a95-e006-4876-9c1f-dc011a5a47ee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:35.767174 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ca067a95-e006-4876-9c1f-dc011a5a47ee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:35.767613 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ca067a95-e006-4876-9c1f-dc011a5a47ee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:35.901169 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ca067a95-e006-4876-9c1f-dc011a5a47ee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:35.908984 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ca067a95-e006-4876-9c1f-dc011a5a47ee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.154472 Apr 08 11:29:35.909558 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1085/2021] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:35 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:35.914244 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2a3ef624-7b38-4f34-9761-edfc86bbb36e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:35.914852 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2a3ef624-7b38-4f34-9761-edfc86bbb36e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:35.920717 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2a3ef624-7b38-4f34-9761-edfc86bbb36e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:35.921179 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2a3ef624-7b38-4f34-9761-edfc86bbb36e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:35.922027 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2a3ef624-7b38-4f34-9761-edfc86bbb36e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:35.922477 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2a3ef624-7b38-4f34-9761-edfc86bbb36e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:35.982597 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2a3ef624-7b38-4f34-9761-edfc86bbb36e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:35.990420 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2a3ef624-7b38-4f34-9761-edfc86bbb36e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079842 Apr 08 11:29:35.990998 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1086/2022] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:35 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:36.926080 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2513fe97-4a12-4889-b0a5-40ef668cf897 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:36.926735 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2513fe97-4a12-4889-b0a5-40ef668cf897 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:36.932859 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2513fe97-4a12-4889-b0a5-40ef668cf897 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:36.933307 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2513fe97-4a12-4889-b0a5-40ef668cf897 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:36.934102 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2513fe97-4a12-4889-b0a5-40ef668cf897 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:36.934537 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2513fe97-4a12-4889-b0a5-40ef668cf897 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:37.077998 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2513fe97-4a12-4889-b0a5-40ef668cf897 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:37.079410 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2513fe97-4a12-4889-b0a5-40ef668cf897 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.157272 Apr 08 11:29:37.079985 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1087/2023] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:36 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:37.084348 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-965ca40f-71be-42d2-ad14-5880ae81b4e6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:37.084952 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-965ca40f-71be-42d2-ad14-5880ae81b4e6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:37.090845 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-965ca40f-71be-42d2-ad14-5880ae81b4e6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:37.091893 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-965ca40f-71be-42d2-ad14-5880ae81b4e6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:37.092676 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-965ca40f-71be-42d2-ad14-5880ae81b4e6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:37.093112 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-965ca40f-71be-42d2-ad14-5880ae81b4e6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:37.151665 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-965ca40f-71be-42d2-ad14-5880ae81b4e6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:37.159165 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-965ca40f-71be-42d2-ad14-5880ae81b4e6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078245 Apr 08 11:29:37.159756 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1088/2024] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:37 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:38.097140 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-33d99159-c562-4559-a32e-a7d6f0113b73 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:38.098089 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-33d99159-c562-4559-a32e-a7d6f0113b73 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:38.104156 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-33d99159-c562-4559-a32e-a7d6f0113b73 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:38.104603 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-33d99159-c562-4559-a32e-a7d6f0113b73 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:38.105372 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-33d99159-c562-4559-a32e-a7d6f0113b73 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:38.105827 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-33d99159-c562-4559-a32e-a7d6f0113b73 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:38.240660 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-33d99159-c562-4559-a32e-a7d6f0113b73 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:38.248645 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-33d99159-c562-4559-a32e-a7d6f0113b73 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.155357 Apr 08 11:29:38.249231 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1089/2025] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:38 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:38.253712 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-491677b7-7a19-47e4-a5cc-3a0e57c80bd8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:38.254354 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-491677b7-7a19-47e4-a5cc-3a0e57c80bd8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:38.260085 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-491677b7-7a19-47e4-a5cc-3a0e57c80bd8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:38.260543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-491677b7-7a19-47e4-a5cc-3a0e57c80bd8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:38.261323 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-491677b7-7a19-47e4-a5cc-3a0e57c80bd8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:38.261757 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-491677b7-7a19-47e4-a5cc-3a0e57c80bd8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:38.320938 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-491677b7-7a19-47e4-a5cc-3a0e57c80bd8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:38.328824 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-491677b7-7a19-47e4-a5cc-3a0e57c80bd8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078655 Apr 08 11:29:38.329395 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1090/2026] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:38 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:39.266311 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-66b04340-2b2e-435d-8bdd-edd8ea5bdb24 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:39.267013 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-66b04340-2b2e-435d-8bdd-edd8ea5bdb24 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:39.273145 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-66b04340-2b2e-435d-8bdd-edd8ea5bdb24 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:39.273593 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-66b04340-2b2e-435d-8bdd-edd8ea5bdb24 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:39.274388 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-66b04340-2b2e-435d-8bdd-edd8ea5bdb24 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:39.274828 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-66b04340-2b2e-435d-8bdd-edd8ea5bdb24 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:39.420976 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-66b04340-2b2e-435d-8bdd-edd8ea5bdb24 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:39.428397 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-66b04340-2b2e-435d-8bdd-edd8ea5bdb24 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.166570 Apr 08 11:29:39.429035 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1091/2027] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:39 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:39.433464 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-20939750-d8c1-4081-a79f-6fe9e101c2f4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:39.434089 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-20939750-d8c1-4081-a79f-6fe9e101c2f4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:39.440336 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-20939750-d8c1-4081-a79f-6fe9e101c2f4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:39.440780 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-20939750-d8c1-4081-a79f-6fe9e101c2f4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:39.441545 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-20939750-d8c1-4081-a79f-6fe9e101c2f4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:39.442007 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-20939750-d8c1-4081-a79f-6fe9e101c2f4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:39.502320 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-20939750-d8c1-4081-a79f-6fe9e101c2f4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:39.509795 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-20939750-d8c1-4081-a79f-6fe9e101c2f4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079807 Apr 08 11:29:39.510454 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1092/2028] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:39 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:40.447205 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-56ad1c39-5312-494a-ba97-7a6f61ff26a2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:40.447869 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-56ad1c39-5312-494a-ba97-7a6f61ff26a2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:40.454112 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-56ad1c39-5312-494a-ba97-7a6f61ff26a2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:40.454571 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-56ad1c39-5312-494a-ba97-7a6f61ff26a2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:40.455341 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-56ad1c39-5312-494a-ba97-7a6f61ff26a2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:40.455782 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-56ad1c39-5312-494a-ba97-7a6f61ff26a2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:40.589758 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-56ad1c39-5312-494a-ba97-7a6f61ff26a2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:40.597579 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-56ad1c39-5312-494a-ba97-7a6f61ff26a2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.154365 Apr 08 11:29:40.598182 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1093/2029] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:40 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:40.602538 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e975f561-338c-43b4-89ea-59ee74c8c829 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:40.603152 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e975f561-338c-43b4-89ea-59ee74c8c829 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:40.609312 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e975f561-338c-43b4-89ea-59ee74c8c829 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:40.609786 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e975f561-338c-43b4-89ea-59ee74c8c829 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:40.610561 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e975f561-338c-43b4-89ea-59ee74c8c829 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:40.611003 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e975f561-338c-43b4-89ea-59ee74c8c829 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:40.674144 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e975f561-338c-43b4-89ea-59ee74c8c829 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:40.681700 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e975f561-338c-43b4-89ea-59ee74c8c829 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082497 Apr 08 11:29:40.682301 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1094/2030] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:40 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:41.615240 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-358fb3d4-6b01-493c-8415-4a6d0e75bce4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:41.615926 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-358fb3d4-6b01-493c-8415-4a6d0e75bce4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:41.623024 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-358fb3d4-6b01-493c-8415-4a6d0e75bce4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:41.623473 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-358fb3d4-6b01-493c-8415-4a6d0e75bce4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:41.624230 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-358fb3d4-6b01-493c-8415-4a6d0e75bce4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:41.624665 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-358fb3d4-6b01-493c-8415-4a6d0e75bce4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:41.770876 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-358fb3d4-6b01-493c-8415-4a6d0e75bce4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:41.778278 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-358fb3d4-6b01-493c-8415-4a6d0e75bce4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.166867 Apr 08 11:29:41.778901 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1095/2031] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:41 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:41.783308 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-edb52296-1e7a-4f38-bd6e-ce51f9f9e9d5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:41.783916 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-edb52296-1e7a-4f38-bd6e-ce51f9f9e9d5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:41.789634 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-edb52296-1e7a-4f38-bd6e-ce51f9f9e9d5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:41.790119 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-edb52296-1e7a-4f38-bd6e-ce51f9f9e9d5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:41.790884 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-edb52296-1e7a-4f38-bd6e-ce51f9f9e9d5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:41.791321 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-edb52296-1e7a-4f38-bd6e-ce51f9f9e9d5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:41.850699 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-edb52296-1e7a-4f38-bd6e-ce51f9f9e9d5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:41.858570 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-edb52296-1e7a-4f38-bd6e-ce51f9f9e9d5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078716 Apr 08 11:29:41.859145 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1096/2032] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:41 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:42.796250 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-22c491be-b7b4-414c-a91a-e84684707a83 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:42.796952 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-22c491be-b7b4-414c-a91a-e84684707a83 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:42.803732 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-22c491be-b7b4-414c-a91a-e84684707a83 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:42.804186 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-22c491be-b7b4-414c-a91a-e84684707a83 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:42.804980 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-22c491be-b7b4-414c-a91a-e84684707a83 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:42.805421 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-22c491be-b7b4-414c-a91a-e84684707a83 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:42.943021 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-22c491be-b7b4-414c-a91a-e84684707a83 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:42.950786 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-22c491be-b7b4-414c-a91a-e84684707a83 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.159050 Apr 08 11:29:42.951363 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1097/2033] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:42 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:42.955774 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b483f8d1-cdec-4000-89ae-44bd90797a4c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:42.956379 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b483f8d1-cdec-4000-89ae-44bd90797a4c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:42.962255 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b483f8d1-cdec-4000-89ae-44bd90797a4c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:42.962706 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b483f8d1-cdec-4000-89ae-44bd90797a4c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:42.963477 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b483f8d1-cdec-4000-89ae-44bd90797a4c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:42.963972 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b483f8d1-cdec-4000-89ae-44bd90797a4c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:43.024865 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b483f8d1-cdec-4000-89ae-44bd90797a4c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:43.032862 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b483f8d1-cdec-4000-89ae-44bd90797a4c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080553 Apr 08 11:29:43.033425 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1098/2034] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:42 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:43.968488 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5f5ee9d4-4d99-4a5e-9253-0bfea45287bd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:43.969140 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5f5ee9d4-4d99-4a5e-9253-0bfea45287bd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:43.975380 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5f5ee9d4-4d99-4a5e-9253-0bfea45287bd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:43.975834 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5f5ee9d4-4d99-4a5e-9253-0bfea45287bd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:43.976599 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5f5ee9d4-4d99-4a5e-9253-0bfea45287bd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:43.977039 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5f5ee9d4-4d99-4a5e-9253-0bfea45287bd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:44.113174 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5f5ee9d4-4d99-4a5e-9253-0bfea45287bd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:44.120767 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5f5ee9d4-4d99-4a5e-9253-0bfea45287bd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.156904 Apr 08 11:29:44.121341 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1099/2035] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:43 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:44.125932 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f38ea692-b70c-4ba4-9287-ea6b355681f3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:44.126535 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f38ea692-b70c-4ba4-9287-ea6b355681f3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:44.132118 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f38ea692-b70c-4ba4-9287-ea6b355681f3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:44.132569 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f38ea692-b70c-4ba4-9287-ea6b355681f3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:44.133331 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f38ea692-b70c-4ba4-9287-ea6b355681f3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:44.133784 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f38ea692-b70c-4ba4-9287-ea6b355681f3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:44.196249 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f38ea692-b70c-4ba4-9287-ea6b355681f3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:44.204418 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f38ea692-b70c-4ba4-9287-ea6b355681f3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082077 Apr 08 11:29:44.205058 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1100/2036] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:44 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:45.138105 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-41e48708-719f-4bd6-8f82-19ba7edd9b79 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:45.138844 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-41e48708-719f-4bd6-8f82-19ba7edd9b79 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:45.145953 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-41e48708-719f-4bd6-8f82-19ba7edd9b79 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:45.146421 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-41e48708-719f-4bd6-8f82-19ba7edd9b79 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:45.147167 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-41e48708-719f-4bd6-8f82-19ba7edd9b79 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:45.147607 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-41e48708-719f-4bd6-8f82-19ba7edd9b79 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:45.289954 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-41e48708-719f-4bd6-8f82-19ba7edd9b79 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:45.297815 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-41e48708-719f-4bd6-8f82-19ba7edd9b79 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.163734 Apr 08 11:29:45.298391 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1101/2037] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:45 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:45.302784 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0fe29a55-0a45-423b-bc59-eee100594035 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:45.303364 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0fe29a55-0a45-423b-bc59-eee100594035 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:45.309095 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0fe29a55-0a45-423b-bc59-eee100594035 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:45.309522 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0fe29a55-0a45-423b-bc59-eee100594035 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:45.310311 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0fe29a55-0a45-423b-bc59-eee100594035 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:45.310744 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0fe29a55-0a45-423b-bc59-eee100594035 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:45.371383 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0fe29a55-0a45-423b-bc59-eee100594035 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:45.379888 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0fe29a55-0a45-423b-bc59-eee100594035 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080541 Apr 08 11:29:45.380465 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1102/2038] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:45 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:46.315537 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ffc05d0f-8548-4870-b9bd-f9ae11f50692 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:46.316217 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ffc05d0f-8548-4870-b9bd-f9ae11f50692 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:46.322566 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ffc05d0f-8548-4870-b9bd-f9ae11f50692 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:46.323023 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ffc05d0f-8548-4870-b9bd-f9ae11f50692 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:46.323798 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ffc05d0f-8548-4870-b9bd-f9ae11f50692 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:46.324243 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ffc05d0f-8548-4870-b9bd-f9ae11f50692 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:46.459688 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ffc05d0f-8548-4870-b9bd-f9ae11f50692 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:46.467070 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ffc05d0f-8548-4870-b9bd-f9ae11f50692 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.156017 Apr 08 11:29:46.468147 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1103/2039] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:46 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:46.472494 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-77555d6c-930e-41d1-85ec-98fb543faa52 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:46.473096 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-77555d6c-930e-41d1-85ec-98fb543faa52 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:46.478984 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-77555d6c-930e-41d1-85ec-98fb543faa52 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:46.479432 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-77555d6c-930e-41d1-85ec-98fb543faa52 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:46.480229 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-77555d6c-930e-41d1-85ec-98fb543faa52 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:46.480678 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-77555d6c-930e-41d1-85ec-98fb543faa52 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:46.539035 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-77555d6c-930e-41d1-85ec-98fb543faa52 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:46.547028 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-77555d6c-930e-41d1-85ec-98fb543faa52 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077918 Apr 08 11:29:46.547592 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1104/2040] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:46 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:47.485455 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f186de21-4ec7-4367-b0a6-8d52e96a94d3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:47.486229 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f186de21-4ec7-4367-b0a6-8d52e96a94d3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:47.492408 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f186de21-4ec7-4367-b0a6-8d52e96a94d3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:47.493129 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f186de21-4ec7-4367-b0a6-8d52e96a94d3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:47.493931 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f186de21-4ec7-4367-b0a6-8d52e96a94d3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:47.494376 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f186de21-4ec7-4367-b0a6-8d52e96a94d3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:47.629158 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f186de21-4ec7-4367-b0a6-8d52e96a94d3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:47.636607 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f186de21-4ec7-4367-b0a6-8d52e96a94d3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.155044 Apr 08 11:29:47.637189 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1105/2041] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:47 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:47.641809 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d881ece1-3194-4faa-8e9a-c003ff00d814 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:47.642494 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d881ece1-3194-4faa-8e9a-c003ff00d814 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:47.648670 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d881ece1-3194-4faa-8e9a-c003ff00d814 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:47.649134 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d881ece1-3194-4faa-8e9a-c003ff00d814 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:47.649954 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d881ece1-3194-4faa-8e9a-c003ff00d814 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:47.650400 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d881ece1-3194-4faa-8e9a-c003ff00d814 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:47.714532 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d881ece1-3194-4faa-8e9a-c003ff00d814 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:47.721969 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d881ece1-3194-4faa-8e9a-c003ff00d814 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.083797 Apr 08 11:29:47.722556 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1106/2042] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:47 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:48.653751 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d9ad93d7-50f1-4c9a-b4d5-e95fbfa34194 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:48.654371 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d9ad93d7-50f1-4c9a-b4d5-e95fbfa34194 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:48.661279 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d9ad93d7-50f1-4c9a-b4d5-e95fbfa34194 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:48.661724 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d9ad93d7-50f1-4c9a-b4d5-e95fbfa34194 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:48.662511 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d9ad93d7-50f1-4c9a-b4d5-e95fbfa34194 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:48.662941 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d9ad93d7-50f1-4c9a-b4d5-e95fbfa34194 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:48.794789 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d9ad93d7-50f1-4c9a-b4d5-e95fbfa34194 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:48.802097 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d9ad93d7-50f1-4c9a-b4d5-e95fbfa34194 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.152158 Apr 08 11:29:48.802659 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1107/2043] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:48 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:48.806958 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bee84000-ee1b-477f-b2b1-88b6d68742cc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:48.807555 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-bee84000-ee1b-477f-b2b1-88b6d68742cc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:48.813429 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bee84000-ee1b-477f-b2b1-88b6d68742cc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:48.813908 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bee84000-ee1b-477f-b2b1-88b6d68742cc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:48.814671 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bee84000-ee1b-477f-b2b1-88b6d68742cc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:48.815111 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bee84000-ee1b-477f-b2b1-88b6d68742cc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:48.872851 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-bee84000-ee1b-477f-b2b1-88b6d68742cc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:48.880530 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-bee84000-ee1b-477f-b2b1-88b6d68742cc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.076945 Apr 08 11:29:48.881097 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1108/2044] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:48 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:49.819034 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e24f2b2f-59d9-474c-bda1-0294b0b6e028 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:49.819738 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e24f2b2f-59d9-474c-bda1-0294b0b6e028 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:49.826095 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e24f2b2f-59d9-474c-bda1-0294b0b6e028 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:49.826541 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e24f2b2f-59d9-474c-bda1-0294b0b6e028 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:49.827828 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e24f2b2f-59d9-474c-bda1-0294b0b6e028 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:49.828261 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e24f2b2f-59d9-474c-bda1-0294b0b6e028 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:49.967657 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e24f2b2f-59d9-474c-bda1-0294b0b6e028 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:49.975813 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e24f2b2f-59d9-474c-bda1-0294b0b6e028 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.160559 Apr 08 11:29:49.976398 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1109/2045] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:49 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:49.980901 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d883b402-8ac6-45b4-bf1b-9fb62dc3b354 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:49.981512 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d883b402-8ac6-45b4-bf1b-9fb62dc3b354 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:49.987458 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d883b402-8ac6-45b4-bf1b-9fb62dc3b354 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:49.987906 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d883b402-8ac6-45b4-bf1b-9fb62dc3b354 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:49.988683 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d883b402-8ac6-45b4-bf1b-9fb62dc3b354 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:49.989124 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d883b402-8ac6-45b4-bf1b-9fb62dc3b354 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:50.049536 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d883b402-8ac6-45b4-bf1b-9fb62dc3b354 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:50.057018 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d883b402-8ac6-45b4-bf1b-9fb62dc3b354 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079672 Apr 08 11:29:50.057590 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1110/2046] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:49 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:50.993612 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8117be9b-a7c9-4936-bddf-35e88401bcf5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:50.994288 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8117be9b-a7c9-4936-bddf-35e88401bcf5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:51.001319 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8117be9b-a7c9-4936-bddf-35e88401bcf5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:51.001796 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8117be9b-a7c9-4936-bddf-35e88401bcf5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:51.002633 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8117be9b-a7c9-4936-bddf-35e88401bcf5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:51.003122 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8117be9b-a7c9-4936-bddf-35e88401bcf5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:51.157413 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8117be9b-a7c9-4936-bddf-35e88401bcf5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:51.164922 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8117be9b-a7c9-4936-bddf-35e88401bcf5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.175740 Apr 08 11:29:51.165491 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1111/2047] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:50 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:51.169994 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-02197738-09cc-4195-a95b-48638113f494 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:51.170614 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-02197738-09cc-4195-a95b-48638113f494 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:51.177347 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-02197738-09cc-4195-a95b-48638113f494 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:51.177826 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-02197738-09cc-4195-a95b-48638113f494 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:51.178762 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-02197738-09cc-4195-a95b-48638113f494 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:51.179209 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-02197738-09cc-4195-a95b-48638113f494 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:51.246590 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-02197738-09cc-4195-a95b-48638113f494 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:51.258919 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-02197738-09cc-4195-a95b-48638113f494 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.092055 Apr 08 11:29:51.260041 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1112/2048] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:51 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:52.182852 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c1a5a462-7e29-4f04-9127-fa5140f8353a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:52.183541 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c1a5a462-7e29-4f04-9127-fa5140f8353a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:52.191467 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c1a5a462-7e29-4f04-9127-fa5140f8353a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:52.191922 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c1a5a462-7e29-4f04-9127-fa5140f8353a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:52.192721 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c1a5a462-7e29-4f04-9127-fa5140f8353a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:52.193460 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c1a5a462-7e29-4f04-9127-fa5140f8353a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:52.329282 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c1a5a462-7e29-4f04-9127-fa5140f8353a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:52.336726 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c1a5a462-7e29-4f04-9127-fa5140f8353a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.157846 Apr 08 11:29:52.337298 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1113/2049] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:52 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:52.341716 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8ba4e013-c916-42e4-a662-a4ca68f785fc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:52.342339 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8ba4e013-c916-42e4-a662-a4ca68f785fc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:52.347812 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8ba4e013-c916-42e4-a662-a4ca68f785fc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:52.348260 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8ba4e013-c916-42e4-a662-a4ca68f785fc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:52.349024 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8ba4e013-c916-42e4-a662-a4ca68f785fc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:52.349459 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8ba4e013-c916-42e4-a662-a4ca68f785fc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:52.409274 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8ba4e013-c916-42e4-a662-a4ca68f785fc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:52.416587 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8ba4e013-c916-42e4-a662-a4ca68f785fc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078331 Apr 08 11:29:52.417148 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1114/2050] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:52 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:53.352962 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-592b37a9-0b64-48cc-80e1-a6268da1bae4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:53.353675 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-592b37a9-0b64-48cc-80e1-a6268da1bae4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:53.360030 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-592b37a9-0b64-48cc-80e1-a6268da1bae4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:53.360488 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-592b37a9-0b64-48cc-80e1-a6268da1bae4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:53.361263 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-592b37a9-0b64-48cc-80e1-a6268da1bae4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:53.361703 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-592b37a9-0b64-48cc-80e1-a6268da1bae4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:53.506293 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-592b37a9-0b64-48cc-80e1-a6268da1bae4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:53.517008 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-592b37a9-0b64-48cc-80e1-a6268da1bae4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.167897 Apr 08 11:29:53.517598 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1115/2051] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:53 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:53.522969 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-42236656-1678-4275-bb55-3953016e9e00 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:53.523582 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-42236656-1678-4275-bb55-3953016e9e00 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:53.529845 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-42236656-1678-4275-bb55-3953016e9e00 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:53.530304 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-42236656-1678-4275-bb55-3953016e9e00 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:53.531076 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-42236656-1678-4275-bb55-3953016e9e00 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:53.531612 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-42236656-1678-4275-bb55-3953016e9e00 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:53.589416 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-42236656-1678-4275-bb55-3953016e9e00 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:53.596861 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-42236656-1678-4275-bb55-3953016e9e00 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078278 Apr 08 11:29:53.597437 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1116/2052] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:53 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:54.534174 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d8d9be71-2944-4734-934f-2d5e1b11e423 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:54.534837 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d8d9be71-2944-4734-934f-2d5e1b11e423 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:54.541222 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d8d9be71-2944-4734-934f-2d5e1b11e423 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:54.541677 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d8d9be71-2944-4734-934f-2d5e1b11e423 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:54.542479 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d8d9be71-2944-4734-934f-2d5e1b11e423 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:54.542923 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d8d9be71-2944-4734-934f-2d5e1b11e423 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:54.677638 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d8d9be71-2944-4734-934f-2d5e1b11e423 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:54.684987 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d8d9be71-2944-4734-934f-2d5e1b11e423 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.154678 Apr 08 11:29:54.685559 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1117/2053] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:54 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:54.689990 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0f57f99c-db04-4380-acc1-b88d9e223e60 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:54.690627 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0f57f99c-db04-4380-acc1-b88d9e223e60 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:54.696206 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0f57f99c-db04-4380-acc1-b88d9e223e60 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:54.696679 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0f57f99c-db04-4380-acc1-b88d9e223e60 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:54.697451 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0f57f99c-db04-4380-acc1-b88d9e223e60 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:54.697926 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0f57f99c-db04-4380-acc1-b88d9e223e60 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:54.757625 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0f57f99c-db04-4380-acc1-b88d9e223e60 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:54.765177 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0f57f99c-db04-4380-acc1-b88d9e223e60 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078633 Apr 08 11:29:54.765757 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1118/2054] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:54 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:55.702272 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8bdb571b-f1ab-4d0e-b38d-4e7d161598de tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:55.702951 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8bdb571b-f1ab-4d0e-b38d-4e7d161598de tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:55.710120 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8bdb571b-f1ab-4d0e-b38d-4e7d161598de tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:55.710576 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8bdb571b-f1ab-4d0e-b38d-4e7d161598de tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:55.711368 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8bdb571b-f1ab-4d0e-b38d-4e7d161598de tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:55.711813 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8bdb571b-f1ab-4d0e-b38d-4e7d161598de tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:55.874691 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8bdb571b-f1ab-4d0e-b38d-4e7d161598de tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:55.882894 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8bdb571b-f1ab-4d0e-b38d-4e7d161598de tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.184510 Apr 08 11:29:55.883474 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1119/2055] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:55 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:55.888334 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0f3ec454-8353-4887-b18b-e6b7e2417b83 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:55.888944 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0f3ec454-8353-4887-b18b-e6b7e2417b83 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:55.898639 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0f3ec454-8353-4887-b18b-e6b7e2417b83 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:55.899707 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0f3ec454-8353-4887-b18b-e6b7e2417b83 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:55.899890 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0f3ec454-8353-4887-b18b-e6b7e2417b83 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:55.900326 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0f3ec454-8353-4887-b18b-e6b7e2417b83 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:55.972696 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0f3ec454-8353-4887-b18b-e6b7e2417b83 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:55.981386 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0f3ec454-8353-4887-b18b-e6b7e2417b83 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.095950 Apr 08 11:29:55.982349 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1120/2056] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:55 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:56.900779 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8af216d8-4efa-4714-97ef-e9b70aedcc34 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:56.902072 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8af216d8-4efa-4714-97ef-e9b70aedcc34 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:56.907250 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8af216d8-4efa-4714-97ef-e9b70aedcc34 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:56.907699 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8af216d8-4efa-4714-97ef-e9b70aedcc34 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:56.908466 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8af216d8-4efa-4714-97ef-e9b70aedcc34 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:56.908907 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8af216d8-4efa-4714-97ef-e9b70aedcc34 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:57.039559 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8af216d8-4efa-4714-97ef-e9b70aedcc34 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:57.046970 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8af216d8-4efa-4714-97ef-e9b70aedcc34 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.150368 Apr 08 11:29:57.047613 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1121/2057] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:56 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:57.052265 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-50aea3d3-e31e-4f96-90e1-bdcd7bc9059f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:57.052883 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-50aea3d3-e31e-4f96-90e1-bdcd7bc9059f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:57.059127 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-50aea3d3-e31e-4f96-90e1-bdcd7bc9059f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:57.059584 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-50aea3d3-e31e-4f96-90e1-bdcd7bc9059f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:57.060360 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-50aea3d3-e31e-4f96-90e1-bdcd7bc9059f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:57.060817 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-50aea3d3-e31e-4f96-90e1-bdcd7bc9059f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:57.123241 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-50aea3d3-e31e-4f96-90e1-bdcd7bc9059f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:57.131239 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-50aea3d3-e31e-4f96-90e1-bdcd7bc9059f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082674 Apr 08 11:29:57.131805 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1122/2058] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:57 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:58.064035 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-eeac4903-2338-42d6-b987-1e5f78da541d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:58.064760 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-eeac4903-2338-42d6-b987-1e5f78da541d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:58.071109 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-eeac4903-2338-42d6-b987-1e5f78da541d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:58.071561 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-eeac4903-2338-42d6-b987-1e5f78da541d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:58.072378 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-eeac4903-2338-42d6-b987-1e5f78da541d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:58.072820 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-eeac4903-2338-42d6-b987-1e5f78da541d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:58.211089 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-eeac4903-2338-42d6-b987-1e5f78da541d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:58.218510 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-eeac4903-2338-42d6-b987-1e5f78da541d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.158450 Apr 08 11:29:58.219087 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1123/2059] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:58 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:58.224028 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-34b790da-b24a-4a78-9049-46e241936e47 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:58.224664 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-34b790da-b24a-4a78-9049-46e241936e47 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:58.230780 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-34b790da-b24a-4a78-9049-46e241936e47 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:58.231281 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-34b790da-b24a-4a78-9049-46e241936e47 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:58.232062 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-34b790da-b24a-4a78-9049-46e241936e47 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:58.232508 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-34b790da-b24a-4a78-9049-46e241936e47 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:58.291321 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-34b790da-b24a-4a78-9049-46e241936e47 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:58.298643 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-34b790da-b24a-4a78-9049-46e241936e47 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078620 Apr 08 11:29:58.299217 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1124/2060] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:58 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:29:59.236619 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a77de868-9bec-4698-97dc-aa9b1c9894ee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:59.237315 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a77de868-9bec-4698-97dc-aa9b1c9894ee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:59.244450 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a77de868-9bec-4698-97dc-aa9b1c9894ee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:59.244906 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a77de868-9bec-4698-97dc-aa9b1c9894ee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:59.245681 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a77de868-9bec-4698-97dc-aa9b1c9894ee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:59.246152 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a77de868-9bec-4698-97dc-aa9b1c9894ee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:59.387198 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a77de868-9bec-4698-97dc-aa9b1c9894ee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:59.394563 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a77de868-9bec-4698-97dc-aa9b1c9894ee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.161815 Apr 08 11:29:59.395640 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1125/2061] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:59 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:29:59.399976 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-cf28b008-a431-45a7-9a92-8bd360f0eafc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:29:59.400582 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-cf28b008-a431-45a7-9a92-8bd360f0eafc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:29:59.405985 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cf28b008-a431-45a7-9a92-8bd360f0eafc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:59.406442 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cf28b008-a431-45a7-9a92-8bd360f0eafc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:59.407205 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cf28b008-a431-45a7-9a92-8bd360f0eafc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:29:59.407648 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cf28b008-a431-45a7-9a92-8bd360f0eafc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:29:59.466731 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-cf28b008-a431-45a7-9a92-8bd360f0eafc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:29:59.474746 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-cf28b008-a431-45a7-9a92-8bd360f0eafc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078147 Apr 08 11:29:59.475302 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1126/2062] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:29:59 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:00.412248 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f67f1887-94e2-490b-b696-abe326cba3dc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:00.412922 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f67f1887-94e2-490b-b696-abe326cba3dc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:00.419113 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f67f1887-94e2-490b-b696-abe326cba3dc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:00.419569 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f67f1887-94e2-490b-b696-abe326cba3dc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:00.420336 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f67f1887-94e2-490b-b696-abe326cba3dc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:00.420777 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f67f1887-94e2-490b-b696-abe326cba3dc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:00.552892 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f67f1887-94e2-490b-b696-abe326cba3dc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:00.560726 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f67f1887-94e2-490b-b696-abe326cba3dc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.152531 Apr 08 11:30:00.561286 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1127/2063] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:00 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:00.565604 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9314fddf-3745-4057-a835-510ee22d29fb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:00.566224 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9314fddf-3745-4057-a835-510ee22d29fb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:00.572040 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9314fddf-3745-4057-a835-510ee22d29fb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:00.572495 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9314fddf-3745-4057-a835-510ee22d29fb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:00.573275 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9314fddf-3745-4057-a835-510ee22d29fb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:00.573719 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9314fddf-3745-4057-a835-510ee22d29fb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:00.635137 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9314fddf-3745-4057-a835-510ee22d29fb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:00.642712 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9314fddf-3745-4057-a835-510ee22d29fb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080419 Apr 08 11:30:00.644883 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1128/2064] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:00 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:00.870441 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 11:30:00.870693 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:30:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 11:30:01.577640 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-01a51de2-905f-49b5-b84e-cddb77ea69fd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:01.578370 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-01a51de2-905f-49b5-b84e-cddb77ea69fd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:01.584622 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-01a51de2-905f-49b5-b84e-cddb77ea69fd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:01.585073 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-01a51de2-905f-49b5-b84e-cddb77ea69fd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:01.585863 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-01a51de2-905f-49b5-b84e-cddb77ea69fd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:01.586308 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-01a51de2-905f-49b5-b84e-cddb77ea69fd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:01.720097 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-01a51de2-905f-49b5-b84e-cddb77ea69fd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:01.728306 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-01a51de2-905f-49b5-b84e-cddb77ea69fd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.154534 Apr 08 11:30:01.728878 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1129/2065] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:01 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:01.733289 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-127ab28a-1e57-4c8f-ab5d-d86d1c18972c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:01.733936 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-127ab28a-1e57-4c8f-ab5d-d86d1c18972c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:01.739467 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-127ab28a-1e57-4c8f-ab5d-d86d1c18972c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:01.739940 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-127ab28a-1e57-4c8f-ab5d-d86d1c18972c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:01.740735 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-127ab28a-1e57-4c8f-ab5d-d86d1c18972c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:01.741178 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-127ab28a-1e57-4c8f-ab5d-d86d1c18972c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:01.801257 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-127ab28a-1e57-4c8f-ab5d-d86d1c18972c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:01.808712 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-127ab28a-1e57-4c8f-ab5d-d86d1c18972c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078797 Apr 08 11:30:01.809285 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1130/2066] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:01 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:02.746086 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-090bb5de-9c8b-4b6f-ae17-eab175d7724d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:02.746776 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-090bb5de-9c8b-4b6f-ae17-eab175d7724d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:02.753285 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-090bb5de-9c8b-4b6f-ae17-eab175d7724d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:02.753740 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-090bb5de-9c8b-4b6f-ae17-eab175d7724d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:02.754536 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-090bb5de-9c8b-4b6f-ae17-eab175d7724d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:02.754982 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-090bb5de-9c8b-4b6f-ae17-eab175d7724d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:02.888766 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-090bb5de-9c8b-4b6f-ae17-eab175d7724d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:02.896132 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-090bb5de-9c8b-4b6f-ae17-eab175d7724d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.154198 Apr 08 11:30:02.896646 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1131/2067] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:02 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:02.901023 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b871b583-b4ab-4691-881f-741ba3f7131b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:02.901628 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b871b583-b4ab-4691-881f-741ba3f7131b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:02.907097 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b871b583-b4ab-4691-881f-741ba3f7131b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:02.907681 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b871b583-b4ab-4691-881f-741ba3f7131b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:02.908420 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b871b583-b4ab-4691-881f-741ba3f7131b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:02.908868 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b871b583-b4ab-4691-881f-741ba3f7131b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:02.969614 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b871b583-b4ab-4691-881f-741ba3f7131b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:02.977369 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b871b583-b4ab-4691-881f-741ba3f7131b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079787 Apr 08 11:30:02.977978 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1132/2068] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:02 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:03.912582 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2b04ec0d-1c1f-4afb-8193-54c8ed15ea0a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:03.913210 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2b04ec0d-1c1f-4afb-8193-54c8ed15ea0a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:03.919771 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2b04ec0d-1c1f-4afb-8193-54c8ed15ea0a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:03.920221 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2b04ec0d-1c1f-4afb-8193-54c8ed15ea0a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:03.920992 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2b04ec0d-1c1f-4afb-8193-54c8ed15ea0a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:03.921429 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2b04ec0d-1c1f-4afb-8193-54c8ed15ea0a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:04.058154 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2b04ec0d-1c1f-4afb-8193-54c8ed15ea0a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:04.065853 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2b04ec0d-1c1f-4afb-8193-54c8ed15ea0a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.157084 Apr 08 11:30:04.066515 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1133/2069] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:03 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:04.071738 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1d5a06e8-a896-4512-a96c-16b528c76448 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:04.072348 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1d5a06e8-a896-4512-a96c-16b528c76448 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:04.078169 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1d5a06e8-a896-4512-a96c-16b528c76448 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:04.078624 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1d5a06e8-a896-4512-a96c-16b528c76448 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:04.079399 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1d5a06e8-a896-4512-a96c-16b528c76448 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:04.079844 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1d5a06e8-a896-4512-a96c-16b528c76448 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:04.140269 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1d5a06e8-a896-4512-a96c-16b528c76448 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:04.149415 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1d5a06e8-a896-4512-a96c-16b528c76448 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081996 Apr 08 11:30:04.150107 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1134/2070] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:04 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:05.083442 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1ee2c037-9b83-4410-b0dc-7d0f705f2677 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:05.084125 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1ee2c037-9b83-4410-b0dc-7d0f705f2677 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:05.091032 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ee2c037-9b83-4410-b0dc-7d0f705f2677 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:05.091489 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ee2c037-9b83-4410-b0dc-7d0f705f2677 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:05.092263 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ee2c037-9b83-4410-b0dc-7d0f705f2677 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:05.092708 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ee2c037-9b83-4410-b0dc-7d0f705f2677 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:05.227395 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1ee2c037-9b83-4410-b0dc-7d0f705f2677 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:05.235187 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1ee2c037-9b83-4410-b0dc-7d0f705f2677 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.155581 Apr 08 11:30:05.235757 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1135/2071] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:05 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:05.240217 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0d77924e-0f9b-4ccc-a4e7-9728cc1a0b17 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:05.240813 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0d77924e-0f9b-4ccc-a4e7-9728cc1a0b17 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:05.247211 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0d77924e-0f9b-4ccc-a4e7-9728cc1a0b17 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:05.247664 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0d77924e-0f9b-4ccc-a4e7-9728cc1a0b17 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:05.248455 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0d77924e-0f9b-4ccc-a4e7-9728cc1a0b17 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:05.248924 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0d77924e-0f9b-4ccc-a4e7-9728cc1a0b17 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:05.307685 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0d77924e-0f9b-4ccc-a4e7-9728cc1a0b17 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:05.315047 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0d77924e-0f9b-4ccc-a4e7-9728cc1a0b17 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078354 Apr 08 11:30:05.315608 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1136/2072] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:05 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:06.252487 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2a1627a1-8423-4547-9203-7137923c5f5c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:06.253168 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2a1627a1-8423-4547-9203-7137923c5f5c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:06.259409 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2a1627a1-8423-4547-9203-7137923c5f5c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:06.259881 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2a1627a1-8423-4547-9203-7137923c5f5c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:06.260628 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2a1627a1-8423-4547-9203-7137923c5f5c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:06.261066 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2a1627a1-8423-4547-9203-7137923c5f5c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:06.397038 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2a1627a1-8423-4547-9203-7137923c5f5c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:06.405096 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2a1627a1-8423-4547-9203-7137923c5f5c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.156487 Apr 08 11:30:06.405670 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1137/2073] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:06 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:06.410019 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-621bf083-9f8a-4a72-9e05-464fbf82c431 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:06.410629 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-621bf083-9f8a-4a72-9e05-464fbf82c431 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:06.416782 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-621bf083-9f8a-4a72-9e05-464fbf82c431 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:06.417234 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-621bf083-9f8a-4a72-9e05-464fbf82c431 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:06.418030 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-621bf083-9f8a-4a72-9e05-464fbf82c431 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:06.418472 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-621bf083-9f8a-4a72-9e05-464fbf82c431 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:06.476361 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-621bf083-9f8a-4a72-9e05-464fbf82c431 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:06.483579 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-621bf083-9f8a-4a72-9e05-464fbf82c431 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.076957 Apr 08 11:30:06.484227 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1138/2074] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:06 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:07.422406 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1dd82a2c-5608-4d34-bdfa-240e0118e6ee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:07.423075 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1dd82a2c-5608-4d34-bdfa-240e0118e6ee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:07.429207 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1dd82a2c-5608-4d34-bdfa-240e0118e6ee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:07.429648 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1dd82a2c-5608-4d34-bdfa-240e0118e6ee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:07.431064 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1dd82a2c-5608-4d34-bdfa-240e0118e6ee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:07.431496 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1dd82a2c-5608-4d34-bdfa-240e0118e6ee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:07.565400 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1dd82a2c-5608-4d34-bdfa-240e0118e6ee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:07.574432 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1dd82a2c-5608-4d34-bdfa-240e0118e6ee tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.155759 Apr 08 11:30:07.575043 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1139/2075] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:07 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:07.579560 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-62f06d30-008f-4536-934f-c8154e7a4c23 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:07.580162 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-62f06d30-008f-4536-934f-c8154e7a4c23 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:07.586167 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-62f06d30-008f-4536-934f-c8154e7a4c23 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:07.586655 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-62f06d30-008f-4536-934f-c8154e7a4c23 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:07.587373 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-62f06d30-008f-4536-934f-c8154e7a4c23 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:07.587801 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-62f06d30-008f-4536-934f-c8154e7a4c23 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:07.650962 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-62f06d30-008f-4536-934f-c8154e7a4c23 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:07.658726 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-62f06d30-008f-4536-934f-c8154e7a4c23 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082722 Apr 08 11:30:07.659307 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1140/2076] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:07 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:08.592162 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c8906f27-3f96-474c-9e3c-72ab6173380f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:08.592863 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c8906f27-3f96-474c-9e3c-72ab6173380f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:08.600418 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c8906f27-3f96-474c-9e3c-72ab6173380f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:08.600872 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c8906f27-3f96-474c-9e3c-72ab6173380f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:08.601647 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c8906f27-3f96-474c-9e3c-72ab6173380f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:08.602763 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c8906f27-3f96-474c-9e3c-72ab6173380f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:08.751752 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c8906f27-3f96-474c-9e3c-72ab6173380f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:08.759341 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c8906f27-3f96-474c-9e3c-72ab6173380f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.171039 Apr 08 11:30:08.759913 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1141/2077] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:08 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:08.764454 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a12d311f-af7c-4346-95fc-0a565de32178 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:08.765053 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a12d311f-af7c-4346-95fc-0a565de32178 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:08.771279 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a12d311f-af7c-4346-95fc-0a565de32178 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:08.771729 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a12d311f-af7c-4346-95fc-0a565de32178 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:08.772504 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a12d311f-af7c-4346-95fc-0a565de32178 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:08.772954 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a12d311f-af7c-4346-95fc-0a565de32178 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:08.832624 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a12d311f-af7c-4346-95fc-0a565de32178 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:08.840374 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a12d311f-af7c-4346-95fc-0a565de32178 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079429 Apr 08 11:30:08.840970 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1142/2078] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:08 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:09.777367 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-74779328-1957-4976-ae87-83cd2dfbc4b6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:09.778091 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-74779328-1957-4976-ae87-83cd2dfbc4b6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:09.786041 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-74779328-1957-4976-ae87-83cd2dfbc4b6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:09.786588 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-74779328-1957-4976-ae87-83cd2dfbc4b6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:09.787888 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-74779328-1957-4976-ae87-83cd2dfbc4b6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:09.788582 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-74779328-1957-4976-ae87-83cd2dfbc4b6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:09.939144 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-74779328-1957-4976-ae87-83cd2dfbc4b6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:09.947689 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-74779328-1957-4976-ae87-83cd2dfbc4b6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.174955 Apr 08 11:30:09.948283 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1143/2079] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:09 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:09.953010 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5472c70b-57fd-4de6-a134-67d02f24a5d2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:09.953621 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5472c70b-57fd-4de6-a134-67d02f24a5d2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:09.959979 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5472c70b-57fd-4de6-a134-67d02f24a5d2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:09.960430 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5472c70b-57fd-4de6-a134-67d02f24a5d2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:09.961212 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5472c70b-57fd-4de6-a134-67d02f24a5d2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:09.961654 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5472c70b-57fd-4de6-a134-67d02f24a5d2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:10.026646 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5472c70b-57fd-4de6-a134-67d02f24a5d2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:10.034529 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5472c70b-57fd-4de6-a134-67d02f24a5d2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.085214 Apr 08 11:30:10.035140 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1144/2080] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:09 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:10.964465 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-52ab3a63-8df5-4751-9b29-808f2379d590 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:10.965111 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-52ab3a63-8df5-4751-9b29-808f2379d590 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:10.971400 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-52ab3a63-8df5-4751-9b29-808f2379d590 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:10.971846 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-52ab3a63-8df5-4751-9b29-808f2379d590 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:10.972614 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-52ab3a63-8df5-4751-9b29-808f2379d590 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:10.973037 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-52ab3a63-8df5-4751-9b29-808f2379d590 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:11.111711 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-52ab3a63-8df5-4751-9b29-808f2379d590 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:11.119262 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-52ab3a63-8df5-4751-9b29-808f2379d590 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.158643 Apr 08 11:30:11.119874 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1145/2081] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:10 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:11.124387 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2edc7eed-80d2-496a-8912-0b0b97f909b2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:11.125064 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2edc7eed-80d2-496a-8912-0b0b97f909b2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:11.131052 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2edc7eed-80d2-496a-8912-0b0b97f909b2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:11.131499 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2edc7eed-80d2-496a-8912-0b0b97f909b2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:11.132264 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2edc7eed-80d2-496a-8912-0b0b97f909b2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:11.132697 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2edc7eed-80d2-496a-8912-0b0b97f909b2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:11.193101 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2edc7eed-80d2-496a-8912-0b0b97f909b2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:11.202070 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2edc7eed-80d2-496a-8912-0b0b97f909b2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081168 Apr 08 11:30:11.202654 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1146/2082] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:11 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:12.136274 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c073b99a-48a6-44b5-9bb4-528091ced292 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:12.136888 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c073b99a-48a6-44b5-9bb4-528091ced292 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:12.143200 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c073b99a-48a6-44b5-9bb4-528091ced292 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:12.143646 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c073b99a-48a6-44b5-9bb4-528091ced292 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:12.144414 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c073b99a-48a6-44b5-9bb4-528091ced292 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:12.144850 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c073b99a-48a6-44b5-9bb4-528091ced292 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:12.318786 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c073b99a-48a6-44b5-9bb4-528091ced292 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:12.326433 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c073b99a-48a6-44b5-9bb4-528091ced292 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.193944 Apr 08 11:30:12.327001 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1147/2083] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:12 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:12.331364 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c2a3d43d-189f-4cc7-b875-9685aca2fcb4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:12.331957 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c2a3d43d-189f-4cc7-b875-9685aca2fcb4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:12.338175 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c2a3d43d-189f-4cc7-b875-9685aca2fcb4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:12.338616 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c2a3d43d-189f-4cc7-b875-9685aca2fcb4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:12.339376 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c2a3d43d-189f-4cc7-b875-9685aca2fcb4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:12.339810 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c2a3d43d-189f-4cc7-b875-9685aca2fcb4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:12.399982 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c2a3d43d-189f-4cc7-b875-9685aca2fcb4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:12.407571 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c2a3d43d-189f-4cc7-b875-9685aca2fcb4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079623 Apr 08 11:30:12.408196 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1148/2084] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:12 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:13.344746 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e39fb3bd-1f3b-4d5f-96be-bca4b3aae2bc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:13.345433 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e39fb3bd-1f3b-4d5f-96be-bca4b3aae2bc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:13.352525 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e39fb3bd-1f3b-4d5f-96be-bca4b3aae2bc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:13.352990 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e39fb3bd-1f3b-4d5f-96be-bca4b3aae2bc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:13.353755 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e39fb3bd-1f3b-4d5f-96be-bca4b3aae2bc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:13.354221 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e39fb3bd-1f3b-4d5f-96be-bca4b3aae2bc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:13.495023 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e39fb3bd-1f3b-4d5f-96be-bca4b3aae2bc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:13.502547 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e39fb3bd-1f3b-4d5f-96be-bca4b3aae2bc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.161824 Apr 08 11:30:13.503160 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1149/2085] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:13 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:13.509362 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ac0b0502-7749-4d10-aaaa-f61e9ec05eeb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:13.510023 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ac0b0502-7749-4d10-aaaa-f61e9ec05eeb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:13.516333 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ac0b0502-7749-4d10-aaaa-f61e9ec05eeb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:13.516786 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ac0b0502-7749-4d10-aaaa-f61e9ec05eeb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:13.517569 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ac0b0502-7749-4d10-aaaa-f61e9ec05eeb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:13.518045 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ac0b0502-7749-4d10-aaaa-f61e9ec05eeb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:13.581195 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ac0b0502-7749-4d10-aaaa-f61e9ec05eeb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:13.589285 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ac0b0502-7749-4d10-aaaa-f61e9ec05eeb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.085162 Apr 08 11:30:13.589888 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1150/2086] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:13 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:14.519924 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e8635616-43ef-46fa-a508-19fce8aab2fc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:14.520897 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e8635616-43ef-46fa-a508-19fce8aab2fc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:14.527441 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e8635616-43ef-46fa-a508-19fce8aab2fc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:14.527903 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e8635616-43ef-46fa-a508-19fce8aab2fc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:14.528709 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e8635616-43ef-46fa-a508-19fce8aab2fc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:14.529163 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e8635616-43ef-46fa-a508-19fce8aab2fc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:14.684471 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e8635616-43ef-46fa-a508-19fce8aab2fc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:14.692988 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e8635616-43ef-46fa-a508-19fce8aab2fc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.176988 Apr 08 11:30:14.693574 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1151/2087] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:14 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:14.698264 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9955518f-a16b-4099-9254-618c8895aa90 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:14.699037 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9955518f-a16b-4099-9254-618c8895aa90 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:14.705137 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9955518f-a16b-4099-9254-618c8895aa90 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:14.705590 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9955518f-a16b-4099-9254-618c8895aa90 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:14.706394 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9955518f-a16b-4099-9254-618c8895aa90 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:14.706835 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9955518f-a16b-4099-9254-618c8895aa90 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:14.770073 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9955518f-a16b-4099-9254-618c8895aa90 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:14.777828 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9955518f-a16b-4099-9254-618c8895aa90 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.083204 Apr 08 11:30:14.778431 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1152/2088] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:14 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:15.712523 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-fde3001d-c954-4873-9fa8-ab9a4ff91b4a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:15.713275 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-fde3001d-c954-4873-9fa8-ab9a4ff91b4a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:15.719790 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fde3001d-c954-4873-9fa8-ab9a4ff91b4a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:15.720233 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fde3001d-c954-4873-9fa8-ab9a4ff91b4a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:15.721022 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fde3001d-c954-4873-9fa8-ab9a4ff91b4a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:15.721458 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fde3001d-c954-4873-9fa8-ab9a4ff91b4a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:15.877255 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-fde3001d-c954-4873-9fa8-ab9a4ff91b4a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:15.885745 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-fde3001d-c954-4873-9fa8-ab9a4ff91b4a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.178179 Apr 08 11:30:15.886361 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1153/2089] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:15 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:15.890919 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f2bdcae8-9d4c-48b8-bc58-c691c52596d6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:15.891535 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f2bdcae8-9d4c-48b8-bc58-c691c52596d6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:15.898096 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f2bdcae8-9d4c-48b8-bc58-c691c52596d6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:15.898934 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f2bdcae8-9d4c-48b8-bc58-c691c52596d6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:15.899707 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f2bdcae8-9d4c-48b8-bc58-c691c52596d6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:15.900154 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f2bdcae8-9d4c-48b8-bc58-c691c52596d6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:15.967560 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f2bdcae8-9d4c-48b8-bc58-c691c52596d6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:15.976724 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f2bdcae8-9d4c-48b8-bc58-c691c52596d6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.089288 Apr 08 11:30:15.977296 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1154/2090] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:15 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:16.903632 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-38897248-5dc0-4c77-a5e0-786c79d24c68 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:16.904332 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-38897248-5dc0-4c77-a5e0-786c79d24c68 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:16.910787 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-38897248-5dc0-4c77-a5e0-786c79d24c68 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:16.911243 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-38897248-5dc0-4c77-a5e0-786c79d24c68 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:16.912029 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-38897248-5dc0-4c77-a5e0-786c79d24c68 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:16.912470 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-38897248-5dc0-4c77-a5e0-786c79d24c68 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:17.049872 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-38897248-5dc0-4c77-a5e0-786c79d24c68 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:17.057666 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-38897248-5dc0-4c77-a5e0-786c79d24c68 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.157967 Apr 08 11:30:17.058275 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1155/2091] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:16 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:17.062764 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a7fe47e2-3ec6-46ce-aafa-f8e41d347346 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:17.063381 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a7fe47e2-3ec6-46ce-aafa-f8e41d347346 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:17.069011 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a7fe47e2-3ec6-46ce-aafa-f8e41d347346 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:17.069466 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a7fe47e2-3ec6-46ce-aafa-f8e41d347346 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:17.070269 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a7fe47e2-3ec6-46ce-aafa-f8e41d347346 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:17.071225 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a7fe47e2-3ec6-46ce-aafa-f8e41d347346 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:17.130700 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a7fe47e2-3ec6-46ce-aafa-f8e41d347346 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:17.138653 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a7fe47e2-3ec6-46ce-aafa-f8e41d347346 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079435 Apr 08 11:30:17.139224 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1156/2092] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:17 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:18.075289 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-47bee078-75eb-43d7-a3ca-a99d28bcfbf6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:18.075940 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-47bee078-75eb-43d7-a3ca-a99d28bcfbf6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:18.082242 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-47bee078-75eb-43d7-a3ca-a99d28bcfbf6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:18.082690 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-47bee078-75eb-43d7-a3ca-a99d28bcfbf6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:18.083452 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-47bee078-75eb-43d7-a3ca-a99d28bcfbf6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:18.083891 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-47bee078-75eb-43d7-a3ca-a99d28bcfbf6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:18.222568 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-47bee078-75eb-43d7-a3ca-a99d28bcfbf6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:18.230967 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-47bee078-75eb-43d7-a3ca-a99d28bcfbf6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.159475 Apr 08 11:30:18.231555 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1157/2093] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:18 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:18.236025 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-daeff0a0-1d9c-4888-869e-05f6feb41461 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:18.237666 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-daeff0a0-1d9c-4888-869e-05f6feb41461 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:18.243234 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-daeff0a0-1d9c-4888-869e-05f6feb41461 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:18.243694 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-daeff0a0-1d9c-4888-869e-05f6feb41461 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:18.244474 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-daeff0a0-1d9c-4888-869e-05f6feb41461 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:18.244914 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-daeff0a0-1d9c-4888-869e-05f6feb41461 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:18.303799 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-daeff0a0-1d9c-4888-869e-05f6feb41461 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:18.311134 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-daeff0a0-1d9c-4888-869e-05f6feb41461 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078635 Apr 08 11:30:18.311701 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1158/2094] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:18 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:19.248770 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-35d6efa2-1e33-40ad-8e82-36e270d15d60 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:19.249422 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-35d6efa2-1e33-40ad-8e82-36e270d15d60 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:19.255715 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-35d6efa2-1e33-40ad-8e82-36e270d15d60 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:19.256164 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-35d6efa2-1e33-40ad-8e82-36e270d15d60 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:19.256930 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-35d6efa2-1e33-40ad-8e82-36e270d15d60 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:19.257366 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-35d6efa2-1e33-40ad-8e82-36e270d15d60 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:19.392506 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-35d6efa2-1e33-40ad-8e82-36e270d15d60 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:19.399940 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-35d6efa2-1e33-40ad-8e82-36e270d15d60 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.155036 Apr 08 11:30:19.400507 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1159/2095] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:19 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:19.405613 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f3f04b48-dfd4-4bb0-840c-c435e899948b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:19.406253 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f3f04b48-dfd4-4bb0-840c-c435e899948b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:19.412282 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f3f04b48-dfd4-4bb0-840c-c435e899948b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:19.412760 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f3f04b48-dfd4-4bb0-840c-c435e899948b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:19.413534 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f3f04b48-dfd4-4bb0-840c-c435e899948b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:19.414058 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f3f04b48-dfd4-4bb0-840c-c435e899948b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:19.473881 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f3f04b48-dfd4-4bb0-840c-c435e899948b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:19.484096 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f3f04b48-dfd4-4bb0-840c-c435e899948b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082613 Apr 08 11:30:19.484822 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1160/2096] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:19 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:20.418264 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-eea37861-0fda-45d7-ac41-dcf3abd6ed09 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:20.418912 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-eea37861-0fda-45d7-ac41-dcf3abd6ed09 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:20.425247 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-eea37861-0fda-45d7-ac41-dcf3abd6ed09 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:20.425705 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-eea37861-0fda-45d7-ac41-dcf3abd6ed09 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:20.426513 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-eea37861-0fda-45d7-ac41-dcf3abd6ed09 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:20.426957 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-eea37861-0fda-45d7-ac41-dcf3abd6ed09 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:20.564307 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-eea37861-0fda-45d7-ac41-dcf3abd6ed09 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:20.571713 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-eea37861-0fda-45d7-ac41-dcf3abd6ed09 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.158141 Apr 08 11:30:20.572278 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1161/2097] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:20 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:20.576848 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-490eaaa3-6746-4d1b-bdcd-0d895d384855 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:20.577459 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-490eaaa3-6746-4d1b-bdcd-0d895d384855 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:20.583471 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-490eaaa3-6746-4d1b-bdcd-0d895d384855 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:20.584015 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-490eaaa3-6746-4d1b-bdcd-0d895d384855 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:20.584708 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-490eaaa3-6746-4d1b-bdcd-0d895d384855 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:20.585151 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-490eaaa3-6746-4d1b-bdcd-0d895d384855 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:20.645337 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-490eaaa3-6746-4d1b-bdcd-0d895d384855 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:20.654153 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-490eaaa3-6746-4d1b-bdcd-0d895d384855 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080832 Apr 08 11:30:20.654745 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1162/2098] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:20 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:21.588755 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d025b573-73af-4df6-9fae-b2f7d758cef6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:21.589426 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d025b573-73af-4df6-9fae-b2f7d758cef6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:21.595715 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d025b573-73af-4df6-9fae-b2f7d758cef6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:21.596170 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d025b573-73af-4df6-9fae-b2f7d758cef6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:21.596943 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d025b573-73af-4df6-9fae-b2f7d758cef6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:21.597476 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d025b573-73af-4df6-9fae-b2f7d758cef6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:21.747907 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d025b573-73af-4df6-9fae-b2f7d758cef6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:21.755500 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d025b573-73af-4df6-9fae-b2f7d758cef6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.170637 Apr 08 11:30:21.756100 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1163/2099] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:21 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:21.760675 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8e7e8491-c8af-4864-a840-c257acfa851d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:21.761279 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8e7e8491-c8af-4864-a840-c257acfa851d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:21.767265 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8e7e8491-c8af-4864-a840-c257acfa851d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:21.767708 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8e7e8491-c8af-4864-a840-c257acfa851d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:21.768545 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8e7e8491-c8af-4864-a840-c257acfa851d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:21.769019 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8e7e8491-c8af-4864-a840-c257acfa851d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:21.828762 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8e7e8491-c8af-4864-a840-c257acfa851d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:21.836286 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8e7e8491-c8af-4864-a840-c257acfa851d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079279 Apr 08 11:30:21.836872 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1164/2100] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:21 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:22.772667 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1453a05b-88ae-44b1-ab58-9142aa11bb0f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:22.773366 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1453a05b-88ae-44b1-ab58-9142aa11bb0f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:22.779829 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1453a05b-88ae-44b1-ab58-9142aa11bb0f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:22.780285 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1453a05b-88ae-44b1-ab58-9142aa11bb0f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:22.781065 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1453a05b-88ae-44b1-ab58-9142aa11bb0f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:22.781507 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1453a05b-88ae-44b1-ab58-9142aa11bb0f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:22.916460 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1453a05b-88ae-44b1-ab58-9142aa11bb0f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:22.925285 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1453a05b-88ae-44b1-ab58-9142aa11bb0f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.156441 Apr 08 11:30:22.925918 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1165/2101] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:22 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:22.931521 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e15d06b2-b6ad-44d3-aede-e27aac1135ad tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:22.932263 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e15d06b2-b6ad-44d3-aede-e27aac1135ad tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:22.939378 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e15d06b2-b6ad-44d3-aede-e27aac1135ad tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:22.939890 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e15d06b2-b6ad-44d3-aede-e27aac1135ad tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:22.940871 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e15d06b2-b6ad-44d3-aede-e27aac1135ad tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:22.941324 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e15d06b2-b6ad-44d3-aede-e27aac1135ad tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:23.005396 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e15d06b2-b6ad-44d3-aede-e27aac1135ad tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:23.012885 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e15d06b2-b6ad-44d3-aede-e27aac1135ad tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.085293 Apr 08 11:30:23.013454 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1166/2102] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:22 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:23.942607 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b5c5e499-d329-4dae-82c8-8a794b416cd9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:23.943297 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b5c5e499-d329-4dae-82c8-8a794b416cd9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:23.949816 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b5c5e499-d329-4dae-82c8-8a794b416cd9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:23.950281 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b5c5e499-d329-4dae-82c8-8a794b416cd9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:23.951706 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b5c5e499-d329-4dae-82c8-8a794b416cd9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:23.952149 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b5c5e499-d329-4dae-82c8-8a794b416cd9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:24.088304 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b5c5e499-d329-4dae-82c8-8a794b416cd9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:24.095945 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b5c5e499-d329-4dae-82c8-8a794b416cd9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.157178 Apr 08 11:30:24.096526 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1167/2103] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:23 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:24.101118 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ead3a9e9-1a1b-42cf-9f30-713b7dc33e89 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:24.101752 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ead3a9e9-1a1b-42cf-9f30-713b7dc33e89 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:24.107384 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ead3a9e9-1a1b-42cf-9f30-713b7dc33e89 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:24.107840 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ead3a9e9-1a1b-42cf-9f30-713b7dc33e89 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:24.108610 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ead3a9e9-1a1b-42cf-9f30-713b7dc33e89 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:24.109049 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ead3a9e9-1a1b-42cf-9f30-713b7dc33e89 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:24.168010 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ead3a9e9-1a1b-42cf-9f30-713b7dc33e89 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:24.175614 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ead3a9e9-1a1b-42cf-9f30-713b7dc33e89 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078091 Apr 08 11:30:24.176198 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1168/2104] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:24 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:25.113239 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ec1723c2-c7e7-4628-878f-ca1abd0dcb44 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:25.114047 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ec1723c2-c7e7-4628-878f-ca1abd0dcb44 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:25.120829 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ec1723c2-c7e7-4628-878f-ca1abd0dcb44 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:25.121274 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ec1723c2-c7e7-4628-878f-ca1abd0dcb44 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:25.122081 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ec1723c2-c7e7-4628-878f-ca1abd0dcb44 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:25.122516 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ec1723c2-c7e7-4628-878f-ca1abd0dcb44 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:25.267824 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ec1723c2-c7e7-4628-878f-ca1abd0dcb44 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:25.275708 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ec1723c2-c7e7-4628-878f-ca1abd0dcb44 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.166438 Apr 08 11:30:25.276370 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1169/2105] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:25 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:25.281619 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-20209644-2f81-4bbe-957d-e6f8cbc48f45 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:25.282260 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-20209644-2f81-4bbe-957d-e6f8cbc48f45 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:25.288817 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-20209644-2f81-4bbe-957d-e6f8cbc48f45 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:25.289261 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-20209644-2f81-4bbe-957d-e6f8cbc48f45 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:25.290071 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-20209644-2f81-4bbe-957d-e6f8cbc48f45 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:25.290505 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-20209644-2f81-4bbe-957d-e6f8cbc48f45 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:25.357590 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-20209644-2f81-4bbe-957d-e6f8cbc48f45 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:25.366676 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-20209644-2f81-4bbe-957d-e6f8cbc48f45 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.089290 Apr 08 11:30:25.367291 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1170/2106] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:25 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:26.294050 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ee0e215a-f354-4020-b159-89564a94b511 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:26.295481 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ee0e215a-f354-4020-b159-89564a94b511 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:26.301582 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ee0e215a-f354-4020-b159-89564a94b511 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:26.302076 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ee0e215a-f354-4020-b159-89564a94b511 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:26.302876 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ee0e215a-f354-4020-b159-89564a94b511 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:26.303330 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ee0e215a-f354-4020-b159-89564a94b511 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:26.460799 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ee0e215a-f354-4020-b159-89564a94b511 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:26.475816 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ee0e215a-f354-4020-b159-89564a94b511 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.185390 Apr 08 11:30:26.476875 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1171/2107] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:26 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:26.486459 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4889a2d0-c661-4eda-9786-4cf94a92ef7b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:26.487647 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4889a2d0-c661-4eda-9786-4cf94a92ef7b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:26.498655 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4889a2d0-c661-4eda-9786-4cf94a92ef7b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:26.499451 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4889a2d0-c661-4eda-9786-4cf94a92ef7b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:26.500892 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4889a2d0-c661-4eda-9786-4cf94a92ef7b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:26.501730 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4889a2d0-c661-4eda-9786-4cf94a92ef7b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:26.592746 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4889a2d0-c661-4eda-9786-4cf94a92ef7b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:26.601077 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4889a2d0-c661-4eda-9786-4cf94a92ef7b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.122634 Apr 08 11:30:26.601669 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1172/2108] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:26 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:27.495050 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4d56f447-c0a6-4429-b47e-d9dba3ecf154 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:27.495763 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4d56f447-c0a6-4429-b47e-d9dba3ecf154 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:27.506722 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4d56f447-c0a6-4429-b47e-d9dba3ecf154 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:27.507169 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4d56f447-c0a6-4429-b47e-d9dba3ecf154 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:27.507956 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4d56f447-c0a6-4429-b47e-d9dba3ecf154 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:27.508394 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4d56f447-c0a6-4429-b47e-d9dba3ecf154 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:27.650779 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4d56f447-c0a6-4429-b47e-d9dba3ecf154 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:27.659086 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4d56f447-c0a6-4429-b47e-d9dba3ecf154 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.168241 Apr 08 11:30:27.659661 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1173/2109] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:27 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:27.664234 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e1eea8b9-e166-4b4b-9a44-55076020a10b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:27.664845 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e1eea8b9-e166-4b4b-9a44-55076020a10b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:27.671268 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e1eea8b9-e166-4b4b-9a44-55076020a10b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:27.671713 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e1eea8b9-e166-4b4b-9a44-55076020a10b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:27.675883 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e1eea8b9-e166-4b4b-9a44-55076020a10b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:27.675883 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e1eea8b9-e166-4b4b-9a44-55076020a10b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:27.733208 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e1eea8b9-e166-4b4b-9a44-55076020a10b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:27.741623 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e1eea8b9-e166-4b4b-9a44-55076020a10b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080904 Apr 08 11:30:27.742254 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1174/2110] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:27 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:28.677261 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-01699d43-b7a7-4e17-a0ed-5ee93d03e93c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:28.678364 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-01699d43-b7a7-4e17-a0ed-5ee93d03e93c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:28.684487 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-01699d43-b7a7-4e17-a0ed-5ee93d03e93c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:28.689266 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-01699d43-b7a7-4e17-a0ed-5ee93d03e93c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:28.689266 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-01699d43-b7a7-4e17-a0ed-5ee93d03e93c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:28.689266 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-01699d43-b7a7-4e17-a0ed-5ee93d03e93c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:28.855489 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-01699d43-b7a7-4e17-a0ed-5ee93d03e93c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:28.864581 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-01699d43-b7a7-4e17-a0ed-5ee93d03e93c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.191242 Apr 08 11:30:28.865202 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1175/2111] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:28 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:28.870946 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a15fb383-c056-463b-8781-3c67160a47dd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:28.871560 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a15fb383-c056-463b-8781-3c67160a47dd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:28.880338 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a15fb383-c056-463b-8781-3c67160a47dd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:28.880790 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a15fb383-c056-463b-8781-3c67160a47dd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:28.881625 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a15fb383-c056-463b-8781-3c67160a47dd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:28.882100 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a15fb383-c056-463b-8781-3c67160a47dd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:28.945559 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a15fb383-c056-463b-8781-3c67160a47dd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:28.955250 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a15fb383-c056-463b-8781-3c67160a47dd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.088977 Apr 08 11:30:28.955908 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1176/2112] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:28 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:29.881250 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-969c5936-e301-48a2-ba07-39cd3f8d9189 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:29.882058 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-969c5936-e301-48a2-ba07-39cd3f8d9189 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:29.889027 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-969c5936-e301-48a2-ba07-39cd3f8d9189 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:29.896725 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-969c5936-e301-48a2-ba07-39cd3f8d9189 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:29.896725 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-969c5936-e301-48a2-ba07-39cd3f8d9189 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:29.896725 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-969c5936-e301-48a2-ba07-39cd3f8d9189 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:30.029846 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-969c5936-e301-48a2-ba07-39cd3f8d9189 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:30.037499 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-969c5936-e301-48a2-ba07-39cd3f8d9189 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.160126 Apr 08 11:30:30.038109 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1177/2113] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:29 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:30.042599 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0104c60f-c931-4c0d-ae4d-fc8701be196c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:30.043217 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0104c60f-c931-4c0d-ae4d-fc8701be196c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:30.050605 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0104c60f-c931-4c0d-ae4d-fc8701be196c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:30.051065 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0104c60f-c931-4c0d-ae4d-fc8701be196c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:30.051850 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0104c60f-c931-4c0d-ae4d-fc8701be196c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:30.052297 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0104c60f-c931-4c0d-ae4d-fc8701be196c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:30.113270 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0104c60f-c931-4c0d-ae4d-fc8701be196c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:30.121015 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0104c60f-c931-4c0d-ae4d-fc8701be196c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081897 Apr 08 11:30:30.121579 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1178/2114] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:30 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:31.056128 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3679e2c7-f198-4f2e-8ec3-8468458f0aa0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:31.056827 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3679e2c7-f198-4f2e-8ec3-8468458f0aa0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:31.064328 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3679e2c7-f198-4f2e-8ec3-8468458f0aa0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:31.064810 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3679e2c7-f198-4f2e-8ec3-8468458f0aa0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:31.065604 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3679e2c7-f198-4f2e-8ec3-8468458f0aa0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:31.066113 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3679e2c7-f198-4f2e-8ec3-8468458f0aa0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:31.225129 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3679e2c7-f198-4f2e-8ec3-8468458f0aa0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:31.234774 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3679e2c7-f198-4f2e-8ec3-8468458f0aa0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.183150 Apr 08 11:30:31.235375 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1179/2115] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:31 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:31.240233 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-621bbe44-533e-48cf-a9b0-9198be5ab6ae tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:31.240862 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-621bbe44-533e-48cf-a9b0-9198be5ab6ae tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:31.251439 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-621bbe44-533e-48cf-a9b0-9198be5ab6ae tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:31.251904 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-621bbe44-533e-48cf-a9b0-9198be5ab6ae tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:31.252805 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-621bbe44-533e-48cf-a9b0-9198be5ab6ae tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:31.253147 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-621bbe44-533e-48cf-a9b0-9198be5ab6ae tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:31.320403 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-621bbe44-533e-48cf-a9b0-9198be5ab6ae tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:31.328705 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-621bbe44-533e-48cf-a9b0-9198be5ab6ae tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.092204 Apr 08 11:30:31.329325 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1180/2116] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:31 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:32.254018 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d18cc447-a26b-4d3b-9fed-4be6104758ac tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:32.254956 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d18cc447-a26b-4d3b-9fed-4be6104758ac tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:32.261318 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d18cc447-a26b-4d3b-9fed-4be6104758ac tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:32.261875 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d18cc447-a26b-4d3b-9fed-4be6104758ac tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:32.262605 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d18cc447-a26b-4d3b-9fed-4be6104758ac tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:32.263633 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d18cc447-a26b-4d3b-9fed-4be6104758ac tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:32.409108 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d18cc447-a26b-4d3b-9fed-4be6104758ac tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:32.416623 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d18cc447-a26b-4d3b-9fed-4be6104758ac tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.166698 Apr 08 11:30:32.417203 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1181/2117] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:32 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:32.421703 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-929bc2d6-6434-45a2-b50e-a94bc7e4fde8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:32.422998 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-929bc2d6-6434-45a2-b50e-a94bc7e4fde8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:32.429447 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-929bc2d6-6434-45a2-b50e-a94bc7e4fde8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:32.430157 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-929bc2d6-6434-45a2-b50e-a94bc7e4fde8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:32.431032 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-929bc2d6-6434-45a2-b50e-a94bc7e4fde8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:32.431471 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-929bc2d6-6434-45a2-b50e-a94bc7e4fde8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:32.755125 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-929bc2d6-6434-45a2-b50e-a94bc7e4fde8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:32.765542 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-929bc2d6-6434-45a2-b50e-a94bc7e4fde8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.347286 Apr 08 11:30:32.766482 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1182/2118] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:32 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:33.434298 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6f988730-64b6-4b0f-8b8a-06d8d6479ddb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:33.435588 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6f988730-64b6-4b0f-8b8a-06d8d6479ddb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:33.442457 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6f988730-64b6-4b0f-8b8a-06d8d6479ddb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:33.448685 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6f988730-64b6-4b0f-8b8a-06d8d6479ddb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:33.448685 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6f988730-64b6-4b0f-8b8a-06d8d6479ddb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:33.448685 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6f988730-64b6-4b0f-8b8a-06d8d6479ddb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:33.592837 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6f988730-64b6-4b0f-8b8a-06d8d6479ddb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:33.601335 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6f988730-64b6-4b0f-8b8a-06d8d6479ddb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.171075 Apr 08 11:30:33.602239 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1183/2119] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:33 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:33.783657 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4967b2f0-26bd-48ca-a0e5-9823706ece92 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:33.784334 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4967b2f0-26bd-48ca-a0e5-9823706ece92 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:33.790675 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4967b2f0-26bd-48ca-a0e5-9823706ece92 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:33.791130 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4967b2f0-26bd-48ca-a0e5-9823706ece92 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:33.791993 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4967b2f0-26bd-48ca-a0e5-9823706ece92 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:33.792425 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4967b2f0-26bd-48ca-a0e5-9823706ece92 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:33.858034 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4967b2f0-26bd-48ca-a0e5-9823706ece92 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:33.866277 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4967b2f0-26bd-48ca-a0e5-9823706ece92 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.086424 Apr 08 11:30:33.867218 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1184/2120] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:33 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:34.619586 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-91d57cb3-2d1c-419d-90c7-b44e5c5efc6b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:34.620256 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-91d57cb3-2d1c-419d-90c7-b44e5c5efc6b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:34.628020 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-91d57cb3-2d1c-419d-90c7-b44e5c5efc6b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:34.628472 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-91d57cb3-2d1c-419d-90c7-b44e5c5efc6b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:34.629266 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-91d57cb3-2d1c-419d-90c7-b44e5c5efc6b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:34.629719 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-91d57cb3-2d1c-419d-90c7-b44e5c5efc6b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:34.781025 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-91d57cb3-2d1c-419d-90c7-b44e5c5efc6b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:34.788876 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-91d57cb3-2d1c-419d-90c7-b44e5c5efc6b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.173450 Apr 08 11:30:34.789527 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1185/2121] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:34 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:34.888774 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2ef51809-7df1-4663-aec7-3e601c964f1f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:34.889329 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2ef51809-7df1-4663-aec7-3e601c964f1f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:34.897114 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2ef51809-7df1-4663-aec7-3e601c964f1f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:34.899109 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2ef51809-7df1-4663-aec7-3e601c964f1f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:34.899109 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2ef51809-7df1-4663-aec7-3e601c964f1f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:34.899109 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2ef51809-7df1-4663-aec7-3e601c964f1f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:34.973213 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2ef51809-7df1-4663-aec7-3e601c964f1f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:34.982300 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2ef51809-7df1-4663-aec7-3e601c964f1f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.097096 Apr 08 11:30:34.982897 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1186/2122] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:34 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:35.810165 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-941dd861-9a9d-4c8e-92ef-a284510a03a8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:35.811338 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-941dd861-9a9d-4c8e-92ef-a284510a03a8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:35.819344 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-941dd861-9a9d-4c8e-92ef-a284510a03a8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:35.819810 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-941dd861-9a9d-4c8e-92ef-a284510a03a8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:35.820600 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-941dd861-9a9d-4c8e-92ef-a284510a03a8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:35.821051 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-941dd861-9a9d-4c8e-92ef-a284510a03a8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:35.968264 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-941dd861-9a9d-4c8e-92ef-a284510a03a8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:35.976124 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-941dd861-9a9d-4c8e-92ef-a284510a03a8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.173572 Apr 08 11:30:35.976816 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1187/2123] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:35 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:36.000250 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-553d64d4-c13b-4e5d-9d15-0ef307009337 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:36.000877 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-553d64d4-c13b-4e5d-9d15-0ef307009337 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:36.008093 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-553d64d4-c13b-4e5d-9d15-0ef307009337 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:36.008540 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-553d64d4-c13b-4e5d-9d15-0ef307009337 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:36.009340 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-553d64d4-c13b-4e5d-9d15-0ef307009337 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:36.009800 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-553d64d4-c13b-4e5d-9d15-0ef307009337 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:36.072543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-553d64d4-c13b-4e5d-9d15-0ef307009337 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:36.080807 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-553d64d4-c13b-4e5d-9d15-0ef307009337 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.085099 Apr 08 11:30:36.081381 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1188/2124] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:35 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:36.994142 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-cc144d11-8bdf-48d5-b2d9-2c622414ab1b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:36.994903 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-cc144d11-8bdf-48d5-b2d9-2c622414ab1b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:37.002317 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cc144d11-8bdf-48d5-b2d9-2c622414ab1b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:37.002769 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cc144d11-8bdf-48d5-b2d9-2c622414ab1b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:37.003553 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cc144d11-8bdf-48d5-b2d9-2c622414ab1b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:37.003989 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cc144d11-8bdf-48d5-b2d9-2c622414ab1b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:37.153394 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-cc144d11-8bdf-48d5-b2d9-2c622414ab1b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:37.162049 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-cc144d11-8bdf-48d5-b2d9-2c622414ab1b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.172122 Apr 08 11:30:37.162627 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1189/2125] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:36 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:37.167499 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b0adf028-0234-4754-aeee-bda69225960b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:37.167933 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b0adf028-0234-4754-aeee-bda69225960b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:37.174353 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b0adf028-0234-4754-aeee-bda69225960b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:37.174816 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b0adf028-0234-4754-aeee-bda69225960b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:37.175581 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b0adf028-0234-4754-aeee-bda69225960b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:37.176021 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b0adf028-0234-4754-aeee-bda69225960b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:37.238218 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b0adf028-0234-4754-aeee-bda69225960b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:37.247094 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b0adf028-0234-4754-aeee-bda69225960b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.083350 Apr 08 11:30:37.256205 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1190/2126] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:37 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:38.180179 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-19cff12d-f895-4b7d-8e27-493949bf9a2f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:38.180981 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-19cff12d-f895-4b7d-8e27-493949bf9a2f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:38.187465 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-19cff12d-f895-4b7d-8e27-493949bf9a2f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:38.198536 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-19cff12d-f895-4b7d-8e27-493949bf9a2f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:38.198536 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-19cff12d-f895-4b7d-8e27-493949bf9a2f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:38.198536 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-19cff12d-f895-4b7d-8e27-493949bf9a2f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:38.337326 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-19cff12d-f895-4b7d-8e27-493949bf9a2f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:38.345607 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-19cff12d-f895-4b7d-8e27-493949bf9a2f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.169055 Apr 08 11:30:38.346029 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1191/2127] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:38 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:38.350626 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9bbb954b-70bc-46e2-b3e5-2466e241b954 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:38.351347 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9bbb954b-70bc-46e2-b3e5-2466e241b954 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:38.357808 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9bbb954b-70bc-46e2-b3e5-2466e241b954 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:38.358259 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9bbb954b-70bc-46e2-b3e5-2466e241b954 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:38.359016 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9bbb954b-70bc-46e2-b3e5-2466e241b954 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:38.359451 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9bbb954b-70bc-46e2-b3e5-2466e241b954 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:38.417752 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9bbb954b-70bc-46e2-b3e5-2466e241b954 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:38.425846 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9bbb954b-70bc-46e2-b3e5-2466e241b954 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078841 Apr 08 11:30:38.426418 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1192/2128] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:38 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:39.362936 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bb472cae-0624-4aa7-a9c8-bbada641511b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:39.363645 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-bb472cae-0624-4aa7-a9c8-bbada641511b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:39.370395 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bb472cae-0624-4aa7-a9c8-bbada641511b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:39.370863 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bb472cae-0624-4aa7-a9c8-bbada641511b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:39.371631 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bb472cae-0624-4aa7-a9c8-bbada641511b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:39.372671 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bb472cae-0624-4aa7-a9c8-bbada641511b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:39.504666 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-bb472cae-0624-4aa7-a9c8-bbada641511b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:39.512187 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-bb472cae-0624-4aa7-a9c8-bbada641511b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.153180 Apr 08 11:30:39.512821 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1193/2129] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:39 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:39.517286 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-fc4523ae-588a-4f92-9dc4-c60feb90fca3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:39.517931 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-fc4523ae-588a-4f92-9dc4-c60feb90fca3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:39.523514 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fc4523ae-588a-4f92-9dc4-c60feb90fca3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:39.523972 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fc4523ae-588a-4f92-9dc4-c60feb90fca3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:39.524746 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fc4523ae-588a-4f92-9dc4-c60feb90fca3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:39.525191 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fc4523ae-588a-4f92-9dc4-c60feb90fca3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:39.591713 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-fc4523ae-588a-4f92-9dc4-c60feb90fca3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:39.599253 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-fc4523ae-588a-4f92-9dc4-c60feb90fca3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.085496 Apr 08 11:30:39.599825 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1194/2130] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:39 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:40.529789 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a7f0bfcd-b173-4675-b98a-a1bfa084cdfd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:40.530484 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a7f0bfcd-b173-4675-b98a-a1bfa084cdfd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:40.536810 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a7f0bfcd-b173-4675-b98a-a1bfa084cdfd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:40.537261 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a7f0bfcd-b173-4675-b98a-a1bfa084cdfd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:40.538061 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a7f0bfcd-b173-4675-b98a-a1bfa084cdfd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:40.538502 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a7f0bfcd-b173-4675-b98a-a1bfa084cdfd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:40.688087 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a7f0bfcd-b173-4675-b98a-a1bfa084cdfd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:40.696108 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a7f0bfcd-b173-4675-b98a-a1bfa084cdfd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.170496 Apr 08 11:30:40.696740 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1195/2131] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:40 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:40.702145 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5b6a7fe0-d591-4884-8a75-a5d12dfa7a00 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:40.702743 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5b6a7fe0-d591-4884-8a75-a5d12dfa7a00 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:40.708974 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5b6a7fe0-d591-4884-8a75-a5d12dfa7a00 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:40.709424 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5b6a7fe0-d591-4884-8a75-a5d12dfa7a00 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:40.710239 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5b6a7fe0-d591-4884-8a75-a5d12dfa7a00 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:40.710674 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5b6a7fe0-d591-4884-8a75-a5d12dfa7a00 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:40.774581 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5b6a7fe0-d591-4884-8a75-a5d12dfa7a00 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:40.782705 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5b6a7fe0-d591-4884-8a75-a5d12dfa7a00 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.084786 Apr 08 11:30:40.783193 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1196/2132] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:40 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:41.714433 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a2423058-32a0-423d-85c2-6d8bae75d530 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:41.715388 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a2423058-32a0-423d-85c2-6d8bae75d530 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:41.722226 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a2423058-32a0-423d-85c2-6d8bae75d530 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:41.722673 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a2423058-32a0-423d-85c2-6d8bae75d530 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:41.723451 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a2423058-32a0-423d-85c2-6d8bae75d530 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:41.723886 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a2423058-32a0-423d-85c2-6d8bae75d530 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:41.863628 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a2423058-32a0-423d-85c2-6d8bae75d530 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:41.871304 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a2423058-32a0-423d-85c2-6d8bae75d530 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.160855 Apr 08 11:30:41.871892 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1197/2133] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:41 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:41.876463 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-dde4c593-9393-40f7-8cf2-73c60041c76f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:41.877066 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-dde4c593-9393-40f7-8cf2-73c60041c76f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:41.882692 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dde4c593-9393-40f7-8cf2-73c60041c76f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:41.883132 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dde4c593-9393-40f7-8cf2-73c60041c76f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:41.883896 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dde4c593-9393-40f7-8cf2-73c60041c76f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:41.884327 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dde4c593-9393-40f7-8cf2-73c60041c76f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:41.945142 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-dde4c593-9393-40f7-8cf2-73c60041c76f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:41.953591 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-dde4c593-9393-40f7-8cf2-73c60041c76f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080606 Apr 08 11:30:41.954235 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1198/2134] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:41 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:42.888503 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-80fe774d-2e3b-4541-998e-cdbf0129ac0d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:42.889195 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-80fe774d-2e3b-4541-998e-cdbf0129ac0d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:42.895583 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-80fe774d-2e3b-4541-998e-cdbf0129ac0d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:42.895956 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-80fe774d-2e3b-4541-998e-cdbf0129ac0d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:42.896723 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-80fe774d-2e3b-4541-998e-cdbf0129ac0d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:42.897155 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-80fe774d-2e3b-4541-998e-cdbf0129ac0d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:43.040085 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-80fe774d-2e3b-4541-998e-cdbf0129ac0d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:43.048858 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-80fe774d-2e3b-4541-998e-cdbf0129ac0d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.164236 Apr 08 11:30:43.050653 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1199/2135] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:42 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:43.054087 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-737a2b8f-ae3f-4f88-adce-543d096baf0e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:43.054910 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-737a2b8f-ae3f-4f88-adce-543d096baf0e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:43.060650 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-737a2b8f-ae3f-4f88-adce-543d096baf0e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:43.061110 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-737a2b8f-ae3f-4f88-adce-543d096baf0e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:43.061921 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-737a2b8f-ae3f-4f88-adce-543d096baf0e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:43.062367 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-737a2b8f-ae3f-4f88-adce-543d096baf0e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:43.127192 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-737a2b8f-ae3f-4f88-adce-543d096baf0e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:43.134815 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-737a2b8f-ae3f-4f88-adce-543d096baf0e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.084247 Apr 08 11:30:43.135404 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1200/2136] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:43 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:44.066604 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e3ce2206-ada5-4c33-9d8e-b033c2c2bceb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:44.067308 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e3ce2206-ada5-4c33-9d8e-b033c2c2bceb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:44.073691 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e3ce2206-ada5-4c33-9d8e-b033c2c2bceb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:44.074181 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e3ce2206-ada5-4c33-9d8e-b033c2c2bceb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:44.075016 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e3ce2206-ada5-4c33-9d8e-b033c2c2bceb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:44.075464 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e3ce2206-ada5-4c33-9d8e-b033c2c2bceb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:44.209348 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e3ce2206-ada5-4c33-9d8e-b033c2c2bceb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:44.217875 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e3ce2206-ada5-4c33-9d8e-b033c2c2bceb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.155024 Apr 08 11:30:44.218466 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1201/2137] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:44 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:44.223129 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8afaa35b-af0b-49e6-b1dd-a044455a93bf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:44.223743 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8afaa35b-af0b-49e6-b1dd-a044455a93bf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:44.230031 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8afaa35b-af0b-49e6-b1dd-a044455a93bf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:44.230474 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8afaa35b-af0b-49e6-b1dd-a044455a93bf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:44.231313 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8afaa35b-af0b-49e6-b1dd-a044455a93bf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:44.232332 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8afaa35b-af0b-49e6-b1dd-a044455a93bf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:44.293705 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8afaa35b-af0b-49e6-b1dd-a044455a93bf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:44.301945 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8afaa35b-af0b-49e6-b1dd-a044455a93bf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082450 Apr 08 11:30:44.302525 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1202/2138] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:44 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:45.235216 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a7f9a252-9a13-458d-b94b-c8c56e457f6a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:45.235981 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a7f9a252-9a13-458d-b94b-c8c56e457f6a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:45.242475 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a7f9a252-9a13-458d-b94b-c8c56e457f6a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:45.242930 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a7f9a252-9a13-458d-b94b-c8c56e457f6a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:45.243981 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a7f9a252-9a13-458d-b94b-c8c56e457f6a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:45.244422 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a7f9a252-9a13-458d-b94b-c8c56e457f6a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:45.388984 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a7f9a252-9a13-458d-b94b-c8c56e457f6a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:45.396788 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a7f9a252-9a13-458d-b94b-c8c56e457f6a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.165389 Apr 08 11:30:45.397463 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1203/2139] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:45 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:45.402422 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f2f902ce-19fb-4076-b215-57bafb5bb65c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:45.403032 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f2f902ce-19fb-4076-b215-57bafb5bb65c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:45.409225 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f2f902ce-19fb-4076-b215-57bafb5bb65c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:45.409670 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f2f902ce-19fb-4076-b215-57bafb5bb65c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:45.410591 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f2f902ce-19fb-4076-b215-57bafb5bb65c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:45.411026 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f2f902ce-19fb-4076-b215-57bafb5bb65c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:45.472751 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f2f902ce-19fb-4076-b215-57bafb5bb65c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:45.484183 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f2f902ce-19fb-4076-b215-57bafb5bb65c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.085641 Apr 08 11:30:45.484808 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1204/2140] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:45 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:46.416213 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-151ba3f0-8ccb-428f-b984-d9898749a816 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:46.417532 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-151ba3f0-8ccb-428f-b984-d9898749a816 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:46.424534 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-151ba3f0-8ccb-428f-b984-d9898749a816 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:46.424987 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-151ba3f0-8ccb-428f-b984-d9898749a816 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:46.425836 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-151ba3f0-8ccb-428f-b984-d9898749a816 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:46.426280 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-151ba3f0-8ccb-428f-b984-d9898749a816 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:46.560946 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-151ba3f0-8ccb-428f-b984-d9898749a816 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:46.568296 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-151ba3f0-8ccb-428f-b984-d9898749a816 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.156020 Apr 08 11:30:46.568869 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1205/2141] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:46 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:46.573184 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b6100a27-7572-4eac-979e-61ea587a0ec2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:46.573797 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b6100a27-7572-4eac-979e-61ea587a0ec2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:46.579306 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b6100a27-7572-4eac-979e-61ea587a0ec2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:46.579744 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b6100a27-7572-4eac-979e-61ea587a0ec2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:46.580503 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b6100a27-7572-4eac-979e-61ea587a0ec2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:46.580936 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b6100a27-7572-4eac-979e-61ea587a0ec2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:46.639417 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b6100a27-7572-4eac-979e-61ea587a0ec2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:46.647431 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b6100a27-7572-4eac-979e-61ea587a0ec2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077578 Apr 08 11:30:46.648011 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1206/2142] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:46 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:47.584647 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-10682ea4-061d-4003-b8fc-a654b7b3fb59 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:47.591721 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-10682ea4-061d-4003-b8fc-a654b7b3fb59 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:47.591721 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-10682ea4-061d-4003-b8fc-a654b7b3fb59 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:47.592125 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-10682ea4-061d-4003-b8fc-a654b7b3fb59 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:47.592904 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-10682ea4-061d-4003-b8fc-a654b7b3fb59 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:47.593351 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-10682ea4-061d-4003-b8fc-a654b7b3fb59 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:47.731539 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-10682ea4-061d-4003-b8fc-a654b7b3fb59 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:47.746077 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-10682ea4-061d-4003-b8fc-a654b7b3fb59 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.165263 Apr 08 11:30:47.746671 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1207/2143] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:47 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:47.752479 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bfb67dc5-dea5-4188-a431-b91a7c737854 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:47.753346 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-bfb67dc5-dea5-4188-a431-b91a7c737854 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:47.761012 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bfb67dc5-dea5-4188-a431-b91a7c737854 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:47.761468 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bfb67dc5-dea5-4188-a431-b91a7c737854 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:47.762388 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bfb67dc5-dea5-4188-a431-b91a7c737854 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:47.762756 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bfb67dc5-dea5-4188-a431-b91a7c737854 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:47.821704 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-bfb67dc5-dea5-4188-a431-b91a7c737854 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:47.829186 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-bfb67dc5-dea5-4188-a431-b91a7c737854 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081555 Apr 08 11:30:47.829758 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1208/2144] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:47 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:48.763582 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-662c37a4-5718-4943-93d7-5da39b86808d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:48.764859 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-662c37a4-5718-4943-93d7-5da39b86808d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:48.771182 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-662c37a4-5718-4943-93d7-5da39b86808d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:48.771640 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-662c37a4-5718-4943-93d7-5da39b86808d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:48.772416 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-662c37a4-5718-4943-93d7-5da39b86808d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:48.772861 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-662c37a4-5718-4943-93d7-5da39b86808d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:48.908076 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-662c37a4-5718-4943-93d7-5da39b86808d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:48.915405 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-662c37a4-5718-4943-93d7-5da39b86808d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.155679 Apr 08 11:30:48.916410 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1209/2145] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:48 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:48.920304 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9c392abd-e6a3-4b1e-a921-994c481978f0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:48.920899 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9c392abd-e6a3-4b1e-a921-994c481978f0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:48.926404 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9c392abd-e6a3-4b1e-a921-994c481978f0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:48.926847 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9c392abd-e6a3-4b1e-a921-994c481978f0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:48.927605 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9c392abd-e6a3-4b1e-a921-994c481978f0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:48.928037 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9c392abd-e6a3-4b1e-a921-994c481978f0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:48.985942 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9c392abd-e6a3-4b1e-a921-994c481978f0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:48.993255 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9c392abd-e6a3-4b1e-a921-994c481978f0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.076350 Apr 08 11:30:48.994113 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1210/2146] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:48 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:49.932451 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e0994a29-8b62-406e-89e9-80957bd94da1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:49.933084 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e0994a29-8b62-406e-89e9-80957bd94da1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:49.940396 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e0994a29-8b62-406e-89e9-80957bd94da1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:49.940843 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e0994a29-8b62-406e-89e9-80957bd94da1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:49.941601 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e0994a29-8b62-406e-89e9-80957bd94da1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:49.942072 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e0994a29-8b62-406e-89e9-80957bd94da1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:50.079863 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e0994a29-8b62-406e-89e9-80957bd94da1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:50.087536 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e0994a29-8b62-406e-89e9-80957bd94da1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.158954 Apr 08 11:30:50.088112 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1211/2147] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:49 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:50.093329 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-780f02e8-198f-43fe-9b3f-19eb82ae11b5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:50.094074 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-780f02e8-198f-43fe-9b3f-19eb82ae11b5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:50.099988 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-780f02e8-198f-43fe-9b3f-19eb82ae11b5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:50.100438 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-780f02e8-198f-43fe-9b3f-19eb82ae11b5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:50.101208 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-780f02e8-198f-43fe-9b3f-19eb82ae11b5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:50.101644 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-780f02e8-198f-43fe-9b3f-19eb82ae11b5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:50.161427 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-780f02e8-198f-43fe-9b3f-19eb82ae11b5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:50.168972 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-780f02e8-198f-43fe-9b3f-19eb82ae11b5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079922 Apr 08 11:30:50.169547 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1212/2148] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:50 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:51.105413 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a25a71bd-2fe4-4caa-b589-1aa930227603 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:51.106154 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a25a71bd-2fe4-4caa-b589-1aa930227603 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:51.112461 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a25a71bd-2fe4-4caa-b589-1aa930227603 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:51.112930 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a25a71bd-2fe4-4caa-b589-1aa930227603 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:51.113691 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a25a71bd-2fe4-4caa-b589-1aa930227603 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:51.114151 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a25a71bd-2fe4-4caa-b589-1aa930227603 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:51.252319 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a25a71bd-2fe4-4caa-b589-1aa930227603 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:51.259632 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a25a71bd-2fe4-4caa-b589-1aa930227603 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.158095 Apr 08 11:30:51.260198 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1213/2149] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:51 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:51.264517 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f54678c2-3f61-4798-a7ce-770cf19f5a5b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:51.265121 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f54678c2-3f61-4798-a7ce-770cf19f5a5b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:51.270934 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f54678c2-3f61-4798-a7ce-770cf19f5a5b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:51.271405 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f54678c2-3f61-4798-a7ce-770cf19f5a5b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:51.272164 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f54678c2-3f61-4798-a7ce-770cf19f5a5b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:51.272595 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f54678c2-3f61-4798-a7ce-770cf19f5a5b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:51.330787 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f54678c2-3f61-4798-a7ce-770cf19f5a5b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:51.338112 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f54678c2-3f61-4798-a7ce-770cf19f5a5b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.076952 Apr 08 11:30:51.338685 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1214/2150] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:51 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:52.276749 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-495a2b73-1a05-4208-98c1-d61949b204b7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:52.277437 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-495a2b73-1a05-4208-98c1-d61949b204b7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:52.284355 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-495a2b73-1a05-4208-98c1-d61949b204b7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:52.284808 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-495a2b73-1a05-4208-98c1-d61949b204b7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:52.285579 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-495a2b73-1a05-4208-98c1-d61949b204b7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:52.286044 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-495a2b73-1a05-4208-98c1-d61949b204b7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:52.417432 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-495a2b73-1a05-4208-98c1-d61949b204b7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:52.424976 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-495a2b73-1a05-4208-98c1-d61949b204b7 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.152034 Apr 08 11:30:52.425550 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1215/2151] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:52 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:52.429916 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b488ec64-85f5-440e-97e1-65bfb8c8252e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:52.430528 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b488ec64-85f5-440e-97e1-65bfb8c8252e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:52.436821 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b488ec64-85f5-440e-97e1-65bfb8c8252e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:52.437291 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b488ec64-85f5-440e-97e1-65bfb8c8252e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:52.438117 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b488ec64-85f5-440e-97e1-65bfb8c8252e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:52.438560 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b488ec64-85f5-440e-97e1-65bfb8c8252e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:52.500336 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b488ec64-85f5-440e-97e1-65bfb8c8252e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:52.507663 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b488ec64-85f5-440e-97e1-65bfb8c8252e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081145 Apr 08 11:30:52.508257 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1216/2152] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:52 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:53.442807 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-044eb3ae-9e1a-4606-8c43-666e88054aae tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:53.443562 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-044eb3ae-9e1a-4606-8c43-666e88054aae tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:53.449818 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-044eb3ae-9e1a-4606-8c43-666e88054aae tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:53.450280 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-044eb3ae-9e1a-4606-8c43-666e88054aae tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:53.451046 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-044eb3ae-9e1a-4606-8c43-666e88054aae tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:53.451524 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-044eb3ae-9e1a-4606-8c43-666e88054aae tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:53.587068 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-044eb3ae-9e1a-4606-8c43-666e88054aae tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:53.594771 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-044eb3ae-9e1a-4606-8c43-666e88054aae tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.155819 Apr 08 11:30:53.595387 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1217/2153] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:53 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:53.600017 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-69f14891-4cde-4a71-acc1-c37fc836c27f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:53.600631 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-69f14891-4cde-4a71-acc1-c37fc836c27f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:53.606569 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-69f14891-4cde-4a71-acc1-c37fc836c27f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:53.607024 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-69f14891-4cde-4a71-acc1-c37fc836c27f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:53.608305 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-69f14891-4cde-4a71-acc1-c37fc836c27f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:53.608745 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-69f14891-4cde-4a71-acc1-c37fc836c27f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:53.668414 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-69f14891-4cde-4a71-acc1-c37fc836c27f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:53.676473 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-69f14891-4cde-4a71-acc1-c37fc836c27f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080071 Apr 08 11:30:53.677103 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1218/2154] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:53 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:54.612280 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-52558edb-e0e1-4951-8fdf-fbe328b14ded tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:54.612992 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-52558edb-e0e1-4951-8fdf-fbe328b14ded tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:54.619577 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-52558edb-e0e1-4951-8fdf-fbe328b14ded tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:54.620033 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-52558edb-e0e1-4951-8fdf-fbe328b14ded tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:54.620802 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-52558edb-e0e1-4951-8fdf-fbe328b14ded tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:54.621246 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-52558edb-e0e1-4951-8fdf-fbe328b14ded tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:54.760764 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-52558edb-e0e1-4951-8fdf-fbe328b14ded tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:54.768960 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-52558edb-e0e1-4951-8fdf-fbe328b14ded tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.160900 Apr 08 11:30:54.769536 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1219/2155] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:54 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:54.773951 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c18a4534-432e-465f-9550-a06532d91a2f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:54.774500 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c18a4534-432e-465f-9550-a06532d91a2f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:54.780494 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c18a4534-432e-465f-9550-a06532d91a2f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:54.780948 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c18a4534-432e-465f-9550-a06532d91a2f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:54.781748 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c18a4534-432e-465f-9550-a06532d91a2f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:54.782225 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c18a4534-432e-465f-9550-a06532d91a2f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:54.841308 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c18a4534-432e-465f-9550-a06532d91a2f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:54.849458 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c18a4534-432e-465f-9550-a06532d91a2f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078936 Apr 08 11:30:54.850075 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1220/2156] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:54 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:55.785857 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d0a2392e-5188-4bf1-8d62-1df7d4b56dd3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:55.786555 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d0a2392e-5188-4bf1-8d62-1df7d4b56dd3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:55.792887 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d0a2392e-5188-4bf1-8d62-1df7d4b56dd3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:55.793335 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d0a2392e-5188-4bf1-8d62-1df7d4b56dd3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:55.794133 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d0a2392e-5188-4bf1-8d62-1df7d4b56dd3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:55.794576 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d0a2392e-5188-4bf1-8d62-1df7d4b56dd3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:55.927776 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d0a2392e-5188-4bf1-8d62-1df7d4b56dd3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:55.935165 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d0a2392e-5188-4bf1-8d62-1df7d4b56dd3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.153196 Apr 08 11:30:55.935762 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1221/2157] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:55 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:55.940628 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2f3cd3a7-2ed5-49f0-a929-2ca0f213ab59 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:55.941233 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2f3cd3a7-2ed5-49f0-a929-2ca0f213ab59 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:55.946737 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2f3cd3a7-2ed5-49f0-a929-2ca0f213ab59 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:55.947186 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2f3cd3a7-2ed5-49f0-a929-2ca0f213ab59 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:55.947945 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2f3cd3a7-2ed5-49f0-a929-2ca0f213ab59 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:55.948384 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2f3cd3a7-2ed5-49f0-a929-2ca0f213ab59 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:56.010469 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2f3cd3a7-2ed5-49f0-a929-2ca0f213ab59 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:56.017877 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2f3cd3a7-2ed5-49f0-a929-2ca0f213ab59 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081143 Apr 08 11:30:56.018456 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1222/2158] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:55 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:56.952789 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-994330a5-e9c1-4e14-9076-1859ad556d7b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:56.953444 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-994330a5-e9c1-4e14-9076-1859ad556d7b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:56.961393 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-994330a5-e9c1-4e14-9076-1859ad556d7b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:56.961880 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-994330a5-e9c1-4e14-9076-1859ad556d7b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:56.962671 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-994330a5-e9c1-4e14-9076-1859ad556d7b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:56.964073 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-994330a5-e9c1-4e14-9076-1859ad556d7b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:57.111623 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-994330a5-e9c1-4e14-9076-1859ad556d7b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:57.121294 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-994330a5-e9c1-4e14-9076-1859ad556d7b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.172064 Apr 08 11:30:57.122225 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1223/2159] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:56 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:57.127522 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-daf6bf86-81f7-4129-9a7b-b4bcb06fde43 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:57.128191 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-daf6bf86-81f7-4129-9a7b-b4bcb06fde43 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:57.134146 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-daf6bf86-81f7-4129-9a7b-b4bcb06fde43 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:57.134604 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-daf6bf86-81f7-4129-9a7b-b4bcb06fde43 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:57.135378 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-daf6bf86-81f7-4129-9a7b-b4bcb06fde43 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:57.135824 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-daf6bf86-81f7-4129-9a7b-b4bcb06fde43 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:57.195410 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-daf6bf86-81f7-4129-9a7b-b4bcb06fde43 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:57.203533 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-daf6bf86-81f7-4129-9a7b-b4bcb06fde43 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079626 Apr 08 11:30:57.204044 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1224/2160] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:57 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:58.139524 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0c294a40-d280-437d-8424-ab41170511ed tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:58.140763 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0c294a40-d280-437d-8424-ab41170511ed tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:58.147179 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0c294a40-d280-437d-8424-ab41170511ed tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:58.147636 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0c294a40-d280-437d-8424-ab41170511ed tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:58.148414 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0c294a40-d280-437d-8424-ab41170511ed tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:58.148856 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0c294a40-d280-437d-8424-ab41170511ed tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:58.288340 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0c294a40-d280-437d-8424-ab41170511ed tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:58.295913 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0c294a40-d280-437d-8424-ab41170511ed tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.160307 Apr 08 11:30:58.296521 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1225/2161] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:58 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:58.301198 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-52347b45-c566-4ca6-b5dd-051c23112ae5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:58.301868 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-52347b45-c566-4ca6-b5dd-051c23112ae5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:58.307704 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-52347b45-c566-4ca6-b5dd-051c23112ae5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:58.308158 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-52347b45-c566-4ca6-b5dd-051c23112ae5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:58.308923 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-52347b45-c566-4ca6-b5dd-051c23112ae5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:58.309360 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-52347b45-c566-4ca6-b5dd-051c23112ae5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:58.375278 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-52347b45-c566-4ca6-b5dd-051c23112ae5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:58.382836 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-52347b45-c566-4ca6-b5dd-051c23112ae5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.085368 Apr 08 11:30:58.383436 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1226/2162] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:58 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:30:59.313152 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6fb95331-345f-439c-a23f-97098da15989 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:59.313958 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6fb95331-345f-439c-a23f-97098da15989 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:59.320120 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6fb95331-345f-439c-a23f-97098da15989 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:59.320565 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6fb95331-345f-439c-a23f-97098da15989 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:59.321322 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6fb95331-345f-439c-a23f-97098da15989 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:59.321753 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6fb95331-345f-439c-a23f-97098da15989 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:59.456076 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6fb95331-345f-439c-a23f-97098da15989 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:59.463481 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6fb95331-345f-439c-a23f-97098da15989 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.154272 Apr 08 11:30:59.464043 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1227/2163] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:59 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:30:59.468579 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-decf9ac3-968d-4cc4-9bdb-53dd4f3807e9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:30:59.469174 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-decf9ac3-968d-4cc4-9bdb-53dd4f3807e9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:30:59.475542 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-decf9ac3-968d-4cc4-9bdb-53dd4f3807e9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:59.475994 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-decf9ac3-968d-4cc4-9bdb-53dd4f3807e9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:59.476755 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-decf9ac3-968d-4cc4-9bdb-53dd4f3807e9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:30:59.477184 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-decf9ac3-968d-4cc4-9bdb-53dd4f3807e9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:30:59.537048 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-decf9ac3-968d-4cc4-9bdb-53dd4f3807e9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:30:59.544265 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-decf9ac3-968d-4cc4-9bdb-53dd4f3807e9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079289 Apr 08 11:30:59.544828 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1228/2164] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:30:59 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:00.481900 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-210c37de-a75a-41a2-8d45-223cec23699f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:00.482561 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-210c37de-a75a-41a2-8d45-223cec23699f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:00.489199 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-210c37de-a75a-41a2-8d45-223cec23699f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:00.489654 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-210c37de-a75a-41a2-8d45-223cec23699f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:00.490469 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-210c37de-a75a-41a2-8d45-223cec23699f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:00.490904 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-210c37de-a75a-41a2-8d45-223cec23699f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:00.626973 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-210c37de-a75a-41a2-8d45-223cec23699f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:00.634426 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-210c37de-a75a-41a2-8d45-223cec23699f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.156470 Apr 08 11:31:00.634995 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1229/2165] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:00 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:00.639348 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9c0bf33f-682a-4d3d-a288-ebc3d8d784c2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:00.640509 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9c0bf33f-682a-4d3d-a288-ebc3d8d784c2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:00.647699 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9c0bf33f-682a-4d3d-a288-ebc3d8d784c2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:00.648152 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9c0bf33f-682a-4d3d-a288-ebc3d8d784c2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:00.648927 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9c0bf33f-682a-4d3d-a288-ebc3d8d784c2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:00.649366 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9c0bf33f-682a-4d3d-a288-ebc3d8d784c2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:00.709457 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9c0bf33f-682a-4d3d-a288-ebc3d8d784c2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:00.716178 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9c0bf33f-682a-4d3d-a288-ebc3d8d784c2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080241 Apr 08 11:31:00.716744 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1230/2166] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:00 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:01.651855 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ffe21d3d-e03c-4074-880f-26980681d91b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:01.652463 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ffe21d3d-e03c-4074-880f-26980681d91b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:01.659112 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ffe21d3d-e03c-4074-880f-26980681d91b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:01.659557 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ffe21d3d-e03c-4074-880f-26980681d91b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:01.660323 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ffe21d3d-e03c-4074-880f-26980681d91b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:01.660758 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ffe21d3d-e03c-4074-880f-26980681d91b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:01.795820 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ffe21d3d-e03c-4074-880f-26980681d91b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:01.803992 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ffe21d3d-e03c-4074-880f-26980681d91b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.155990 Apr 08 11:31:01.804568 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1231/2167] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:01 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:01.809035 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2eb7408b-68fd-43b2-bbeb-4a06ca77b488 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:01.809637 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2eb7408b-68fd-43b2-bbeb-4a06ca77b488 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:01.816022 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2eb7408b-68fd-43b2-bbeb-4a06ca77b488 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:01.816480 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2eb7408b-68fd-43b2-bbeb-4a06ca77b488 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:01.817256 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2eb7408b-68fd-43b2-bbeb-4a06ca77b488 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:01.817701 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2eb7408b-68fd-43b2-bbeb-4a06ca77b488 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:01.876349 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2eb7408b-68fd-43b2-bbeb-4a06ca77b488 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:01.883861 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2eb7408b-68fd-43b2-bbeb-4a06ca77b488 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078349 Apr 08 11:31:01.884435 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1232/2168] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:01 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:02.821437 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-45ee3c13-603f-4ed0-8afe-4c55120cad4f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:02.822153 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-45ee3c13-603f-4ed0-8afe-4c55120cad4f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:02.828448 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-45ee3c13-603f-4ed0-8afe-4c55120cad4f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:02.829590 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-45ee3c13-603f-4ed0-8afe-4c55120cad4f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:02.830413 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-45ee3c13-603f-4ed0-8afe-4c55120cad4f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:02.830839 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-45ee3c13-603f-4ed0-8afe-4c55120cad4f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:02.964206 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-45ee3c13-603f-4ed0-8afe-4c55120cad4f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:02.971627 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-45ee3c13-603f-4ed0-8afe-4c55120cad4f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.154088 Apr 08 11:31:02.972204 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1233/2169] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:02 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:02.976749 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9e98d2bd-4d1c-4445-a963-c64a4e2fdd8e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:02.977356 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9e98d2bd-4d1c-4445-a963-c64a4e2fdd8e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:02.983355 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9e98d2bd-4d1c-4445-a963-c64a4e2fdd8e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:02.983815 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9e98d2bd-4d1c-4445-a963-c64a4e2fdd8e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:02.984609 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9e98d2bd-4d1c-4445-a963-c64a4e2fdd8e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:02.985066 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9e98d2bd-4d1c-4445-a963-c64a4e2fdd8e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:03.044782 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9e98d2bd-4d1c-4445-a963-c64a4e2fdd8e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:03.052309 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9e98d2bd-4d1c-4445-a963-c64a4e2fdd8e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079141 Apr 08 11:31:03.052886 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1234/2170] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:02 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:03.990007 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-cdf491c6-cd7d-46aa-acbd-7db63374306f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:03.991162 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-cdf491c6-cd7d-46aa-acbd-7db63374306f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:03.999031 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cdf491c6-cd7d-46aa-acbd-7db63374306f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:03.999499 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cdf491c6-cd7d-46aa-acbd-7db63374306f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:04.000284 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cdf491c6-cd7d-46aa-acbd-7db63374306f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:04.001660 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cdf491c6-cd7d-46aa-acbd-7db63374306f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:04.139536 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-cdf491c6-cd7d-46aa-acbd-7db63374306f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:04.147266 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-cdf491c6-cd7d-46aa-acbd-7db63374306f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.162425 Apr 08 11:31:04.147827 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1235/2171] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:03 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:04.152199 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-daae4af8-311e-4663-bbf5-9dea734d1a85 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:04.152791 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-daae4af8-311e-4663-bbf5-9dea734d1a85 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:04.158953 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-daae4af8-311e-4663-bbf5-9dea734d1a85 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:04.159394 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-daae4af8-311e-4663-bbf5-9dea734d1a85 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:04.160152 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-daae4af8-311e-4663-bbf5-9dea734d1a85 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:04.160584 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-daae4af8-311e-4663-bbf5-9dea734d1a85 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:04.221000 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-daae4af8-311e-4663-bbf5-9dea734d1a85 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:04.228529 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-daae4af8-311e-4663-bbf5-9dea734d1a85 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079724 Apr 08 11:31:04.229105 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1236/2172] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:04 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:05.164300 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-197c7c3a-0a92-4a8c-94e1-8d6de94f88db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:05.164989 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-197c7c3a-0a92-4a8c-94e1-8d6de94f88db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:05.171286 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-197c7c3a-0a92-4a8c-94e1-8d6de94f88db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:05.171753 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-197c7c3a-0a92-4a8c-94e1-8d6de94f88db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:05.173213 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-197c7c3a-0a92-4a8c-94e1-8d6de94f88db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:05.173653 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-197c7c3a-0a92-4a8c-94e1-8d6de94f88db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:05.307197 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-197c7c3a-0a92-4a8c-94e1-8d6de94f88db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:05.314498 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-197c7c3a-0a92-4a8c-94e1-8d6de94f88db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.154064 Apr 08 11:31:05.315069 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1237/2173] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:05 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:05.319513 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-aefcfdb0-66eb-4e85-8c63-a37fe2b08c71 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:05.320116 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-aefcfdb0-66eb-4e85-8c63-a37fe2b08c71 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:05.325930 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aefcfdb0-66eb-4e85-8c63-a37fe2b08c71 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:05.326383 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aefcfdb0-66eb-4e85-8c63-a37fe2b08c71 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:05.327158 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aefcfdb0-66eb-4e85-8c63-a37fe2b08c71 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:05.327595 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aefcfdb0-66eb-4e85-8c63-a37fe2b08c71 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:05.390332 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-aefcfdb0-66eb-4e85-8c63-a37fe2b08c71 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:05.397581 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-aefcfdb0-66eb-4e85-8c63-a37fe2b08c71 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081587 Apr 08 11:31:05.398190 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1238/2174] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:05 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:06.331521 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1d1f81c0-949a-4279-b64b-7100782aab9b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:06.332222 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1d1f81c0-949a-4279-b64b-7100782aab9b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:06.338501 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1d1f81c0-949a-4279-b64b-7100782aab9b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:06.338954 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1d1f81c0-949a-4279-b64b-7100782aab9b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:06.339735 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1d1f81c0-949a-4279-b64b-7100782aab9b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:06.340179 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1d1f81c0-949a-4279-b64b-7100782aab9b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:06.474085 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1d1f81c0-949a-4279-b64b-7100782aab9b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:06.481394 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1d1f81c0-949a-4279-b64b-7100782aab9b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.153816 Apr 08 11:31:06.482026 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1239/2175] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:06 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:06.486954 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f7958e61-2ed4-441a-a2b0-d19f300eae55 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:06.487549 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f7958e61-2ed4-441a-a2b0-d19f300eae55 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:06.493246 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f7958e61-2ed4-441a-a2b0-d19f300eae55 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:06.494008 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f7958e61-2ed4-441a-a2b0-d19f300eae55 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:06.494770 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f7958e61-2ed4-441a-a2b0-d19f300eae55 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:06.495204 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f7958e61-2ed4-441a-a2b0-d19f300eae55 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:06.553632 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f7958e61-2ed4-441a-a2b0-d19f300eae55 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:06.560998 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f7958e61-2ed4-441a-a2b0-d19f300eae55 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078046 Apr 08 11:31:06.561558 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1240/2176] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:06 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:07.499207 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-abc6da57-859b-47bc-bb38-6466a10bcddf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:07.499877 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-abc6da57-859b-47bc-bb38-6466a10bcddf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:07.506755 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-abc6da57-859b-47bc-bb38-6466a10bcddf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:07.507212 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-abc6da57-859b-47bc-bb38-6466a10bcddf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:07.507978 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-abc6da57-859b-47bc-bb38-6466a10bcddf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:07.508423 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-abc6da57-859b-47bc-bb38-6466a10bcddf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:07.646932 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-abc6da57-859b-47bc-bb38-6466a10bcddf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:07.654856 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-abc6da57-859b-47bc-bb38-6466a10bcddf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.159491 Apr 08 11:31:07.655436 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1241/2177] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:07 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:07.659769 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e7517b31-683f-420d-b607-24d14fd10fc4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:07.660364 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e7517b31-683f-420d-b607-24d14fd10fc4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:07.666027 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e7517b31-683f-420d-b607-24d14fd10fc4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:07.666477 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e7517b31-683f-420d-b607-24d14fd10fc4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:07.667232 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e7517b31-683f-420d-b607-24d14fd10fc4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:07.667664 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e7517b31-683f-420d-b607-24d14fd10fc4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:07.726351 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e7517b31-683f-420d-b607-24d14fd10fc4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:07.733581 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e7517b31-683f-420d-b607-24d14fd10fc4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077222 Apr 08 11:31:07.734185 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1242/2178] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:07 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:08.671714 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-048377f8-a7d7-4e31-9c40-02a06a141abd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:08.672344 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-048377f8-a7d7-4e31-9c40-02a06a141abd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:08.678666 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-048377f8-a7d7-4e31-9c40-02a06a141abd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:08.679123 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-048377f8-a7d7-4e31-9c40-02a06a141abd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:08.679897 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-048377f8-a7d7-4e31-9c40-02a06a141abd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:08.680337 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-048377f8-a7d7-4e31-9c40-02a06a141abd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:08.817044 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-048377f8-a7d7-4e31-9c40-02a06a141abd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:08.824525 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-048377f8-a7d7-4e31-9c40-02a06a141abd tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.156671 Apr 08 11:31:08.825101 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1243/2179] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:08 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:08.830066 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-08597f02-cdb4-4da2-b807-cbcd43613f31 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:08.830678 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-08597f02-cdb4-4da2-b807-cbcd43613f31 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:08.836203 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-08597f02-cdb4-4da2-b807-cbcd43613f31 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:08.836660 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-08597f02-cdb4-4da2-b807-cbcd43613f31 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:08.837431 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-08597f02-cdb4-4da2-b807-cbcd43613f31 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:08.837899 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-08597f02-cdb4-4da2-b807-cbcd43613f31 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:08.901344 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-08597f02-cdb4-4da2-b807-cbcd43613f31 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:08.908692 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-08597f02-cdb4-4da2-b807-cbcd43613f31 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082663 Apr 08 11:31:08.909256 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1244/2180] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:08 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:09.842274 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ea534337-7aed-4c27-a399-7e8e4f52d4b2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:09.843435 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ea534337-7aed-4c27-a399-7e8e4f52d4b2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:09.849484 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ea534337-7aed-4c27-a399-7e8e4f52d4b2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:09.849984 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ea534337-7aed-4c27-a399-7e8e4f52d4b2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:09.850766 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ea534337-7aed-4c27-a399-7e8e4f52d4b2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:09.851216 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ea534337-7aed-4c27-a399-7e8e4f52d4b2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:09.985919 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ea534337-7aed-4c27-a399-7e8e4f52d4b2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:09.993284 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ea534337-7aed-4c27-a399-7e8e4f52d4b2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.155036 Apr 08 11:31:09.994146 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1245/2181] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:09 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:09.998513 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-13fae57d-fc34-48ce-8100-b05b290bfcd1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:09.999120 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-13fae57d-fc34-48ce-8100-b05b290bfcd1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:10.005272 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-13fae57d-fc34-48ce-8100-b05b290bfcd1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:10.005728 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-13fae57d-fc34-48ce-8100-b05b290bfcd1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:10.006542 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-13fae57d-fc34-48ce-8100-b05b290bfcd1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:10.006982 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-13fae57d-fc34-48ce-8100-b05b290bfcd1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:10.073611 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-13fae57d-fc34-48ce-8100-b05b290bfcd1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:10.080970 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-13fae57d-fc34-48ce-8100-b05b290bfcd1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.085895 Apr 08 11:31:10.081542 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1246/2182] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:09 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:11.011120 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-aca47e77-87d3-4504-88a7-b97b02d3c199 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:11.011779 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-aca47e77-87d3-4504-88a7-b97b02d3c199 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:11.018595 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aca47e77-87d3-4504-88a7-b97b02d3c199 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:11.019046 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aca47e77-87d3-4504-88a7-b97b02d3c199 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:11.019816 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aca47e77-87d3-4504-88a7-b97b02d3c199 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:11.020258 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aca47e77-87d3-4504-88a7-b97b02d3c199 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:11.168942 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-aca47e77-87d3-4504-88a7-b97b02d3c199 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:11.176278 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-aca47e77-87d3-4504-88a7-b97b02d3c199 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.169115 Apr 08 11:31:11.176852 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1247/2183] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:11 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:11.181307 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4ca70b97-5a84-4bb2-b656-69102ac8dac0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:11.181967 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4ca70b97-5a84-4bb2-b656-69102ac8dac0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:11.187540 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4ca70b97-5a84-4bb2-b656-69102ac8dac0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:11.188510 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4ca70b97-5a84-4bb2-b656-69102ac8dac0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:11.189277 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4ca70b97-5a84-4bb2-b656-69102ac8dac0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:11.189730 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4ca70b97-5a84-4bb2-b656-69102ac8dac0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:11.249291 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4ca70b97-5a84-4bb2-b656-69102ac8dac0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:11.257338 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4ca70b97-5a84-4bb2-b656-69102ac8dac0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079552 Apr 08 11:31:11.257929 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1248/2184] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:11 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:12.192285 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ba5e4428-0456-4484-9283-d7367285f8a5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:12.192889 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ba5e4428-0456-4484-9283-d7367285f8a5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:12.199253 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ba5e4428-0456-4484-9283-d7367285f8a5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:12.199701 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ba5e4428-0456-4484-9283-d7367285f8a5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:12.200479 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ba5e4428-0456-4484-9283-d7367285f8a5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:12.200911 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ba5e4428-0456-4484-9283-d7367285f8a5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:12.335711 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ba5e4428-0456-4484-9283-d7367285f8a5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:12.343172 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ba5e4428-0456-4484-9283-d7367285f8a5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.154690 Apr 08 11:31:12.343743 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1249/2185] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:12 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:12.348742 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-65f3d7b4-25e9-4417-ab22-ae6b6969310e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:12.349349 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-65f3d7b4-25e9-4417-ab22-ae6b6969310e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:12.354971 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-65f3d7b4-25e9-4417-ab22-ae6b6969310e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:12.355425 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-65f3d7b4-25e9-4417-ab22-ae6b6969310e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:12.356195 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-65f3d7b4-25e9-4417-ab22-ae6b6969310e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:12.356637 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-65f3d7b4-25e9-4417-ab22-ae6b6969310e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:12.416017 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-65f3d7b4-25e9-4417-ab22-ae6b6969310e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:12.425359 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-65f3d7b4-25e9-4417-ab22-ae6b6969310e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080524 Apr 08 11:31:12.426322 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1250/2186] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:12 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:13.361067 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3521081f-73f1-4c67-8e23-72a5eeb5cbb0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:13.361794 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3521081f-73f1-4c67-8e23-72a5eeb5cbb0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:13.368624 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3521081f-73f1-4c67-8e23-72a5eeb5cbb0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:13.369328 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3521081f-73f1-4c67-8e23-72a5eeb5cbb0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:13.370132 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3521081f-73f1-4c67-8e23-72a5eeb5cbb0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:13.370573 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3521081f-73f1-4c67-8e23-72a5eeb5cbb0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:13.520598 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3521081f-73f1-4c67-8e23-72a5eeb5cbb0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:13.528021 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3521081f-73f1-4c67-8e23-72a5eeb5cbb0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.170935 Apr 08 11:31:13.528592 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1251/2187] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:13 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:13.532909 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-67f1434b-2405-42db-a738-dc0093f0d062 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:13.533512 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-67f1434b-2405-42db-a738-dc0093f0d062 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:13.539509 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-67f1434b-2405-42db-a738-dc0093f0d062 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:13.539985 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-67f1434b-2405-42db-a738-dc0093f0d062 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:13.540736 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-67f1434b-2405-42db-a738-dc0093f0d062 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:13.541176 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-67f1434b-2405-42db-a738-dc0093f0d062 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:13.601518 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-67f1434b-2405-42db-a738-dc0093f0d062 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:13.608862 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-67f1434b-2405-42db-a738-dc0093f0d062 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079335 Apr 08 11:31:13.609435 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1252/2188] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:13 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:14.546034 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6e001411-cea3-4102-ab60-5795e0539bac tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:14.546710 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6e001411-cea3-4102-ab60-5795e0539bac tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:14.553409 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6e001411-cea3-4102-ab60-5795e0539bac tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:14.553897 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6e001411-cea3-4102-ab60-5795e0539bac tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:14.554673 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6e001411-cea3-4102-ab60-5795e0539bac tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:14.555115 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6e001411-cea3-4102-ab60-5795e0539bac tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:14.693077 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6e001411-cea3-4102-ab60-5795e0539bac tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:14.700423 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6e001411-cea3-4102-ab60-5795e0539bac tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.158308 Apr 08 11:31:14.700982 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1253/2189] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:14 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:14.705369 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2d368ca2-cab7-4473-84c2-27761bcabca4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:14.705989 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2d368ca2-cab7-4473-84c2-27761bcabca4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:14.711541 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2d368ca2-cab7-4473-84c2-27761bcabca4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:14.711986 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2d368ca2-cab7-4473-84c2-27761bcabca4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:14.712737 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2d368ca2-cab7-4473-84c2-27761bcabca4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:14.713174 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2d368ca2-cab7-4473-84c2-27761bcabca4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:14.771549 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2d368ca2-cab7-4473-84c2-27761bcabca4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:14.778832 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2d368ca2-cab7-4473-84c2-27761bcabca4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.076918 Apr 08 11:31:14.779407 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1254/2190] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:14 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:15.717295 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-689c86d3-c483-4b98-914b-881f5d31cafb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:15.717997 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-689c86d3-c483-4b98-914b-881f5d31cafb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:15.724478 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-689c86d3-c483-4b98-914b-881f5d31cafb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:15.724923 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-689c86d3-c483-4b98-914b-881f5d31cafb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:15.728299 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-689c86d3-c483-4b98-914b-881f5d31cafb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:15.728733 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-689c86d3-c483-4b98-914b-881f5d31cafb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:15.865455 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-689c86d3-c483-4b98-914b-881f5d31cafb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:15.873108 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-689c86d3-c483-4b98-914b-881f5d31cafb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.159615 Apr 08 11:31:15.873674 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1255/2191] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:15 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:15.878545 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ed24e212-347c-45de-a256-42f32f972c25 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:15.879144 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ed24e212-347c-45de-a256-42f32f972c25 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:15.884685 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ed24e212-347c-45de-a256-42f32f972c25 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:15.885133 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ed24e212-347c-45de-a256-42f32f972c25 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:15.885937 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ed24e212-347c-45de-a256-42f32f972c25 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:15.886372 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ed24e212-347c-45de-a256-42f32f972c25 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:15.944921 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ed24e212-347c-45de-a256-42f32f972c25 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:15.952382 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ed24e212-347c-45de-a256-42f32f972c25 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077740 Apr 08 11:31:15.952950 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1256/2192] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:15 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:16.890863 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-203c3354-368f-47d2-b86d-147a620266e0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:16.891511 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-203c3354-368f-47d2-b86d-147a620266e0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:16.898685 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-203c3354-368f-47d2-b86d-147a620266e0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:16.899082 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-203c3354-368f-47d2-b86d-147a620266e0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:16.899858 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-203c3354-368f-47d2-b86d-147a620266e0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:16.900298 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-203c3354-368f-47d2-b86d-147a620266e0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:17.039026 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-203c3354-368f-47d2-b86d-147a620266e0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:17.046303 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-203c3354-368f-47d2-b86d-147a620266e0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.159564 Apr 08 11:31:17.046868 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1257/2193] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:16 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:17.051199 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e8b3e021-0c2b-4e1d-bbe8-db99fea5eabd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:17.051846 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e8b3e021-0c2b-4e1d-bbe8-db99fea5eabd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:17.057227 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e8b3e021-0c2b-4e1d-bbe8-db99fea5eabd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:17.057671 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e8b3e021-0c2b-4e1d-bbe8-db99fea5eabd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:17.058461 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e8b3e021-0c2b-4e1d-bbe8-db99fea5eabd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:17.058892 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e8b3e021-0c2b-4e1d-bbe8-db99fea5eabd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:17.117675 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e8b3e021-0c2b-4e1d-bbe8-db99fea5eabd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:17.125268 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e8b3e021-0c2b-4e1d-bbe8-db99fea5eabd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077430 Apr 08 11:31:17.125811 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1258/2194] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:17 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:18.063448 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e8b917f3-e395-4edc-9c9b-841b8d7e2045 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:18.064150 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e8b917f3-e395-4edc-9c9b-841b8d7e2045 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:18.071000 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e8b917f3-e395-4edc-9c9b-841b8d7e2045 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:18.071453 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e8b917f3-e395-4edc-9c9b-841b8d7e2045 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:18.072211 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e8b917f3-e395-4edc-9c9b-841b8d7e2045 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:18.072646 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e8b917f3-e395-4edc-9c9b-841b8d7e2045 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:18.208743 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e8b917f3-e395-4edc-9c9b-841b8d7e2045 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:18.216115 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e8b917f3-e395-4edc-9c9b-841b8d7e2045 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.156544 Apr 08 11:31:18.216677 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1259/2195] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:18 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:18.221001 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4754f3f4-3f01-4978-aafc-f43509ee436c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:18.221590 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4754f3f4-3f01-4978-aafc-f43509ee436c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:18.227375 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4754f3f4-3f01-4978-aafc-f43509ee436c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:18.227823 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4754f3f4-3f01-4978-aafc-f43509ee436c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:18.228584 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4754f3f4-3f01-4978-aafc-f43509ee436c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:18.229013 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4754f3f4-3f01-4978-aafc-f43509ee436c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:18.293429 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4754f3f4-3f01-4978-aafc-f43509ee436c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:18.301606 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4754f3f4-3f01-4978-aafc-f43509ee436c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.083984 Apr 08 11:31:18.302286 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1260/2196] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:18 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:19.233209 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b2e34952-e644-4169-be42-ddc1a8827c16 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:19.233883 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b2e34952-e644-4169-be42-ddc1a8827c16 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:19.240443 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b2e34952-e644-4169-be42-ddc1a8827c16 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:19.240902 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b2e34952-e644-4169-be42-ddc1a8827c16 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:19.241684 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b2e34952-e644-4169-be42-ddc1a8827c16 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:19.242152 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b2e34952-e644-4169-be42-ddc1a8827c16 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:19.376211 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b2e34952-e644-4169-be42-ddc1a8827c16 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:19.384034 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b2e34952-e644-4169-be42-ddc1a8827c16 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.154799 Apr 08 11:31:19.384603 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1261/2197] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:19 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:19.388907 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-005c9642-a330-4125-a814-36378d1dfcfd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:19.389511 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-005c9642-a330-4125-a814-36378d1dfcfd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:19.396050 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-005c9642-a330-4125-a814-36378d1dfcfd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:19.396510 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-005c9642-a330-4125-a814-36378d1dfcfd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:19.397297 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-005c9642-a330-4125-a814-36378d1dfcfd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:19.397743 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-005c9642-a330-4125-a814-36378d1dfcfd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:19.456881 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-005c9642-a330-4125-a814-36378d1dfcfd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:19.464131 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-005c9642-a330-4125-a814-36378d1dfcfd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078581 Apr 08 11:31:19.464706 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1262/2198] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:19 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:20.401086 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d4f87ef8-4115-45b4-8f69-371030510dd5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:20.401800 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d4f87ef8-4115-45b4-8f69-371030510dd5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:20.408005 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d4f87ef8-4115-45b4-8f69-371030510dd5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:20.408459 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d4f87ef8-4115-45b4-8f69-371030510dd5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:20.409259 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d4f87ef8-4115-45b4-8f69-371030510dd5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:20.409674 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d4f87ef8-4115-45b4-8f69-371030510dd5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:20.544958 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d4f87ef8-4115-45b4-8f69-371030510dd5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:20.552743 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d4f87ef8-4115-45b4-8f69-371030510dd5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.155517 Apr 08 11:31:20.553312 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1263/2199] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:20 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:20.557684 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0a198239-4055-446e-bd04-cd88d1374171 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:20.558345 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0a198239-4055-446e-bd04-cd88d1374171 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:20.563894 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0a198239-4055-446e-bd04-cd88d1374171 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:20.564318 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0a198239-4055-446e-bd04-cd88d1374171 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:20.565079 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0a198239-4055-446e-bd04-cd88d1374171 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:20.565512 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0a198239-4055-446e-bd04-cd88d1374171 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:20.623734 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0a198239-4055-446e-bd04-cd88d1374171 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:20.631673 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0a198239-4055-446e-bd04-cd88d1374171 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077398 Apr 08 11:31:20.632243 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1264/2200] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:20 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:21.570206 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-51270619-5f90-4e6c-8502-24aedcee7960 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:21.570857 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-51270619-5f90-4e6c-8502-24aedcee7960 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:21.577084 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-51270619-5f90-4e6c-8502-24aedcee7960 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:21.577530 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-51270619-5f90-4e6c-8502-24aedcee7960 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:21.578318 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-51270619-5f90-4e6c-8502-24aedcee7960 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:21.578748 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-51270619-5f90-4e6c-8502-24aedcee7960 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:21.715154 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-51270619-5f90-4e6c-8502-24aedcee7960 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:21.722428 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-51270619-5f90-4e6c-8502-24aedcee7960 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.156621 Apr 08 11:31:21.723026 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1265/2201] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:21 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:21.728430 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1a396d07-297e-4d19-a38e-ff4f128ec0b4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:21.729026 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1a396d07-297e-4d19-a38e-ff4f128ec0b4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:21.734574 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1a396d07-297e-4d19-a38e-ff4f128ec0b4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:21.735018 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1a396d07-297e-4d19-a38e-ff4f128ec0b4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:21.735772 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1a396d07-297e-4d19-a38e-ff4f128ec0b4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:21.736208 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1a396d07-297e-4d19-a38e-ff4f128ec0b4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:21.797853 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1a396d07-297e-4d19-a38e-ff4f128ec0b4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:21.805232 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1a396d07-297e-4d19-a38e-ff4f128ec0b4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081274 Apr 08 11:31:21.805820 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1266/2202] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:21 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:22.739526 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c8d0a873-52fb-4c68-ac3b-c1e6f780db30 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:22.740219 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c8d0a873-52fb-4c68-ac3b-c1e6f780db30 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:22.746804 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c8d0a873-52fb-4c68-ac3b-c1e6f780db30 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:22.747262 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c8d0a873-52fb-4c68-ac3b-c1e6f780db30 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:22.748035 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c8d0a873-52fb-4c68-ac3b-c1e6f780db30 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:22.748476 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c8d0a873-52fb-4c68-ac3b-c1e6f780db30 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:22.879870 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c8d0a873-52fb-4c68-ac3b-c1e6f780db30 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:22.887225 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c8d0a873-52fb-4c68-ac3b-c1e6f780db30 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.151572 Apr 08 11:31:22.887796 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1267/2203] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:22 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:22.892133 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d7397bde-c591-4e31-ba89-605256dd663f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:22.892737 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d7397bde-c591-4e31-ba89-605256dd663f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:22.898976 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d7397bde-c591-4e31-ba89-605256dd663f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:22.899373 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d7397bde-c591-4e31-ba89-605256dd663f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:22.900140 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d7397bde-c591-4e31-ba89-605256dd663f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:22.900585 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d7397bde-c591-4e31-ba89-605256dd663f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:22.961218 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d7397bde-c591-4e31-ba89-605256dd663f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:22.968791 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d7397bde-c591-4e31-ba89-605256dd663f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080043 Apr 08 11:31:22.969378 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1268/2204] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:22 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:23.904625 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-969eb6bb-673c-4bb5-95f4-8c7d595c7bb8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:23.905277 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-969eb6bb-673c-4bb5-95f4-8c7d595c7bb8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:23.912062 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-969eb6bb-673c-4bb5-95f4-8c7d595c7bb8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:23.912516 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-969eb6bb-673c-4bb5-95f4-8c7d595c7bb8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:23.913294 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-969eb6bb-673c-4bb5-95f4-8c7d595c7bb8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:23.913733 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-969eb6bb-673c-4bb5-95f4-8c7d595c7bb8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:24.048539 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-969eb6bb-673c-4bb5-95f4-8c7d595c7bb8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:24.056557 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-969eb6bb-673c-4bb5-95f4-8c7d595c7bb8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.155859 Apr 08 11:31:24.057195 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1269/2205] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:23 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:24.061665 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-189290fc-0a56-4a5e-9ca5-822c9955ea80 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:24.062324 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-189290fc-0a56-4a5e-9ca5-822c9955ea80 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:24.067793 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-189290fc-0a56-4a5e-9ca5-822c9955ea80 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:24.068256 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-189290fc-0a56-4a5e-9ca5-822c9955ea80 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:24.068995 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-189290fc-0a56-4a5e-9ca5-822c9955ea80 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:24.069434 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-189290fc-0a56-4a5e-9ca5-822c9955ea80 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:24.130998 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-189290fc-0a56-4a5e-9ca5-822c9955ea80 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:24.138451 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-189290fc-0a56-4a5e-9ca5-822c9955ea80 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080329 Apr 08 11:31:24.139020 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1270/2206] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:24 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:25.073923 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0f2c1125-b416-488d-afa2-25d3e2760673 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:25.074578 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0f2c1125-b416-488d-afa2-25d3e2760673 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:25.080861 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0f2c1125-b416-488d-afa2-25d3e2760673 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:25.081315 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0f2c1125-b416-488d-afa2-25d3e2760673 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:25.082122 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0f2c1125-b416-488d-afa2-25d3e2760673 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:25.082562 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0f2c1125-b416-488d-afa2-25d3e2760673 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:25.221778 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0f2c1125-b416-488d-afa2-25d3e2760673 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:25.229929 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0f2c1125-b416-488d-afa2-25d3e2760673 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.159799 Apr 08 11:31:25.230525 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1271/2207] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:25 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:25.235068 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e13f1745-9283-4443-b4e3-522be7600f7d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:25.235674 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e13f1745-9283-4443-b4e3-522be7600f7d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:25.242323 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e13f1745-9283-4443-b4e3-522be7600f7d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:25.242775 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e13f1745-9283-4443-b4e3-522be7600f7d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:25.243553 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e13f1745-9283-4443-b4e3-522be7600f7d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:25.244291 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e13f1745-9283-4443-b4e3-522be7600f7d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:25.302178 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e13f1745-9283-4443-b4e3-522be7600f7d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:25.309604 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e13f1745-9283-4443-b4e3-522be7600f7d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078138 Apr 08 11:31:25.310207 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1272/2208] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:25 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:26.248106 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3ea81c58-0d00-4208-a3e8-834f72bd2423 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:26.248743 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3ea81c58-0d00-4208-a3e8-834f72bd2423 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:26.255412 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3ea81c58-0d00-4208-a3e8-834f72bd2423 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:26.255862 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3ea81c58-0d00-4208-a3e8-834f72bd2423 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:26.256613 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3ea81c58-0d00-4208-a3e8-834f72bd2423 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:26.257046 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3ea81c58-0d00-4208-a3e8-834f72bd2423 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:26.393993 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3ea81c58-0d00-4208-a3e8-834f72bd2423 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:26.401375 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3ea81c58-0d00-4208-a3e8-834f72bd2423 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.157373 Apr 08 11:31:26.401975 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1273/2209] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:26 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:26.406289 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d03f3b74-7f06-4ac0-80a6-0d6b8686bb19 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:26.406893 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d03f3b74-7f06-4ac0-80a6-0d6b8686bb19 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:26.412334 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d03f3b74-7f06-4ac0-80a6-0d6b8686bb19 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:26.412784 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d03f3b74-7f06-4ac0-80a6-0d6b8686bb19 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:26.413542 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d03f3b74-7f06-4ac0-80a6-0d6b8686bb19 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:26.414009 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d03f3b74-7f06-4ac0-80a6-0d6b8686bb19 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:26.481184 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d03f3b74-7f06-4ac0-80a6-0d6b8686bb19 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:26.491039 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d03f3b74-7f06-4ac0-80a6-0d6b8686bb19 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.088087 Apr 08 11:31:26.491608 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1274/2210] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:26 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:27.418695 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e16db844-49ba-40ad-9dd2-b4fb605e355b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:27.419351 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e16db844-49ba-40ad-9dd2-b4fb605e355b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:27.425860 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e16db844-49ba-40ad-9dd2-b4fb605e355b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:27.426319 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e16db844-49ba-40ad-9dd2-b4fb605e355b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:27.427095 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e16db844-49ba-40ad-9dd2-b4fb605e355b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:27.427542 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e16db844-49ba-40ad-9dd2-b4fb605e355b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:27.561508 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e16db844-49ba-40ad-9dd2-b4fb605e355b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:27.569487 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e16db844-49ba-40ad-9dd2-b4fb605e355b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.154735 Apr 08 11:31:27.570095 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1275/2211] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:27 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:27.574620 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-959f344d-3360-4e15-9587-9bf0bbbba966 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:27.575225 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-959f344d-3360-4e15-9587-9bf0bbbba966 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:27.581099 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-959f344d-3360-4e15-9587-9bf0bbbba966 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:27.590154 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-959f344d-3360-4e15-9587-9bf0bbbba966 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:27.590154 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-959f344d-3360-4e15-9587-9bf0bbbba966 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:27.590154 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-959f344d-3360-4e15-9587-9bf0bbbba966 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:27.641534 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-959f344d-3360-4e15-9587-9bf0bbbba966 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:27.649654 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-959f344d-3360-4e15-9587-9bf0bbbba966 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078541 Apr 08 11:31:27.650272 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1276/2212] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:27 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:28.587567 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-75ff0331-2e90-49e4-ab0d-445839515f2a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:28.588223 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-75ff0331-2e90-49e4-ab0d-445839515f2a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:28.594556 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-75ff0331-2e90-49e4-ab0d-445839515f2a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:28.595009 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-75ff0331-2e90-49e4-ab0d-445839515f2a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:28.595773 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-75ff0331-2e90-49e4-ab0d-445839515f2a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:28.596223 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-75ff0331-2e90-49e4-ab0d-445839515f2a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:28.733423 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-75ff0331-2e90-49e4-ab0d-445839515f2a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:28.741120 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-75ff0331-2e90-49e4-ab0d-445839515f2a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.157509 Apr 08 11:31:28.741691 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1277/2213] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:28 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:28.746422 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-971f99d5-4068-4ee5-ac48-f32dc707851b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:28.747046 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-971f99d5-4068-4ee5-ac48-f32dc707851b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:28.752537 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-971f99d5-4068-4ee5-ac48-f32dc707851b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:28.752999 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-971f99d5-4068-4ee5-ac48-f32dc707851b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:28.759161 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-971f99d5-4068-4ee5-ac48-f32dc707851b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:28.759161 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-971f99d5-4068-4ee5-ac48-f32dc707851b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:28.813505 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-971f99d5-4068-4ee5-ac48-f32dc707851b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:28.821142 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-971f99d5-4068-4ee5-ac48-f32dc707851b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078427 Apr 08 11:31:28.821718 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1278/2214] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:28 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:29.759718 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ff9977b6-dc9e-4b41-ac58-ee5ed4292f3f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:29.760436 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ff9977b6-dc9e-4b41-ac58-ee5ed4292f3f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:29.766742 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ff9977b6-dc9e-4b41-ac58-ee5ed4292f3f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:29.767196 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ff9977b6-dc9e-4b41-ac58-ee5ed4292f3f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:29.767972 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ff9977b6-dc9e-4b41-ac58-ee5ed4292f3f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:29.768415 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ff9977b6-dc9e-4b41-ac58-ee5ed4292f3f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:29.926953 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ff9977b6-dc9e-4b41-ac58-ee5ed4292f3f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:29.934146 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ff9977b6-dc9e-4b41-ac58-ee5ed4292f3f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.180301 Apr 08 11:31:29.934717 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1279/2215] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:29 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:29.939189 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bfcf9375-8be0-42c2-b149-381a19352263 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:29.939792 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-bfcf9375-8be0-42c2-b149-381a19352263 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:29.945708 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bfcf9375-8be0-42c2-b149-381a19352263 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:29.946186 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bfcf9375-8be0-42c2-b149-381a19352263 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:29.946946 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bfcf9375-8be0-42c2-b149-381a19352263 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:29.947409 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bfcf9375-8be0-42c2-b149-381a19352263 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:30.009397 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-bfcf9375-8be0-42c2-b149-381a19352263 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:30.014049 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-bfcf9375-8be0-42c2-b149-381a19352263 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078379 Apr 08 11:31:30.014621 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1280/2216] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:29 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:30.951375 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-10fa544c-d19d-437b-9edc-188369ecaceb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:30.952021 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-10fa544c-d19d-437b-9edc-188369ecaceb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:30.958247 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-10fa544c-d19d-437b-9edc-188369ecaceb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:30.958697 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-10fa544c-d19d-437b-9edc-188369ecaceb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:30.959468 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-10fa544c-d19d-437b-9edc-188369ecaceb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:30.959902 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-10fa544c-d19d-437b-9edc-188369ecaceb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:31.092370 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-10fa544c-d19d-437b-9edc-188369ecaceb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:31.099829 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-10fa544c-d19d-437b-9edc-188369ecaceb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.152371 Apr 08 11:31:31.100407 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1281/2217] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:30 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:31.104958 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d4c4818e-3af2-445d-bd3b-caaeb08424b0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:31.105559 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d4c4818e-3af2-445d-bd3b-caaeb08424b0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:31.111296 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d4c4818e-3af2-445d-bd3b-caaeb08424b0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:31.111852 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d4c4818e-3af2-445d-bd3b-caaeb08424b0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:31.112528 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d4c4818e-3af2-445d-bd3b-caaeb08424b0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:31.112973 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d4c4818e-3af2-445d-bd3b-caaeb08424b0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:31.178361 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d4c4818e-3af2-445d-bd3b-caaeb08424b0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:31.185635 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d4c4818e-3af2-445d-bd3b-caaeb08424b0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.084269 Apr 08 11:31:31.186250 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1282/2218] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:31 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:32.116712 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2dc56b38-4810-4cb2-be89-a5624ba5ab2d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:32.117426 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2dc56b38-4810-4cb2-be89-a5624ba5ab2d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:32.124069 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2dc56b38-4810-4cb2-be89-a5624ba5ab2d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:32.124518 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2dc56b38-4810-4cb2-be89-a5624ba5ab2d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:32.125305 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2dc56b38-4810-4cb2-be89-a5624ba5ab2d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:32.125741 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2dc56b38-4810-4cb2-be89-a5624ba5ab2d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:32.262618 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2dc56b38-4810-4cb2-be89-a5624ba5ab2d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:32.270685 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2dc56b38-4810-4cb2-be89-a5624ba5ab2d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.157102 Apr 08 11:31:32.271260 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1283/2219] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:32 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:32.275580 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-cb72f40a-b9bd-4788-a636-5dc026725a6c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:32.276189 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-cb72f40a-b9bd-4788-a636-5dc026725a6c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:32.281748 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cb72f40a-b9bd-4788-a636-5dc026725a6c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:32.282224 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cb72f40a-b9bd-4788-a636-5dc026725a6c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:32.282985 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cb72f40a-b9bd-4788-a636-5dc026725a6c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:32.283455 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cb72f40a-b9bd-4788-a636-5dc026725a6c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:32.342303 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-cb72f40a-b9bd-4788-a636-5dc026725a6c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:32.350098 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-cb72f40a-b9bd-4788-a636-5dc026725a6c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077724 Apr 08 11:31:32.350707 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1284/2220] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:32 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:33.288763 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-51f5706e-5111-4f56-a7c6-075c2a3252c1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:33.289494 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-51f5706e-5111-4f56-a7c6-075c2a3252c1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:33.295758 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-51f5706e-5111-4f56-a7c6-075c2a3252c1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:33.296210 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-51f5706e-5111-4f56-a7c6-075c2a3252c1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:33.296976 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-51f5706e-5111-4f56-a7c6-075c2a3252c1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:33.297416 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-51f5706e-5111-4f56-a7c6-075c2a3252c1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:33.435554 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-51f5706e-5111-4f56-a7c6-075c2a3252c1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:33.443418 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-51f5706e-5111-4f56-a7c6-075c2a3252c1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.159145 Apr 08 11:31:33.444157 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1285/2221] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:33 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:33.448705 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-62f88dc3-890b-4601-a635-c314ef8db2e1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:33.449302 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-62f88dc3-890b-4601-a635-c314ef8db2e1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:33.454785 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-62f88dc3-890b-4601-a635-c314ef8db2e1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:33.455237 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-62f88dc3-890b-4601-a635-c314ef8db2e1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:33.456000 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-62f88dc3-890b-4601-a635-c314ef8db2e1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:33.456434 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-62f88dc3-890b-4601-a635-c314ef8db2e1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:33.517277 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-62f88dc3-890b-4601-a635-c314ef8db2e1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:33.525200 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-62f88dc3-890b-4601-a635-c314ef8db2e1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079973 Apr 08 11:31:33.525784 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1286/2222] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:33 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:34.460736 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e2039dcc-3239-4023-8639-81c6827d20c8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:34.461392 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e2039dcc-3239-4023-8639-81c6827d20c8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:34.467587 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e2039dcc-3239-4023-8639-81c6827d20c8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:34.468039 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e2039dcc-3239-4023-8639-81c6827d20c8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:34.468811 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e2039dcc-3239-4023-8639-81c6827d20c8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:34.469252 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e2039dcc-3239-4023-8639-81c6827d20c8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:34.601072 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e2039dcc-3239-4023-8639-81c6827d20c8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:34.608455 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e2039dcc-3239-4023-8639-81c6827d20c8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.151702 Apr 08 11:31:34.609028 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1287/2223] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:34 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:34.613414 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-218066f4-a2f3-431a-9177-a24da4dae0ad tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:34.614049 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-218066f4-a2f3-431a-9177-a24da4dae0ad tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:34.619692 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-218066f4-a2f3-431a-9177-a24da4dae0ad tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:34.620125 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-218066f4-a2f3-431a-9177-a24da4dae0ad tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:34.620903 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-218066f4-a2f3-431a-9177-a24da4dae0ad tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:34.621342 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-218066f4-a2f3-431a-9177-a24da4dae0ad tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:34.683712 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-218066f4-a2f3-431a-9177-a24da4dae0ad tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:34.691128 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-218066f4-a2f3-431a-9177-a24da4dae0ad tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081136 Apr 08 11:31:34.691690 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1288/2224] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:34 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:35.624793 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f010764c-3a22-4bb2-ab32-f07c3bf2f8a4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:35.625497 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f010764c-3a22-4bb2-ab32-f07c3bf2f8a4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:35.632935 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f010764c-3a22-4bb2-ab32-f07c3bf2f8a4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:35.633399 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f010764c-3a22-4bb2-ab32-f07c3bf2f8a4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:35.634224 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f010764c-3a22-4bb2-ab32-f07c3bf2f8a4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:35.634673 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f010764c-3a22-4bb2-ab32-f07c3bf2f8a4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:35.773129 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f010764c-3a22-4bb2-ab32-f07c3bf2f8a4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:35.780616 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f010764c-3a22-4bb2-ab32-f07c3bf2f8a4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.159753 Apr 08 11:31:35.781184 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1289/2225] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:35 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:35.786082 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0d4c507d-41cf-4b43-bd37-22f9de3dba98 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:35.786691 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0d4c507d-41cf-4b43-bd37-22f9de3dba98 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:35.792597 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0d4c507d-41cf-4b43-bd37-22f9de3dba98 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:35.793051 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0d4c507d-41cf-4b43-bd37-22f9de3dba98 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:35.793845 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0d4c507d-41cf-4b43-bd37-22f9de3dba98 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:35.794285 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0d4c507d-41cf-4b43-bd37-22f9de3dba98 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:35.855328 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0d4c507d-41cf-4b43-bd37-22f9de3dba98 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:35.862696 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0d4c507d-41cf-4b43-bd37-22f9de3dba98 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080578 Apr 08 11:31:35.863274 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1290/2226] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:35 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:36.798101 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-18af0ad4-eb29-4c74-93ac-2cfeb398c5e8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:36.798776 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-18af0ad4-eb29-4c74-93ac-2cfeb398c5e8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:36.805092 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-18af0ad4-eb29-4c74-93ac-2cfeb398c5e8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:36.805549 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-18af0ad4-eb29-4c74-93ac-2cfeb398c5e8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:36.806353 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-18af0ad4-eb29-4c74-93ac-2cfeb398c5e8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:36.806797 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-18af0ad4-eb29-4c74-93ac-2cfeb398c5e8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:36.941407 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-18af0ad4-eb29-4c74-93ac-2cfeb398c5e8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:36.948802 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-18af0ad4-eb29-4c74-93ac-2cfeb398c5e8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.154605 Apr 08 11:31:36.949375 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1291/2227] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:36 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:36.953682 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b6c83b55-c80e-4964-bc53-d0a1e1275412 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:36.954312 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b6c83b55-c80e-4964-bc53-d0a1e1275412 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:36.960212 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b6c83b55-c80e-4964-bc53-d0a1e1275412 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:36.960656 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b6c83b55-c80e-4964-bc53-d0a1e1275412 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:36.961417 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b6c83b55-c80e-4964-bc53-d0a1e1275412 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:36.961878 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b6c83b55-c80e-4964-bc53-d0a1e1275412 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:37.020387 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b6c83b55-c80e-4964-bc53-d0a1e1275412 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:37.027745 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b6c83b55-c80e-4964-bc53-d0a1e1275412 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077420 Apr 08 11:31:37.028315 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1292/2228] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:36 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:37.966431 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d0a775ec-ef28-46af-aa0f-08c4888ef34f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:37.967224 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d0a775ec-ef28-46af-aa0f-08c4888ef34f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:37.974278 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d0a775ec-ef28-46af-aa0f-08c4888ef34f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:37.974739 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d0a775ec-ef28-46af-aa0f-08c4888ef34f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:37.975532 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d0a775ec-ef28-46af-aa0f-08c4888ef34f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:37.975976 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d0a775ec-ef28-46af-aa0f-08c4888ef34f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:38.092694 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 11:31:38.092922 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:31:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 (ip 10.222.0.46) !!! Apr 08 11:31:38.123211 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d0a775ec-ef28-46af-aa0f-08c4888ef34f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:38.131222 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d0a775ec-ef28-46af-aa0f-08c4888ef34f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.168731 Apr 08 11:31:38.138462 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1293/2229] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:37 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:38.138462 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1ceb0a07-421a-4e71-92de-ad1429f2ec56 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:38.138462 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1ceb0a07-421a-4e71-92de-ad1429f2ec56 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:38.143320 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ceb0a07-421a-4e71-92de-ad1429f2ec56 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:38.143766 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ceb0a07-421a-4e71-92de-ad1429f2ec56 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:38.144671 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ceb0a07-421a-4e71-92de-ad1429f2ec56 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:38.145114 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ceb0a07-421a-4e71-92de-ad1429f2ec56 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:38.207544 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1ceb0a07-421a-4e71-92de-ad1429f2ec56 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:38.214905 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1ceb0a07-421a-4e71-92de-ad1429f2ec56 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082096 Apr 08 11:31:38.215489 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1294/2230] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:38 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:39.148748 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2e5ae8a7-2421-466d-8d76-beb0116fb5db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:39.149432 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2e5ae8a7-2421-466d-8d76-beb0116fb5db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:39.155624 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2e5ae8a7-2421-466d-8d76-beb0116fb5db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:39.156067 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2e5ae8a7-2421-466d-8d76-beb0116fb5db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:39.156818 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2e5ae8a7-2421-466d-8d76-beb0116fb5db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:39.157250 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2e5ae8a7-2421-466d-8d76-beb0116fb5db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:39.297501 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2e5ae8a7-2421-466d-8d76-beb0116fb5db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:39.305341 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2e5ae8a7-2421-466d-8d76-beb0116fb5db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.160771 Apr 08 11:31:39.305935 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1295/2231] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:39 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:39.310276 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e3e7eab6-4285-460d-a697-0264ec8aa32b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:39.310877 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e3e7eab6-4285-460d-a697-0264ec8aa32b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:39.316375 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e3e7eab6-4285-460d-a697-0264ec8aa32b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:39.317458 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e3e7eab6-4285-460d-a697-0264ec8aa32b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:39.318244 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e3e7eab6-4285-460d-a697-0264ec8aa32b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:39.318682 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e3e7eab6-4285-460d-a697-0264ec8aa32b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:39.376634 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e3e7eab6-4285-460d-a697-0264ec8aa32b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:39.384599 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e3e7eab6-4285-460d-a697-0264ec8aa32b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077728 Apr 08 11:31:39.385169 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1296/2232] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:39 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:40.322567 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ea0b5cc7-e9f1-4adf-b242-46866537b9ff tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:40.323239 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ea0b5cc7-e9f1-4adf-b242-46866537b9ff tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:40.329453 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ea0b5cc7-e9f1-4adf-b242-46866537b9ff tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:40.329938 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ea0b5cc7-e9f1-4adf-b242-46866537b9ff tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:40.330706 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ea0b5cc7-e9f1-4adf-b242-46866537b9ff tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:40.331146 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ea0b5cc7-e9f1-4adf-b242-46866537b9ff tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:40.467427 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ea0b5cc7-e9f1-4adf-b242-46866537b9ff tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:40.475839 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ea0b5cc7-e9f1-4adf-b242-46866537b9ff tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.157101 Apr 08 11:31:40.476413 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1297/2233] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:40 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:40.480956 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-beff1494-3e0c-44c7-bc3c-c67e52d7c8fb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:40.481562 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-beff1494-3e0c-44c7-bc3c-c67e52d7c8fb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:40.487012 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-beff1494-3e0c-44c7-bc3c-c67e52d7c8fb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:40.487463 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-beff1494-3e0c-44c7-bc3c-c67e52d7c8fb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:40.488229 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-beff1494-3e0c-44c7-bc3c-c67e52d7c8fb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:40.488735 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-beff1494-3e0c-44c7-bc3c-c67e52d7c8fb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:40.546583 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-beff1494-3e0c-44c7-bc3c-c67e52d7c8fb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:40.554071 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-beff1494-3e0c-44c7-bc3c-c67e52d7c8fb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.076654 Apr 08 11:31:40.554653 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1298/2234] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:40 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:41.493259 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-79370bc6-8f0f-4f85-80ea-27004660ae69 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:41.493982 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-79370bc6-8f0f-4f85-80ea-27004660ae69 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:41.501066 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-79370bc6-8f0f-4f85-80ea-27004660ae69 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:41.501946 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-79370bc6-8f0f-4f85-80ea-27004660ae69 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:41.503087 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-79370bc6-8f0f-4f85-80ea-27004660ae69 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:41.503542 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-79370bc6-8f0f-4f85-80ea-27004660ae69 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:41.642514 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-79370bc6-8f0f-4f85-80ea-27004660ae69 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:41.651022 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-79370bc6-8f0f-4f85-80ea-27004660ae69 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.161958 Apr 08 11:31:41.651592 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1299/2235] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:41 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:41.783401 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e938adcf-8027-4b13-94e7-e5d237be70a0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:41.784020 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e938adcf-8027-4b13-94e7-e5d237be70a0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:41.790494 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e938adcf-8027-4b13-94e7-e5d237be70a0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:41.790950 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e938adcf-8027-4b13-94e7-e5d237be70a0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:41.791729 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e938adcf-8027-4b13-94e7-e5d237be70a0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:41.792174 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e938adcf-8027-4b13-94e7-e5d237be70a0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:41.851348 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e938adcf-8027-4b13-94e7-e5d237be70a0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:41.858826 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e938adcf-8027-4b13-94e7-e5d237be70a0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.206257 Apr 08 11:31:41.859488 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1300/2236] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:41 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:42.668192 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-11af202e-6b06-40f7-8613-bef4c03467be tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:42.668821 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-11af202e-6b06-40f7-8613-bef4c03467be tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:42.675129 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-11af202e-6b06-40f7-8613-bef4c03467be tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:42.675584 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-11af202e-6b06-40f7-8613-bef4c03467be tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:42.676378 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-11af202e-6b06-40f7-8613-bef4c03467be tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:42.676818 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-11af202e-6b06-40f7-8613-bef4c03467be tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:42.827596 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-11af202e-6b06-40f7-8613-bef4c03467be tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:42.835777 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-11af202e-6b06-40f7-8613-bef4c03467be tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.171594 Apr 08 11:31:42.836364 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1301/2237] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:42 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:42.880806 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-431472b3-db2c-42e7-9bbc-34b695fe320e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:42.881414 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-431472b3-db2c-42e7-9bbc-34b695fe320e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:42.887231 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-431472b3-db2c-42e7-9bbc-34b695fe320e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:42.887684 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-431472b3-db2c-42e7-9bbc-34b695fe320e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:42.888455 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-431472b3-db2c-42e7-9bbc-34b695fe320e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:42.888897 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-431472b3-db2c-42e7-9bbc-34b695fe320e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:42.947391 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-431472b3-db2c-42e7-9bbc-34b695fe320e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:42.954676 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-431472b3-db2c-42e7-9bbc-34b695fe320e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078254 Apr 08 11:31:42.955242 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1302/2238] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:42 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:43.853105 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-05f08649-e48e-4014-a0a1-1350ac43156f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:43.853812 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-05f08649-e48e-4014-a0a1-1350ac43156f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:43.860031 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-05f08649-e48e-4014-a0a1-1350ac43156f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:43.860459 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-05f08649-e48e-4014-a0a1-1350ac43156f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:43.867151 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-05f08649-e48e-4014-a0a1-1350ac43156f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:43.867691 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-05f08649-e48e-4014-a0a1-1350ac43156f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:44.017825 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-05f08649-e48e-4014-a0a1-1350ac43156f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:44.025336 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-05f08649-e48e-4014-a0a1-1350ac43156f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.176375 Apr 08 11:31:44.025963 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1303/2239] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:43 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:44.030312 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e4501809-892f-4528-b852-b5eca70aa4f5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:44.030910 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e4501809-892f-4528-b852-b5eca70aa4f5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:44.036349 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e4501809-892f-4528-b852-b5eca70aa4f5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:44.037314 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e4501809-892f-4528-b852-b5eca70aa4f5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:44.038106 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e4501809-892f-4528-b852-b5eca70aa4f5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:44.038553 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e4501809-892f-4528-b852-b5eca70aa4f5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:44.099108 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e4501809-892f-4528-b852-b5eca70aa4f5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:44.107064 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e4501809-892f-4528-b852-b5eca70aa4f5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080158 Apr 08 11:31:44.107642 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1304/2240] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:44 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:45.042269 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-460d905a-519e-4d2b-81ff-03563669703b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:45.042943 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-460d905a-519e-4d2b-81ff-03563669703b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:45.049385 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-460d905a-519e-4d2b-81ff-03563669703b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:45.049862 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-460d905a-519e-4d2b-81ff-03563669703b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:45.050641 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-460d905a-519e-4d2b-81ff-03563669703b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:45.051049 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-460d905a-519e-4d2b-81ff-03563669703b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:45.185938 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-460d905a-519e-4d2b-81ff-03563669703b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:45.194302 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-460d905a-519e-4d2b-81ff-03563669703b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.155882 Apr 08 11:31:45.194867 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1305/2241] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:45 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:45.199303 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-af740036-d48b-4a24-a527-3c0505566f57 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:45.199907 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-af740036-d48b-4a24-a527-3c0505566f57 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:45.205359 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-af740036-d48b-4a24-a527-3c0505566f57 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:45.205854 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-af740036-d48b-4a24-a527-3c0505566f57 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:45.206628 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-af740036-d48b-4a24-a527-3c0505566f57 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:45.207071 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-af740036-d48b-4a24-a527-3c0505566f57 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:45.265572 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-af740036-d48b-4a24-a527-3c0505566f57 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:45.273484 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-af740036-d48b-4a24-a527-3c0505566f57 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077673 Apr 08 11:31:45.274091 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1306/2242] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:45 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:46.212178 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5d25d256-f150-4432-87a2-bf9b683d49d0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:46.212786 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5d25d256-f150-4432-87a2-bf9b683d49d0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:46.219186 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5d25d256-f150-4432-87a2-bf9b683d49d0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:46.219639 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5d25d256-f150-4432-87a2-bf9b683d49d0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:46.220574 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5d25d256-f150-4432-87a2-bf9b683d49d0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:46.221018 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5d25d256-f150-4432-87a2-bf9b683d49d0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:46.359974 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5d25d256-f150-4432-87a2-bf9b683d49d0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:46.367745 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5d25d256-f150-4432-87a2-bf9b683d49d0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.160208 Apr 08 11:31:46.368330 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1307/2243] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:46 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:46.373043 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-45ae9e27-a449-4d23-89c5-daad557f8d55 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:46.373684 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-45ae9e27-a449-4d23-89c5-daad557f8d55 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:46.379451 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-45ae9e27-a449-4d23-89c5-daad557f8d55 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:46.379911 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-45ae9e27-a449-4d23-89c5-daad557f8d55 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:46.381184 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-45ae9e27-a449-4d23-89c5-daad557f8d55 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:46.381632 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-45ae9e27-a449-4d23-89c5-daad557f8d55 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:46.440199 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-45ae9e27-a449-4d23-89c5-daad557f8d55 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:46.448189 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-45ae9e27-a449-4d23-89c5-daad557f8d55 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078833 Apr 08 11:31:46.448699 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1308/2244] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:46 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:47.384920 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-422874bc-b03c-4cb0-a672-7952cf839509 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:47.385612 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-422874bc-b03c-4cb0-a672-7952cf839509 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:47.391901 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-422874bc-b03c-4cb0-a672-7952cf839509 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:47.392352 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-422874bc-b03c-4cb0-a672-7952cf839509 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:47.393123 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-422874bc-b03c-4cb0-a672-7952cf839509 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:47.393562 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-422874bc-b03c-4cb0-a672-7952cf839509 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:47.525424 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-422874bc-b03c-4cb0-a672-7952cf839509 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:47.532794 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-422874bc-b03c-4cb0-a672-7952cf839509 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.151752 Apr 08 11:31:47.533364 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1309/2245] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:47 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:47.538445 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a90e87f2-7398-48cc-aa0e-c0da9917e66c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:47.539054 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a90e87f2-7398-48cc-aa0e-c0da9917e66c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:47.544482 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a90e87f2-7398-48cc-aa0e-c0da9917e66c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:47.544935 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a90e87f2-7398-48cc-aa0e-c0da9917e66c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:47.545698 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a90e87f2-7398-48cc-aa0e-c0da9917e66c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:47.546166 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a90e87f2-7398-48cc-aa0e-c0da9917e66c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:47.609043 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a90e87f2-7398-48cc-aa0e-c0da9917e66c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:47.616751 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a90e87f2-7398-48cc-aa0e-c0da9917e66c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082419 Apr 08 11:31:47.617315 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1310/2246] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:47 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:48.550290 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-cef81d9d-f940-49af-983b-abe2ffc47f65 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:48.551003 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-cef81d9d-f940-49af-983b-abe2ffc47f65 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:48.557900 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cef81d9d-f940-49af-983b-abe2ffc47f65 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:48.558274 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cef81d9d-f940-49af-983b-abe2ffc47f65 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:48.559024 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cef81d9d-f940-49af-983b-abe2ffc47f65 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:48.559457 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cef81d9d-f940-49af-983b-abe2ffc47f65 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:48.692906 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-cef81d9d-f940-49af-983b-abe2ffc47f65 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:48.700348 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-cef81d9d-f940-49af-983b-abe2ffc47f65 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.153924 Apr 08 11:31:48.700926 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1311/2247] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:48 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:48.705374 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-27ad88d2-c9ab-4f3e-a9ec-450624c66de4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:48.706073 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-27ad88d2-c9ab-4f3e-a9ec-450624c66de4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:48.711663 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-27ad88d2-c9ab-4f3e-a9ec-450624c66de4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:48.712117 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-27ad88d2-c9ab-4f3e-a9ec-450624c66de4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:48.712887 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-27ad88d2-c9ab-4f3e-a9ec-450624c66de4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:48.713328 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-27ad88d2-c9ab-4f3e-a9ec-450624c66de4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:48.774255 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-27ad88d2-c9ab-4f3e-a9ec-450624c66de4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:48.782228 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-27ad88d2-c9ab-4f3e-a9ec-450624c66de4 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080211 Apr 08 11:31:48.782821 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1312/2248] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:48 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:49.717426 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a7f3d620-d061-4c99-af70-1246081d9e77 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:49.718076 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a7f3d620-d061-4c99-af70-1246081d9e77 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:49.724336 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a7f3d620-d061-4c99-af70-1246081d9e77 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:49.724780 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a7f3d620-d061-4c99-af70-1246081d9e77 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:49.725548 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a7f3d620-d061-4c99-af70-1246081d9e77 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:49.726086 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a7f3d620-d061-4c99-af70-1246081d9e77 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:49.862212 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a7f3d620-d061-4c99-af70-1246081d9e77 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:49.870330 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a7f3d620-d061-4c99-af70-1246081d9e77 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.156804 Apr 08 11:31:49.870955 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1313/2249] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:49 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:49.875341 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1512d8ca-a349-4d56-a816-3894a110faa5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:49.875956 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1512d8ca-a349-4d56-a816-3894a110faa5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:49.882462 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1512d8ca-a349-4d56-a816-3894a110faa5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:49.882916 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1512d8ca-a349-4d56-a816-3894a110faa5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:49.883690 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1512d8ca-a349-4d56-a816-3894a110faa5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:49.884135 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1512d8ca-a349-4d56-a816-3894a110faa5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:49.942505 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1512d8ca-a349-4d56-a816-3894a110faa5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:49.952480 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1512d8ca-a349-4d56-a816-3894a110faa5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080517 Apr 08 11:31:49.953243 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1314/2250] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:49 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:50.887522 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d98ee6d2-37e8-440b-a90e-160b00a96482 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:50.888193 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d98ee6d2-37e8-440b-a90e-160b00a96482 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:50.894447 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d98ee6d2-37e8-440b-a90e-160b00a96482 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:50.894898 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d98ee6d2-37e8-440b-a90e-160b00a96482 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:50.895712 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d98ee6d2-37e8-440b-a90e-160b00a96482 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:50.896098 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d98ee6d2-37e8-440b-a90e-160b00a96482 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:51.028778 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d98ee6d2-37e8-440b-a90e-160b00a96482 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:51.036146 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d98ee6d2-37e8-440b-a90e-160b00a96482 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.152497 Apr 08 11:31:51.036725 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1315/2251] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:50 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:51.041077 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-06e8e459-d3ea-451d-a5cd-decd74630f12 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:51.041686 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-06e8e459-d3ea-451d-a5cd-decd74630f12 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:51.047419 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-06e8e459-d3ea-451d-a5cd-decd74630f12 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:51.047877 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-06e8e459-d3ea-451d-a5cd-decd74630f12 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:51.048650 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-06e8e459-d3ea-451d-a5cd-decd74630f12 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:51.049091 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-06e8e459-d3ea-451d-a5cd-decd74630f12 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:51.107015 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-06e8e459-d3ea-451d-a5cd-decd74630f12 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:51.114206 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-06e8e459-d3ea-451d-a5cd-decd74630f12 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.076519 Apr 08 11:31:51.114811 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1316/2252] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:51 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:52.053707 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-83b40acc-d4e2-439d-8ed1-6bc14f5d0f5b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:52.054525 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-83b40acc-d4e2-439d-8ed1-6bc14f5d0f5b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:52.060644 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-83b40acc-d4e2-439d-8ed1-6bc14f5d0f5b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:52.061098 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-83b40acc-d4e2-439d-8ed1-6bc14f5d0f5b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:52.061893 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-83b40acc-d4e2-439d-8ed1-6bc14f5d0f5b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:52.062335 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-83b40acc-d4e2-439d-8ed1-6bc14f5d0f5b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:52.200649 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-83b40acc-d4e2-439d-8ed1-6bc14f5d0f5b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:52.208563 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-83b40acc-d4e2-439d-8ed1-6bc14f5d0f5b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.158583 Apr 08 11:31:52.209593 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1317/2253] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:52 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:52.216945 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-462320e7-4ffc-40d3-b82b-c521cec2fc85 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:52.217851 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-462320e7-4ffc-40d3-b82b-c521cec2fc85 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:52.226017 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-462320e7-4ffc-40d3-b82b-c521cec2fc85 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:52.226663 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-462320e7-4ffc-40d3-b82b-c521cec2fc85 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:52.227760 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-462320e7-4ffc-40d3-b82b-c521cec2fc85 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:52.228382 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-462320e7-4ffc-40d3-b82b-c521cec2fc85 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:52.297349 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-462320e7-4ffc-40d3-b82b-c521cec2fc85 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:52.304866 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-462320e7-4ffc-40d3-b82b-c521cec2fc85 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.094056 Apr 08 11:31:52.305382 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1318/2254] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:52 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:53.227151 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-882db36f-d663-4f55-8147-557df6d95cf1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:53.228222 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-882db36f-d663-4f55-8147-557df6d95cf1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:53.234238 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-882db36f-d663-4f55-8147-557df6d95cf1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:53.234691 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-882db36f-d663-4f55-8147-557df6d95cf1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:53.235477 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-882db36f-d663-4f55-8147-557df6d95cf1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:53.235913 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-882db36f-d663-4f55-8147-557df6d95cf1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:53.373834 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-882db36f-d663-4f55-8147-557df6d95cf1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:53.381211 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-882db36f-d663-4f55-8147-557df6d95cf1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.158523 Apr 08 11:31:53.381814 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1319/2255] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:53 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:53.386285 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-115425d0-e253-4882-b972-09e9cc4ce507 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:53.386888 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-115425d0-e253-4882-b972-09e9cc4ce507 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:53.393257 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-115425d0-e253-4882-b972-09e9cc4ce507 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:53.393712 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-115425d0-e253-4882-b972-09e9cc4ce507 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:53.394532 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-115425d0-e253-4882-b972-09e9cc4ce507 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:53.394995 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-115425d0-e253-4882-b972-09e9cc4ce507 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:53.454284 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-115425d0-e253-4882-b972-09e9cc4ce507 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:53.462284 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-115425d0-e253-4882-b972-09e9cc4ce507 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079440 Apr 08 11:31:53.462859 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1320/2256] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:53 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:54.397860 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8c091083-c070-433c-bc7f-4c94c681bd9b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:54.398538 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8c091083-c070-433c-bc7f-4c94c681bd9b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:54.404884 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8c091083-c070-433c-bc7f-4c94c681bd9b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:54.405338 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8c091083-c070-433c-bc7f-4c94c681bd9b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:54.406124 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8c091083-c070-433c-bc7f-4c94c681bd9b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:54.406561 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8c091083-c070-433c-bc7f-4c94c681bd9b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:54.540223 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8c091083-c070-433c-bc7f-4c94c681bd9b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:54.547561 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8c091083-c070-433c-bc7f-4c94c681bd9b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.153586 Apr 08 11:31:54.548134 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1321/2257] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:54 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:54.552590 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-cc617ae3-5c08-4f99-be61-a70d1b0dad56 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:54.553195 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-cc617ae3-5c08-4f99-be61-a70d1b0dad56 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:54.559903 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cc617ae3-5c08-4f99-be61-a70d1b0dad56 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:54.560355 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cc617ae3-5c08-4f99-be61-a70d1b0dad56 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:54.561122 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cc617ae3-5c08-4f99-be61-a70d1b0dad56 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:54.561563 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cc617ae3-5c08-4f99-be61-a70d1b0dad56 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:54.619925 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-cc617ae3-5c08-4f99-be61-a70d1b0dad56 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:54.627409 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-cc617ae3-5c08-4f99-be61-a70d1b0dad56 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078300 Apr 08 11:31:54.627988 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1322/2258] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:54 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:55.564232 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-32800793-6ca9-4b37-b231-b310d010637b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:55.564948 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-32800793-6ca9-4b37-b231-b310d010637b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:55.571758 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-32800793-6ca9-4b37-b231-b310d010637b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:55.572206 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-32800793-6ca9-4b37-b231-b310d010637b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:55.572979 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-32800793-6ca9-4b37-b231-b310d010637b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:55.573421 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-32800793-6ca9-4b37-b231-b310d010637b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:55.714355 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-32800793-6ca9-4b37-b231-b310d010637b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:55.721688 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-32800793-6ca9-4b37-b231-b310d010637b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.161327 Apr 08 11:31:55.722285 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1323/2259] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:55 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:55.726818 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a5664f85-8ea3-426a-aa8f-d05eece4058b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:55.727370 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a5664f85-8ea3-426a-aa8f-d05eece4058b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:55.732966 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a5664f85-8ea3-426a-aa8f-d05eece4058b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:55.733416 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a5664f85-8ea3-426a-aa8f-d05eece4058b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:55.734207 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a5664f85-8ea3-426a-aa8f-d05eece4058b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:55.734648 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a5664f85-8ea3-426a-aa8f-d05eece4058b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:55.802349 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a5664f85-8ea3-426a-aa8f-d05eece4058b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:55.810253 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a5664f85-8ea3-426a-aa8f-d05eece4058b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.086989 Apr 08 11:31:55.810826 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1324/2260] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:55 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:56.738651 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-855746ab-9111-486e-8689-6fb9c47e9002 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:56.739326 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-855746ab-9111-486e-8689-6fb9c47e9002 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:56.745694 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-855746ab-9111-486e-8689-6fb9c47e9002 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:56.746173 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-855746ab-9111-486e-8689-6fb9c47e9002 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:56.746944 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-855746ab-9111-486e-8689-6fb9c47e9002 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:56.747388 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-855746ab-9111-486e-8689-6fb9c47e9002 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:56.884036 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-855746ab-9111-486e-8689-6fb9c47e9002 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:56.898853 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-855746ab-9111-486e-8689-6fb9c47e9002 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.161857 Apr 08 11:31:56.899374 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1325/2261] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:56 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:56.904215 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0609270a-cc34-4e03-a238-02f81a75f507 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:56.904813 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0609270a-cc34-4e03-a238-02f81a75f507 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:56.925559 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0609270a-cc34-4e03-a238-02f81a75f507 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:56.926028 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0609270a-cc34-4e03-a238-02f81a75f507 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:56.926989 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0609270a-cc34-4e03-a238-02f81a75f507 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:56.927584 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0609270a-cc34-4e03-a238-02f81a75f507 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:56.991992 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0609270a-cc34-4e03-a238-02f81a75f507 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:56.999644 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0609270a-cc34-4e03-a238-02f81a75f507 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.099328 Apr 08 11:31:57.000221 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1326/2262] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:56 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:57.916894 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-01c237d8-abc3-43ea-9405-944175579c56 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:57.917544 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-01c237d8-abc3-43ea-9405-944175579c56 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:57.924481 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-01c237d8-abc3-43ea-9405-944175579c56 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:57.925012 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-01c237d8-abc3-43ea-9405-944175579c56 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:57.925803 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-01c237d8-abc3-43ea-9405-944175579c56 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:57.926242 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-01c237d8-abc3-43ea-9405-944175579c56 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:58.070504 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-01c237d8-abc3-43ea-9405-944175579c56 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:58.083468 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-01c237d8-abc3-43ea-9405-944175579c56 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.168181 Apr 08 11:31:58.084084 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1327/2263] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:57 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:58.089098 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c4ba6e5b-758d-4b93-a9e5-879a186e6778 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:58.089708 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c4ba6e5b-758d-4b93-a9e5-879a186e6778 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:58.095986 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c4ba6e5b-758d-4b93-a9e5-879a186e6778 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:58.096441 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c4ba6e5b-758d-4b93-a9e5-879a186e6778 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:58.097243 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c4ba6e5b-758d-4b93-a9e5-879a186e6778 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:58.097663 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c4ba6e5b-758d-4b93-a9e5-879a186e6778 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:58.159702 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c4ba6e5b-758d-4b93-a9e5-879a186e6778 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:58.167325 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c4ba6e5b-758d-4b93-a9e5-879a186e6778 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082218 Apr 08 11:31:58.167861 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1328/2264] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:58 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:31:59.101211 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-883634bd-48b2-464e-be83-b1a6a4bd0418 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:59.101978 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-883634bd-48b2-464e-be83-b1a6a4bd0418 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:59.108341 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-883634bd-48b2-464e-be83-b1a6a4bd0418 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:59.108793 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-883634bd-48b2-464e-be83-b1a6a4bd0418 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:59.109568 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-883634bd-48b2-464e-be83-b1a6a4bd0418 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:59.110033 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-883634bd-48b2-464e-be83-b1a6a4bd0418 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:59.246818 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-883634bd-48b2-464e-be83-b1a6a4bd0418 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:59.254306 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-883634bd-48b2-464e-be83-b1a6a4bd0418 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.157004 Apr 08 11:31:59.254885 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1329/2265] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:59 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:31:59.260165 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-50b5e039-47f1-4e95-a06c-e8e34c897b4a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:31:59.260828 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-50b5e039-47f1-4e95-a06c-e8e34c897b4a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:31:59.271117 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-50b5e039-47f1-4e95-a06c-e8e34c897b4a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:59.271117 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-50b5e039-47f1-4e95-a06c-e8e34c897b4a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:59.271459 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-50b5e039-47f1-4e95-a06c-e8e34c897b4a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:31:59.271885 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-50b5e039-47f1-4e95-a06c-e8e34c897b4a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:31:59.338489 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-50b5e039-47f1-4e95-a06c-e8e34c897b4a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:31:59.345835 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-50b5e039-47f1-4e95-a06c-e8e34c897b4a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.089965 Apr 08 11:31:59.346411 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1330/2266] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:31:59 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:00.276932 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b85b622d-d878-4034-a79c-d85018cf7c0f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:00.277635 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b85b622d-d878-4034-a79c-d85018cf7c0f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:00.284144 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b85b622d-d878-4034-a79c-d85018cf7c0f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:00.284598 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b85b622d-d878-4034-a79c-d85018cf7c0f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:00.285386 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b85b622d-d878-4034-a79c-d85018cf7c0f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:00.285854 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b85b622d-d878-4034-a79c-d85018cf7c0f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:00.418423 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b85b622d-d878-4034-a79c-d85018cf7c0f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:00.425678 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b85b622d-d878-4034-a79c-d85018cf7c0f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.153149 Apr 08 11:32:00.426289 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1331/2267] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:00 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:00.430778 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-79cedc54-6526-4bca-8d59-95daa66c498d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:00.431413 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-79cedc54-6526-4bca-8d59-95daa66c498d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:00.437040 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-79cedc54-6526-4bca-8d59-95daa66c498d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:00.437491 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-79cedc54-6526-4bca-8d59-95daa66c498d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:00.438309 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-79cedc54-6526-4bca-8d59-95daa66c498d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:00.438747 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-79cedc54-6526-4bca-8d59-95daa66c498d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:00.500287 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-79cedc54-6526-4bca-8d59-95daa66c498d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:00.508858 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-79cedc54-6526-4bca-8d59-95daa66c498d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081471 Apr 08 11:32:00.509433 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1332/2268] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:00 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:01.442623 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-dd7c813b-9418-4c87-9f09-196ca064b47e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:01.443359 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-dd7c813b-9418-4c87-9f09-196ca064b47e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:01.449712 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dd7c813b-9418-4c87-9f09-196ca064b47e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:01.450200 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dd7c813b-9418-4c87-9f09-196ca064b47e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:01.450987 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dd7c813b-9418-4c87-9f09-196ca064b47e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:01.451430 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dd7c813b-9418-4c87-9f09-196ca064b47e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:01.589752 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-dd7c813b-9418-4c87-9f09-196ca064b47e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:01.597151 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-dd7c813b-9418-4c87-9f09-196ca064b47e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.158362 Apr 08 11:32:01.597733 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1333/2269] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:01 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:01.603118 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6ec7b7f5-a71b-4142-b662-463fc9546138 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:01.603729 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6ec7b7f5-a71b-4142-b662-463fc9546138 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:01.609385 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6ec7b7f5-a71b-4142-b662-463fc9546138 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:01.609865 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6ec7b7f5-a71b-4142-b662-463fc9546138 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:01.610638 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6ec7b7f5-a71b-4142-b662-463fc9546138 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:01.611081 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6ec7b7f5-a71b-4142-b662-463fc9546138 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:01.670531 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6ec7b7f5-a71b-4142-b662-463fc9546138 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:01.678170 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6ec7b7f5-a71b-4142-b662-463fc9546138 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079255 Apr 08 11:32:01.678749 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1334/2270] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:01 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:02.614583 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-da3d6a8c-58f8-429c-ba39-9f19013e1889 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:02.615276 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-da3d6a8c-58f8-429c-ba39-9f19013e1889 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:02.622550 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-da3d6a8c-58f8-429c-ba39-9f19013e1889 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:02.623012 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-da3d6a8c-58f8-429c-ba39-9f19013e1889 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:02.623798 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-da3d6a8c-58f8-429c-ba39-9f19013e1889 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:02.624242 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-da3d6a8c-58f8-429c-ba39-9f19013e1889 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:02.768847 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-da3d6a8c-58f8-429c-ba39-9f19013e1889 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:02.776143 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-da3d6a8c-58f8-429c-ba39-9f19013e1889 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.165590 Apr 08 11:32:02.776713 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1335/2271] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:02 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:02.781071 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5f9f2d8d-b516-43d0-81a6-54126fe2f418 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:02.781671 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5f9f2d8d-b516-43d0-81a6-54126fe2f418 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:02.787211 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5f9f2d8d-b516-43d0-81a6-54126fe2f418 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:02.787660 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5f9f2d8d-b516-43d0-81a6-54126fe2f418 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:02.788936 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5f9f2d8d-b516-43d0-81a6-54126fe2f418 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:02.789375 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5f9f2d8d-b516-43d0-81a6-54126fe2f418 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:02.846482 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5f9f2d8d-b516-43d0-81a6-54126fe2f418 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:02.854210 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5f9f2d8d-b516-43d0-81a6-54126fe2f418 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.076518 Apr 08 11:32:02.854779 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1336/2272] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:02 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:03.793104 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-33ef0c40-c12d-4496-a53c-85b2161b7e4f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:03.793834 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-33ef0c40-c12d-4496-a53c-85b2161b7e4f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:03.800398 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-33ef0c40-c12d-4496-a53c-85b2161b7e4f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:03.800904 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-33ef0c40-c12d-4496-a53c-85b2161b7e4f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:03.801682 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-33ef0c40-c12d-4496-a53c-85b2161b7e4f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:03.802170 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-33ef0c40-c12d-4496-a53c-85b2161b7e4f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:03.938397 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-33ef0c40-c12d-4496-a53c-85b2161b7e4f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:03.946426 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-33ef0c40-c12d-4496-a53c-85b2161b7e4f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.157178 Apr 08 11:32:03.946987 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1337/2273] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:03 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:03.951271 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-965cf960-b6bf-439a-ad2a-7ff8df394804 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:03.951864 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-965cf960-b6bf-439a-ad2a-7ff8df394804 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:03.957253 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-965cf960-b6bf-439a-ad2a-7ff8df394804 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:03.957700 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-965cf960-b6bf-439a-ad2a-7ff8df394804 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:03.958487 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-965cf960-b6bf-439a-ad2a-7ff8df394804 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:03.958919 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-965cf960-b6bf-439a-ad2a-7ff8df394804 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:04.017531 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-965cf960-b6bf-439a-ad2a-7ff8df394804 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:04.025788 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-965cf960-b6bf-439a-ad2a-7ff8df394804 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077844 Apr 08 11:32:04.026377 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1338/2274] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:03 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:04.964190 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-405c6cf6-0763-497d-bc76-2c56303fd0ad tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:04.964856 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-405c6cf6-0763-497d-bc76-2c56303fd0ad tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:04.971487 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-405c6cf6-0763-497d-bc76-2c56303fd0ad tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:04.971942 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-405c6cf6-0763-497d-bc76-2c56303fd0ad tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:04.972740 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-405c6cf6-0763-497d-bc76-2c56303fd0ad tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:04.973345 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-405c6cf6-0763-497d-bc76-2c56303fd0ad tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:05.114821 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-405c6cf6-0763-497d-bc76-2c56303fd0ad tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:05.122483 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-405c6cf6-0763-497d-bc76-2c56303fd0ad tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.162872 Apr 08 11:32:05.123057 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1339/2275] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:04 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:05.127388 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bfa518ba-ab6f-40fc-b08b-676c2311632b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:05.127991 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-bfa518ba-ab6f-40fc-b08b-676c2311632b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:05.133678 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bfa518ba-ab6f-40fc-b08b-676c2311632b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:05.134171 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bfa518ba-ab6f-40fc-b08b-676c2311632b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:05.135486 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bfa518ba-ab6f-40fc-b08b-676c2311632b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:05.135926 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bfa518ba-ab6f-40fc-b08b-676c2311632b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:05.193992 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-bfa518ba-ab6f-40fc-b08b-676c2311632b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:05.201793 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-bfa518ba-ab6f-40fc-b08b-676c2311632b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077789 Apr 08 11:32:05.202392 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1340/2276] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:05 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:06.139890 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-eaf83f74-ea0a-480d-91c9-a50e729ff8c6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:06.140602 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-eaf83f74-ea0a-480d-91c9-a50e729ff8c6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:06.146948 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-eaf83f74-ea0a-480d-91c9-a50e729ff8c6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:06.147389 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-eaf83f74-ea0a-480d-91c9-a50e729ff8c6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:06.148151 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-eaf83f74-ea0a-480d-91c9-a50e729ff8c6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:06.148586 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-eaf83f74-ea0a-480d-91c9-a50e729ff8c6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:06.287730 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-eaf83f74-ea0a-480d-91c9-a50e729ff8c6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:06.295899 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-eaf83f74-ea0a-480d-91c9-a50e729ff8c6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.159931 Apr 08 11:32:06.296476 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1341/2277] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:06 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:06.300906 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8930fe56-e389-44bb-b874-1ea55515b1f9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:06.301511 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8930fe56-e389-44bb-b874-1ea55515b1f9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:06.307038 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8930fe56-e389-44bb-b874-1ea55515b1f9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:06.307485 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8930fe56-e389-44bb-b874-1ea55515b1f9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:06.308254 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8930fe56-e389-44bb-b874-1ea55515b1f9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:06.308694 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8930fe56-e389-44bb-b874-1ea55515b1f9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:06.370193 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8930fe56-e389-44bb-b874-1ea55515b1f9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:06.377634 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8930fe56-e389-44bb-b874-1ea55515b1f9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080220 Apr 08 11:32:06.378239 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1342/2278] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:06 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:07.313004 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b6666fa9-45a9-4f90-9584-f99c17eb7ccb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:07.313720 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b6666fa9-45a9-4f90-9584-f99c17eb7ccb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:07.320024 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b6666fa9-45a9-4f90-9584-f99c17eb7ccb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:07.320474 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b6666fa9-45a9-4f90-9584-f99c17eb7ccb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:07.321252 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b6666fa9-45a9-4f90-9584-f99c17eb7ccb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:07.321694 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b6666fa9-45a9-4f90-9584-f99c17eb7ccb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:07.461330 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b6666fa9-45a9-4f90-9584-f99c17eb7ccb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:07.469038 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b6666fa9-45a9-4f90-9584-f99c17eb7ccb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.159903 Apr 08 11:32:07.469614 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1343/2279] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:07 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:07.474168 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9caef59d-fa2e-4343-846c-16d20af2fe4d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:07.474791 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9caef59d-fa2e-4343-846c-16d20af2fe4d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:07.480694 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9caef59d-fa2e-4343-846c-16d20af2fe4d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:07.481141 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9caef59d-fa2e-4343-846c-16d20af2fe4d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:07.481954 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9caef59d-fa2e-4343-846c-16d20af2fe4d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:07.482402 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9caef59d-fa2e-4343-846c-16d20af2fe4d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:07.543311 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9caef59d-fa2e-4343-846c-16d20af2fe4d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:07.550900 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9caef59d-fa2e-4343-846c-16d20af2fe4d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080264 Apr 08 11:32:07.551486 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1344/2280] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:07 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:08.486825 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-549a2e26-ece1-4dc4-aba2-9c39701aed42 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:08.487472 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-549a2e26-ece1-4dc4-aba2-9c39701aed42 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:08.493698 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-549a2e26-ece1-4dc4-aba2-9c39701aed42 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:08.494188 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-549a2e26-ece1-4dc4-aba2-9c39701aed42 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:08.495224 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-549a2e26-ece1-4dc4-aba2-9c39701aed42 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:08.495666 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-549a2e26-ece1-4dc4-aba2-9c39701aed42 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:08.654519 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-549a2e26-ece1-4dc4-aba2-9c39701aed42 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:08.662048 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-549a2e26-ece1-4dc4-aba2-9c39701aed42 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.179058 Apr 08 11:32:08.662640 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1345/2281] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:08 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:08.667243 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8b51e344-e754-49ea-ac24-85e52352a6a1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:08.667851 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8b51e344-e754-49ea-ac24-85e52352a6a1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:08.674091 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8b51e344-e754-49ea-ac24-85e52352a6a1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:08.674539 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8b51e344-e754-49ea-ac24-85e52352a6a1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:08.675312 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8b51e344-e754-49ea-ac24-85e52352a6a1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:08.675750 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8b51e344-e754-49ea-ac24-85e52352a6a1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:08.736016 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8b51e344-e754-49ea-ac24-85e52352a6a1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:08.744186 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8b51e344-e754-49ea-ac24-85e52352a6a1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080470 Apr 08 11:32:08.745087 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1346/2282] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:08 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:09.679023 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4137b108-a7c4-43df-9535-7ad941f432a4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:09.679618 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4137b108-a7c4-43df-9535-7ad941f432a4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:09.686546 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4137b108-a7c4-43df-9535-7ad941f432a4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:09.687001 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4137b108-a7c4-43df-9535-7ad941f432a4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:09.687775 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4137b108-a7c4-43df-9535-7ad941f432a4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:09.688208 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4137b108-a7c4-43df-9535-7ad941f432a4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:09.819448 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4137b108-a7c4-43df-9535-7ad941f432a4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:09.826804 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4137b108-a7c4-43df-9535-7ad941f432a4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.151621 Apr 08 11:32:09.827383 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1347/2283] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:09 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:09.831730 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-94e56d0c-a870-4253-bcb1-8a8567f67df2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:09.832329 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-94e56d0c-a870-4253-bcb1-8a8567f67df2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:09.838507 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-94e56d0c-a870-4253-bcb1-8a8567f67df2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:09.838955 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-94e56d0c-a870-4253-bcb1-8a8567f67df2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:09.839729 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-94e56d0c-a870-4253-bcb1-8a8567f67df2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:09.840162 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-94e56d0c-a870-4253-bcb1-8a8567f67df2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:09.902696 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-94e56d0c-a870-4253-bcb1-8a8567f67df2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:09.910263 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-94e56d0c-a870-4253-bcb1-8a8567f67df2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081918 Apr 08 11:32:09.910850 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1348/2284] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:09 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:10.844586 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-cfcf1981-54a5-46fa-8f04-ed330237989e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:10.845279 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-cfcf1981-54a5-46fa-8f04-ed330237989e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:10.851715 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cfcf1981-54a5-46fa-8f04-ed330237989e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:10.852172 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cfcf1981-54a5-46fa-8f04-ed330237989e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:10.852955 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cfcf1981-54a5-46fa-8f04-ed330237989e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:10.853942 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cfcf1981-54a5-46fa-8f04-ed330237989e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:10.992031 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-cfcf1981-54a5-46fa-8f04-ed330237989e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:11.000372 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-cfcf1981-54a5-46fa-8f04-ed330237989e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.159657 Apr 08 11:32:11.000977 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1349/2285] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:10 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:11.005528 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-acd6c0fd-ccf1-4cfa-b366-0c092fd7031e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:11.006177 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-acd6c0fd-ccf1-4cfa-b366-0c092fd7031e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:11.012370 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-acd6c0fd-ccf1-4cfa-b366-0c092fd7031e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:11.012830 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-acd6c0fd-ccf1-4cfa-b366-0c092fd7031e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:11.013636 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-acd6c0fd-ccf1-4cfa-b366-0c092fd7031e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:11.014110 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-acd6c0fd-ccf1-4cfa-b366-0c092fd7031e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:11.073846 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-acd6c0fd-ccf1-4cfa-b366-0c092fd7031e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:11.081524 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-acd6c0fd-ccf1-4cfa-b366-0c092fd7031e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079454 Apr 08 11:32:11.082035 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1350/2286] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:11 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:12.017781 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bcf5d60a-7080-4e02-b6e1-ad462e4c9ba2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:12.018430 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-bcf5d60a-7080-4e02-b6e1-ad462e4c9ba2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:12.024723 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bcf5d60a-7080-4e02-b6e1-ad462e4c9ba2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:12.025176 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bcf5d60a-7080-4e02-b6e1-ad462e4c9ba2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:12.025986 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bcf5d60a-7080-4e02-b6e1-ad462e4c9ba2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:12.026433 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bcf5d60a-7080-4e02-b6e1-ad462e4c9ba2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:12.163528 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-bcf5d60a-7080-4e02-b6e1-ad462e4c9ba2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:12.170979 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-bcf5d60a-7080-4e02-b6e1-ad462e4c9ba2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.157069 Apr 08 11:32:12.171572 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1351/2287] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:12 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:12.175994 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4c03f875-c9cd-4d38-9e72-9c61fb1ccdb8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:12.176600 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4c03f875-c9cd-4d38-9e72-9c61fb1ccdb8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:12.182721 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4c03f875-c9cd-4d38-9e72-9c61fb1ccdb8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:12.183170 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4c03f875-c9cd-4d38-9e72-9c61fb1ccdb8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:12.183941 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4c03f875-c9cd-4d38-9e72-9c61fb1ccdb8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:12.184378 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4c03f875-c9cd-4d38-9e72-9c61fb1ccdb8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:12.242945 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4c03f875-c9cd-4d38-9e72-9c61fb1ccdb8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:12.251266 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4c03f875-c9cd-4d38-9e72-9c61fb1ccdb8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078759 Apr 08 11:32:12.251836 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1352/2288] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:12 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:13.187884 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-04a72971-dd60-4a05-a20d-edb481df2220 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:13.188592 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-04a72971-dd60-4a05-a20d-edb481df2220 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:13.194833 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-04a72971-dd60-4a05-a20d-edb481df2220 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:13.195278 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-04a72971-dd60-4a05-a20d-edb481df2220 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:13.196034 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-04a72971-dd60-4a05-a20d-edb481df2220 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:13.196466 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-04a72971-dd60-4a05-a20d-edb481df2220 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:13.330513 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-04a72971-dd60-4a05-a20d-edb481df2220 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:13.338501 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-04a72971-dd60-4a05-a20d-edb481df2220 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.154496 Apr 08 11:32:13.339072 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1353/2289] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:13 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:13.343434 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0c83dca1-ae81-4a2b-a51d-ff4a7dde5350 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:13.344040 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0c83dca1-ae81-4a2b-a51d-ff4a7dde5350 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:13.349571 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0c83dca1-ae81-4a2b-a51d-ff4a7dde5350 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:13.350057 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0c83dca1-ae81-4a2b-a51d-ff4a7dde5350 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:13.350820 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0c83dca1-ae81-4a2b-a51d-ff4a7dde5350 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:13.351256 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0c83dca1-ae81-4a2b-a51d-ff4a7dde5350 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:13.412614 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0c83dca1-ae81-4a2b-a51d-ff4a7dde5350 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:13.419910 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0c83dca1-ae81-4a2b-a51d-ff4a7dde5350 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079898 Apr 08 11:32:13.420477 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1354/2290] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:13 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:14.356578 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9ac178d5-a1c7-48a7-bdce-1aeb18182a4c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:14.357268 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9ac178d5-a1c7-48a7-bdce-1aeb18182a4c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:14.363660 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9ac178d5-a1c7-48a7-bdce-1aeb18182a4c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:14.364117 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9ac178d5-a1c7-48a7-bdce-1aeb18182a4c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:14.364891 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9ac178d5-a1c7-48a7-bdce-1aeb18182a4c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:14.365336 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9ac178d5-a1c7-48a7-bdce-1aeb18182a4c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:14.501186 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9ac178d5-a1c7-48a7-bdce-1aeb18182a4c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:14.508588 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9ac178d5-a1c7-48a7-bdce-1aeb18182a4c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.156741 Apr 08 11:32:14.509167 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1355/2291] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:14 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:14.514112 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-44291966-8d56-4f35-8f18-5d69c39a8c84 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:14.514725 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-44291966-8d56-4f35-8f18-5d69c39a8c84 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:14.520617 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-44291966-8d56-4f35-8f18-5d69c39a8c84 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:14.521071 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-44291966-8d56-4f35-8f18-5d69c39a8c84 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:14.521874 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-44291966-8d56-4f35-8f18-5d69c39a8c84 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:14.522317 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-44291966-8d56-4f35-8f18-5d69c39a8c84 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:14.580683 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-44291966-8d56-4f35-8f18-5d69c39a8c84 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:14.587964 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-44291966-8d56-4f35-8f18-5d69c39a8c84 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077861 Apr 08 11:32:14.589136 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1356/2292] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:14 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:15.527106 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-28d1f674-82ba-4ee5-b21d-57c8ee5ac57d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:15.527818 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-28d1f674-82ba-4ee5-b21d-57c8ee5ac57d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:15.534075 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-28d1f674-82ba-4ee5-b21d-57c8ee5ac57d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:15.534533 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-28d1f674-82ba-4ee5-b21d-57c8ee5ac57d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:15.535303 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-28d1f674-82ba-4ee5-b21d-57c8ee5ac57d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:15.535745 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-28d1f674-82ba-4ee5-b21d-57c8ee5ac57d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:15.681620 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-28d1f674-82ba-4ee5-b21d-57c8ee5ac57d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:15.689808 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-28d1f674-82ba-4ee5-b21d-57c8ee5ac57d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.167335 Apr 08 11:32:15.690388 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1357/2293] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:15 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:15.695019 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-53a9b81b-f84d-4593-b822-534dc87a40fc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:15.695630 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-53a9b81b-f84d-4593-b822-534dc87a40fc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:15.701979 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-53a9b81b-f84d-4593-b822-534dc87a40fc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:15.702618 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-53a9b81b-f84d-4593-b822-534dc87a40fc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:15.703419 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-53a9b81b-f84d-4593-b822-534dc87a40fc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:15.703861 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-53a9b81b-f84d-4593-b822-534dc87a40fc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:15.762767 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-53a9b81b-f84d-4593-b822-534dc87a40fc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:15.770123 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-53a9b81b-f84d-4593-b822-534dc87a40fc tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078766 Apr 08 11:32:15.770695 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1358/2294] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:15 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:16.707835 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b44012a3-bfd0-41a5-ae88-d447c9690ff1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:16.708678 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b44012a3-bfd0-41a5-ae88-d447c9690ff1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:16.715269 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b44012a3-bfd0-41a5-ae88-d447c9690ff1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:16.715718 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b44012a3-bfd0-41a5-ae88-d447c9690ff1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:16.716485 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b44012a3-bfd0-41a5-ae88-d447c9690ff1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:16.716928 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b44012a3-bfd0-41a5-ae88-d447c9690ff1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:16.849697 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b44012a3-bfd0-41a5-ae88-d447c9690ff1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:16.857083 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b44012a3-bfd0-41a5-ae88-d447c9690ff1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.153159 Apr 08 11:32:16.857698 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1359/2295] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:16 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:16.862141 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-cb3f8e08-8c7e-45c1-8ad0-a3c68ad3e88c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:16.862747 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-cb3f8e08-8c7e-45c1-8ad0-a3c68ad3e88c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:16.868242 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cb3f8e08-8c7e-45c1-8ad0-a3c68ad3e88c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:16.868692 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cb3f8e08-8c7e-45c1-8ad0-a3c68ad3e88c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:16.869456 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cb3f8e08-8c7e-45c1-8ad0-a3c68ad3e88c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:16.870211 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cb3f8e08-8c7e-45c1-8ad0-a3c68ad3e88c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:16.927603 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-cb3f8e08-8c7e-45c1-8ad0-a3c68ad3e88c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:16.934936 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-cb3f8e08-8c7e-45c1-8ad0-a3c68ad3e88c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.076288 Apr 08 11:32:16.935506 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1360/2296] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:16 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:17.874470 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-41fdbf64-02ca-4bbd-bb55-2cbcbe2c7bec tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:17.875158 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-41fdbf64-02ca-4bbd-bb55-2cbcbe2c7bec tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:17.881375 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-41fdbf64-02ca-4bbd-bb55-2cbcbe2c7bec tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:17.881872 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-41fdbf64-02ca-4bbd-bb55-2cbcbe2c7bec tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:17.882676 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-41fdbf64-02ca-4bbd-bb55-2cbcbe2c7bec tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:17.883119 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-41fdbf64-02ca-4bbd-bb55-2cbcbe2c7bec tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:18.021592 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-41fdbf64-02ca-4bbd-bb55-2cbcbe2c7bec tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:18.029748 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-41fdbf64-02ca-4bbd-bb55-2cbcbe2c7bec tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.159714 Apr 08 11:32:18.030358 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1361/2297] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:17 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:18.034839 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a310f7c9-0587-4753-893e-7b64ba1de809 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:18.035476 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a310f7c9-0587-4753-893e-7b64ba1de809 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:18.041462 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a310f7c9-0587-4753-893e-7b64ba1de809 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:18.042612 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a310f7c9-0587-4753-893e-7b64ba1de809 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:18.043416 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a310f7c9-0587-4753-893e-7b64ba1de809 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:18.043882 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a310f7c9-0587-4753-893e-7b64ba1de809 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:18.103433 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a310f7c9-0587-4753-893e-7b64ba1de809 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:18.111334 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a310f7c9-0587-4753-893e-7b64ba1de809 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080038 Apr 08 11:32:18.111909 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1362/2298] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:18 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:19.047071 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-00fd5e1b-876f-4520-9374-4236c3d69a3b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:19.047747 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-00fd5e1b-876f-4520-9374-4236c3d69a3b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:19.054006 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-00fd5e1b-876f-4520-9374-4236c3d69a3b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:19.054460 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-00fd5e1b-876f-4520-9374-4236c3d69a3b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:19.055231 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-00fd5e1b-876f-4520-9374-4236c3d69a3b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:19.055668 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-00fd5e1b-876f-4520-9374-4236c3d69a3b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:19.189217 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-00fd5e1b-876f-4520-9374-4236c3d69a3b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:19.196658 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-00fd5e1b-876f-4520-9374-4236c3d69a3b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.153969 Apr 08 11:32:19.197238 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1363/2299] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:19 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:19.201704 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b3909490-bc05-491d-91f7-b71140febd55 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:19.202341 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b3909490-bc05-491d-91f7-b71140febd55 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:19.207833 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b3909490-bc05-491d-91f7-b71140febd55 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:19.208285 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b3909490-bc05-491d-91f7-b71140febd55 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:19.209058 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b3909490-bc05-491d-91f7-b71140febd55 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:19.209497 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b3909490-bc05-491d-91f7-b71140febd55 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:19.507222 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b3909490-bc05-491d-91f7-b71140febd55 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:19.514982 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b3909490-bc05-491d-91f7-b71140febd55 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.316789 Apr 08 11:32:19.515555 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1364/2300] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:19 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:20.213148 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-93c3fe6e-eded-44b1-a671-b4574f40b979 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:20.213892 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-93c3fe6e-eded-44b1-a671-b4574f40b979 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:20.219987 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-93c3fe6e-eded-44b1-a671-b4574f40b979 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:20.220432 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-93c3fe6e-eded-44b1-a671-b4574f40b979 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:20.221192 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-93c3fe6e-eded-44b1-a671-b4574f40b979 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:20.221615 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-93c3fe6e-eded-44b1-a671-b4574f40b979 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:20.355581 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-93c3fe6e-eded-44b1-a671-b4574f40b979 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:20.362995 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-93c3fe6e-eded-44b1-a671-b4574f40b979 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.153693 Apr 08 11:32:20.363575 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1365/2301] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:20 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:20.531849 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b661a85e-91d7-4806-aa78-3427e5e5a756 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:20.532465 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b661a85e-91d7-4806-aa78-3427e5e5a756 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:20.538382 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b661a85e-91d7-4806-aa78-3427e5e5a756 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:20.538837 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b661a85e-91d7-4806-aa78-3427e5e5a756 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:20.539608 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b661a85e-91d7-4806-aa78-3427e5e5a756 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:20.540046 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b661a85e-91d7-4806-aa78-3427e5e5a756 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:20.598333 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b661a85e-91d7-4806-aa78-3427e5e5a756 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:20.606585 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b661a85e-91d7-4806-aa78-3427e5e5a756 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078556 Apr 08 11:32:20.607162 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1366/2302] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:20 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:21.380436 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-76573327-fd1c-4704-9cf3-ed8ace887124 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:21.381119 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-76573327-fd1c-4704-9cf3-ed8ace887124 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:21.387908 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-76573327-fd1c-4704-9cf3-ed8ace887124 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:21.388360 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-76573327-fd1c-4704-9cf3-ed8ace887124 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:21.389170 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-76573327-fd1c-4704-9cf3-ed8ace887124 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:21.389608 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-76573327-fd1c-4704-9cf3-ed8ace887124 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:21.523076 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-76573327-fd1c-4704-9cf3-ed8ace887124 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:21.531136 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-76573327-fd1c-4704-9cf3-ed8ace887124 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.154533 Apr 08 11:32:21.531709 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1367/2303] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:21 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:21.623777 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9c24edef-9dc9-44b4-a7d7-b1ba1d7b50d8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:21.624427 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9c24edef-9dc9-44b4-a7d7-b1ba1d7b50d8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:21.630292 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9c24edef-9dc9-44b4-a7d7-b1ba1d7b50d8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:21.630803 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9c24edef-9dc9-44b4-a7d7-b1ba1d7b50d8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:21.631525 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9c24edef-9dc9-44b4-a7d7-b1ba1d7b50d8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:21.631969 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9c24edef-9dc9-44b4-a7d7-b1ba1d7b50d8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:21.691018 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9c24edef-9dc9-44b4-a7d7-b1ba1d7b50d8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:21.698469 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9c24edef-9dc9-44b4-a7d7-b1ba1d7b50d8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079252 Apr 08 11:32:21.699081 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1368/2304] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:21 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:22.548577 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f2d5e7bc-4ba7-48d4-938e-5de570363a73 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:22.549241 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f2d5e7bc-4ba7-48d4-938e-5de570363a73 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:22.555644 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f2d5e7bc-4ba7-48d4-938e-5de570363a73 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:22.556092 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f2d5e7bc-4ba7-48d4-938e-5de570363a73 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:22.556887 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f2d5e7bc-4ba7-48d4-938e-5de570363a73 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:22.557330 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f2d5e7bc-4ba7-48d4-938e-5de570363a73 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:22.695134 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f2d5e7bc-4ba7-48d4-938e-5de570363a73 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:22.703744 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f2d5e7bc-4ba7-48d4-938e-5de570363a73 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.159503 Apr 08 11:32:22.704347 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1369/2305] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:22 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:22.717255 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ccf64f24-d659-4579-b758-40200701e150 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:22.718126 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ccf64f24-d659-4579-b758-40200701e150 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:22.724287 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ccf64f24-d659-4579-b758-40200701e150 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:22.724740 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ccf64f24-d659-4579-b758-40200701e150 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:22.725560 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ccf64f24-d659-4579-b758-40200701e150 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:22.726012 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ccf64f24-d659-4579-b758-40200701e150 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:22.789174 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ccf64f24-d659-4579-b758-40200701e150 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:22.797111 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ccf64f24-d659-4579-b758-40200701e150 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.084416 Apr 08 11:32:22.797707 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1370/2306] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:22 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:23.721045 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-25830a22-549a-4a3e-a245-b4ec4b40e9db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:23.721696 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-25830a22-549a-4a3e-a245-b4ec4b40e9db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:23.728004 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-25830a22-549a-4a3e-a245-b4ec4b40e9db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:23.728463 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-25830a22-549a-4a3e-a245-b4ec4b40e9db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:23.729240 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-25830a22-549a-4a3e-a245-b4ec4b40e9db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:23.729695 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-25830a22-549a-4a3e-a245-b4ec4b40e9db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:23.862646 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-25830a22-549a-4a3e-a245-b4ec4b40e9db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:23.870333 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-25830a22-549a-4a3e-a245-b4ec4b40e9db tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.152881 Apr 08 11:32:23.870894 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1371/2307] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:23 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:23.875401 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-885d777a-b255-4258-893a-5739da632d3e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:23.876003 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-885d777a-b255-4258-893a-5739da632d3e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:23.881506 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-885d777a-b255-4258-893a-5739da632d3e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:23.882011 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-885d777a-b255-4258-893a-5739da632d3e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:23.882780 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-885d777a-b255-4258-893a-5739da632d3e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:23.883228 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-885d777a-b255-4258-893a-5739da632d3e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:23.941270 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-885d777a-b255-4258-893a-5739da632d3e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:23.948636 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-885d777a-b255-4258-893a-5739da632d3e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.076806 Apr 08 11:32:23.949231 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1372/2308] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:23 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:24.887785 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ae40e480-03fa-454a-a296-2ea7042536cf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:24.888999 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ae40e480-03fa-454a-a296-2ea7042536cf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:24.895427 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ae40e480-03fa-454a-a296-2ea7042536cf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:24.895821 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ae40e480-03fa-454a-a296-2ea7042536cf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:24.896591 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ae40e480-03fa-454a-a296-2ea7042536cf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:24.897032 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ae40e480-03fa-454a-a296-2ea7042536cf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:25.033719 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ae40e480-03fa-454a-a296-2ea7042536cf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:25.041369 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ae40e480-03fa-454a-a296-2ea7042536cf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.157534 Apr 08 11:32:25.041976 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1373/2309] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:24 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:25.046887 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-330c313d-6196-487b-9311-d3fe37da12c1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:25.047606 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-330c313d-6196-487b-9311-d3fe37da12c1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:25.053284 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-330c313d-6196-487b-9311-d3fe37da12c1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:25.053907 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-330c313d-6196-487b-9311-d3fe37da12c1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:25.054691 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-330c313d-6196-487b-9311-d3fe37da12c1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:25.055134 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-330c313d-6196-487b-9311-d3fe37da12c1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:25.115045 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-330c313d-6196-487b-9311-d3fe37da12c1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:25.121542 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-330c313d-6196-487b-9311-d3fe37da12c1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078628 Apr 08 11:32:25.122186 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1374/2310] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:25 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:26.058974 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8a7c1f21-a104-4522-95bd-4135cdb0de3a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:26.059654 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8a7c1f21-a104-4522-95bd-4135cdb0de3a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:26.067895 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8a7c1f21-a104-4522-95bd-4135cdb0de3a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:26.068351 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8a7c1f21-a104-4522-95bd-4135cdb0de3a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:26.069218 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8a7c1f21-a104-4522-95bd-4135cdb0de3a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:26.069733 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8a7c1f21-a104-4522-95bd-4135cdb0de3a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:26.203343 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8a7c1f21-a104-4522-95bd-4135cdb0de3a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:26.210729 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8a7c1f21-a104-4522-95bd-4135cdb0de3a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.155603 Apr 08 11:32:26.211295 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1375/2311] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:26 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:26.215592 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-543251ca-5652-498d-b02a-7f28feab3732 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:26.216189 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-543251ca-5652-498d-b02a-7f28feab3732 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:26.221533 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-543251ca-5652-498d-b02a-7f28feab3732 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:26.222013 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-543251ca-5652-498d-b02a-7f28feab3732 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:26.228406 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-543251ca-5652-498d-b02a-7f28feab3732 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:26.228406 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-543251ca-5652-498d-b02a-7f28feab3732 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:26.285277 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-543251ca-5652-498d-b02a-7f28feab3732 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:26.292700 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-543251ca-5652-498d-b02a-7f28feab3732 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080473 Apr 08 11:32:26.293274 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1376/2312] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:26 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:27.227982 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-85ff28c5-afee-493f-aa56-e980727d4df5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:27.228653 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-85ff28c5-afee-493f-aa56-e980727d4df5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:27.235710 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-85ff28c5-afee-493f-aa56-e980727d4df5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:27.236167 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-85ff28c5-afee-493f-aa56-e980727d4df5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:27.236961 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-85ff28c5-afee-493f-aa56-e980727d4df5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:27.237406 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-85ff28c5-afee-493f-aa56-e980727d4df5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:27.376670 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-85ff28c5-afee-493f-aa56-e980727d4df5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:27.384002 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-85ff28c5-afee-493f-aa56-e980727d4df5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.159976 Apr 08 11:32:27.384580 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1377/2313] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:27 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:27.388917 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-64ee3dd1-8268-4f11-bf43-5b542e36974b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:27.389524 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-64ee3dd1-8268-4f11-bf43-5b542e36974b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:27.395576 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-64ee3dd1-8268-4f11-bf43-5b542e36974b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:27.396029 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-64ee3dd1-8268-4f11-bf43-5b542e36974b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:27.396886 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-64ee3dd1-8268-4f11-bf43-5b542e36974b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:27.397329 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-64ee3dd1-8268-4f11-bf43-5b542e36974b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:27.455093 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-64ee3dd1-8268-4f11-bf43-5b542e36974b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:27.462658 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-64ee3dd1-8268-4f11-bf43-5b542e36974b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077106 Apr 08 11:32:27.463244 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1378/2314] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:27 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:28.401552 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9898201b-7338-4a7e-a97f-ef09514ca99c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:28.402246 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9898201b-7338-4a7e-a97f-ef09514ca99c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:28.409076 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9898201b-7338-4a7e-a97f-ef09514ca99c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:28.409532 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9898201b-7338-4a7e-a97f-ef09514ca99c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:28.410323 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9898201b-7338-4a7e-a97f-ef09514ca99c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:28.410767 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9898201b-7338-4a7e-a97f-ef09514ca99c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:28.546019 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9898201b-7338-4a7e-a97f-ef09514ca99c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:28.553994 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9898201b-7338-4a7e-a97f-ef09514ca99c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.156292 Apr 08 11:32:28.554582 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1379/2315] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:28 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:28.558955 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8e818904-8068-495b-91df-aa03dd93b868 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:28.559552 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8e818904-8068-495b-91df-aa03dd93b868 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:28.565056 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8e818904-8068-495b-91df-aa03dd93b868 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:28.565501 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8e818904-8068-495b-91df-aa03dd93b868 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:28.566290 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8e818904-8068-495b-91df-aa03dd93b868 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:28.566724 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8e818904-8068-495b-91df-aa03dd93b868 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:28.626315 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8e818904-8068-495b-91df-aa03dd93b868 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:28.633923 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8e818904-8068-495b-91df-aa03dd93b868 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078381 Apr 08 11:32:28.634506 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1380/2316] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:28 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:29.573255 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bca6e67f-0704-4306-8669-6210263981e0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:29.573255 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-bca6e67f-0704-4306-8669-6210263981e0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:29.579500 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bca6e67f-0704-4306-8669-6210263981e0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:29.579963 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bca6e67f-0704-4306-8669-6210263981e0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:29.580743 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bca6e67f-0704-4306-8669-6210263981e0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:29.581185 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bca6e67f-0704-4306-8669-6210263981e0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:29.721376 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-bca6e67f-0704-4306-8669-6210263981e0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:29.729275 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-bca6e67f-0704-4306-8669-6210263981e0 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.161512 Apr 08 11:32:29.729916 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1381/2317] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:29 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:29.734940 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8852a14e-0c37-4afa-a93f-3f8d9e46b778 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:29.737146 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8852a14e-0c37-4afa-a93f-3f8d9e46b778 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:29.741290 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8852a14e-0c37-4afa-a93f-3f8d9e46b778 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:29.741747 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8852a14e-0c37-4afa-a93f-3f8d9e46b778 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:29.742595 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8852a14e-0c37-4afa-a93f-3f8d9e46b778 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:29.743040 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8852a14e-0c37-4afa-a93f-3f8d9e46b778 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:29.807479 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8852a14e-0c37-4afa-a93f-3f8d9e46b778 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:29.815220 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8852a14e-0c37-4afa-a93f-3f8d9e46b778 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.084317 Apr 08 11:32:29.817535 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1382/2318] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:29 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:30.746212 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-19a11b5e-d16d-41bc-b72f-5050d3504029 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:30.746887 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-19a11b5e-d16d-41bc-b72f-5050d3504029 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:30.753138 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-19a11b5e-d16d-41bc-b72f-5050d3504029 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:30.753595 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-19a11b5e-d16d-41bc-b72f-5050d3504029 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:30.754409 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-19a11b5e-d16d-41bc-b72f-5050d3504029 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:30.754849 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-19a11b5e-d16d-41bc-b72f-5050d3504029 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:30.888141 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-19a11b5e-d16d-41bc-b72f-5050d3504029 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:30.895401 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-19a11b5e-d16d-41bc-b72f-5050d3504029 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.153285 Apr 08 11:32:30.896033 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1383/2319] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:30 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:30.900456 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7c6d7d5c-a0c6-45d4-961a-ff2ef6e31345 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:30.901060 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7c6d7d5c-a0c6-45d4-961a-ff2ef6e31345 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:30.906870 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7c6d7d5c-a0c6-45d4-961a-ff2ef6e31345 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:30.907329 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7c6d7d5c-a0c6-45d4-961a-ff2ef6e31345 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:30.908107 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7c6d7d5c-a0c6-45d4-961a-ff2ef6e31345 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:30.908559 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7c6d7d5c-a0c6-45d4-961a-ff2ef6e31345 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:30.971932 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7c6d7d5c-a0c6-45d4-961a-ff2ef6e31345 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:30.979425 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7c6d7d5c-a0c6-45d4-961a-ff2ef6e31345 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082477 Apr 08 11:32:30.980033 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1384/2320] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:30 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:32.023393 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4918b315-150e-4a1b-9cca-924b1eea3cc9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:32.024015 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4918b315-150e-4a1b-9cca-924b1eea3cc9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:32.030213 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4918b315-150e-4a1b-9cca-924b1eea3cc9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:32.030654 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4918b315-150e-4a1b-9cca-924b1eea3cc9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:32.031415 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4918b315-150e-4a1b-9cca-924b1eea3cc9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:32.031844 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4918b315-150e-4a1b-9cca-924b1eea3cc9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:32.171016 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4918b315-150e-4a1b-9cca-924b1eea3cc9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:32.179173 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4918b315-150e-4a1b-9cca-924b1eea3cc9 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.270598 Apr 08 11:32:32.179748 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1385/2321] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:31 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:32.184135 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8d43ccf6-3dee-4cc5-919e-458a288b4659 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:32.184739 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8d43ccf6-3dee-4cc5-919e-458a288b4659 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:32.190900 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8d43ccf6-3dee-4cc5-919e-458a288b4659 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:32.191338 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8d43ccf6-3dee-4cc5-919e-458a288b4659 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:32.192108 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8d43ccf6-3dee-4cc5-919e-458a288b4659 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:32.192551 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8d43ccf6-3dee-4cc5-919e-458a288b4659 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:32.252298 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8d43ccf6-3dee-4cc5-919e-458a288b4659 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:32.259757 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8d43ccf6-3dee-4cc5-919e-458a288b4659 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079073 Apr 08 11:32:32.260326 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1386/2322] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:32 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:33.196440 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-11d799fb-b236-46be-b553-8b88b41e7611 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:33.197149 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-11d799fb-b236-46be-b553-8b88b41e7611 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:33.203367 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-11d799fb-b236-46be-b553-8b88b41e7611 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:33.204333 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-11d799fb-b236-46be-b553-8b88b41e7611 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:33.205106 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-11d799fb-b236-46be-b553-8b88b41e7611 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:33.205549 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-11d799fb-b236-46be-b553-8b88b41e7611 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:33.337797 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-11d799fb-b236-46be-b553-8b88b41e7611 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:33.346033 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-11d799fb-b236-46be-b553-8b88b41e7611 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.153407 Apr 08 11:32:33.346609 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1387/2323] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:33 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:33.350995 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-efe58915-f0b4-44c9-b928-079bbfa91f1e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:33.351605 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-efe58915-f0b4-44c9-b928-079bbfa91f1e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:33.357311 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-efe58915-f0b4-44c9-b928-079bbfa91f1e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:33.357780 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-efe58915-f0b4-44c9-b928-079bbfa91f1e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:33.358554 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-efe58915-f0b4-44c9-b928-079bbfa91f1e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:33.358997 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-efe58915-f0b4-44c9-b928-079bbfa91f1e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:33.418512 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-efe58915-f0b4-44c9-b928-079bbfa91f1e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:33.425891 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-efe58915-f0b4-44c9-b928-079bbfa91f1e tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078274 Apr 08 11:32:33.426463 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1388/2324] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:33 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:34.363251 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c14566c7-1c65-482c-9b1f-054da7d2d71c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:34.363921 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c14566c7-1c65-482c-9b1f-054da7d2d71c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:34.370163 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c14566c7-1c65-482c-9b1f-054da7d2d71c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:34.370882 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c14566c7-1c65-482c-9b1f-054da7d2d71c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:34.371647 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c14566c7-1c65-482c-9b1f-054da7d2d71c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:34.372098 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c14566c7-1c65-482c-9b1f-054da7d2d71c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:34.511964 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c14566c7-1c65-482c-9b1f-054da7d2d71c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:34.519519 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c14566c7-1c65-482c-9b1f-054da7d2d71c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.160780 Apr 08 11:32:34.520094 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1389/2325] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:34 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:34.524558 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ea662a73-5c43-41a6-a60b-ae9981c25a6a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:34.525156 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ea662a73-5c43-41a6-a60b-ae9981c25a6a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:34.530977 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ea662a73-5c43-41a6-a60b-ae9981c25a6a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:34.531417 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ea662a73-5c43-41a6-a60b-ae9981c25a6a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:34.532689 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ea662a73-5c43-41a6-a60b-ae9981c25a6a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:34.533116 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ea662a73-5c43-41a6-a60b-ae9981c25a6a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:34.592784 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ea662a73-5c43-41a6-a60b-ae9981c25a6a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:34.601085 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ea662a73-5c43-41a6-a60b-ae9981c25a6a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080021 Apr 08 11:32:34.601672 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1390/2326] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:34 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:35.537087 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-70c66a61-ad40-403f-a42f-f73d577c0fa6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:35.537855 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-70c66a61-ad40-403f-a42f-f73d577c0fa6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:35.544058 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-70c66a61-ad40-403f-a42f-f73d577c0fa6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:35.544520 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-70c66a61-ad40-403f-a42f-f73d577c0fa6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:35.545294 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-70c66a61-ad40-403f-a42f-f73d577c0fa6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:35.545738 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-70c66a61-ad40-403f-a42f-f73d577c0fa6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:35.681943 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-70c66a61-ad40-403f-a42f-f73d577c0fa6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:35.689201 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-70c66a61-ad40-403f-a42f-f73d577c0fa6 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.155999 Apr 08 11:32:35.689759 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1391/2327] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:35 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:35.694259 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a9914347-0928-49c4-ac6d-f8f3849aa4a9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:35.694858 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a9914347-0928-49c4-ac6d-f8f3849aa4a9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:35.700513 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a9914347-0928-49c4-ac6d-f8f3849aa4a9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:35.700961 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a9914347-0928-49c4-ac6d-f8f3849aa4a9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:35.701719 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a9914347-0928-49c4-ac6d-f8f3849aa4a9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:35.702190 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a9914347-0928-49c4-ac6d-f8f3849aa4a9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:35.760546 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a9914347-0928-49c4-ac6d-f8f3849aa4a9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:35.768469 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a9914347-0928-49c4-ac6d-f8f3849aa4a9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077765 Apr 08 11:32:35.769026 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1392/2328] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:35 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:36.706384 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2986f9d5-5481-4f48-83df-4a7f40278455 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:36.707071 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2986f9d5-5481-4f48-83df-4a7f40278455 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:36.713428 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2986f9d5-5481-4f48-83df-4a7f40278455 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:36.713928 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2986f9d5-5481-4f48-83df-4a7f40278455 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:36.714711 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2986f9d5-5481-4f48-83df-4a7f40278455 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:36.715161 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2986f9d5-5481-4f48-83df-4a7f40278455 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:36.851167 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2986f9d5-5481-4f48-83df-4a7f40278455 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:36.858754 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2986f9d5-5481-4f48-83df-4a7f40278455 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.156863 Apr 08 11:32:36.859351 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1393/2329] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:36 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:36.864423 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-87f7ea72-f4cc-404a-b489-da66e4c72ee8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:36.865058 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-87f7ea72-f4cc-404a-b489-da66e4c72ee8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:36.882160 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-87f7ea72-f4cc-404a-b489-da66e4c72ee8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:36.882160 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-87f7ea72-f4cc-404a-b489-da66e4c72ee8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:36.882160 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-87f7ea72-f4cc-404a-b489-da66e4c72ee8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:36.882160 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-87f7ea72-f4cc-404a-b489-da66e4c72ee8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:36.935414 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-87f7ea72-f4cc-404a-b489-da66e4c72ee8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:36.942937 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-87f7ea72-f4cc-404a-b489-da66e4c72ee8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082071 Apr 08 11:32:36.943519 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1394/2330] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:36 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:37.877214 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0406b263-9967-4096-b65e-07ef3bdb3bcb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:37.877902 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0406b263-9967-4096-b65e-07ef3bdb3bcb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:37.884264 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0406b263-9967-4096-b65e-07ef3bdb3bcb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:37.884732 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0406b263-9967-4096-b65e-07ef3bdb3bcb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:37.885508 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0406b263-9967-4096-b65e-07ef3bdb3bcb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:37.885989 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0406b263-9967-4096-b65e-07ef3bdb3bcb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:38.025285 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0406b263-9967-4096-b65e-07ef3bdb3bcb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:38.037487 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0406b263-9967-4096-b65e-07ef3bdb3bcb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.164438 Apr 08 11:32:38.038122 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1395/2331] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:37 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:38.042729 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-115d8827-606c-4283-ac1c-6763f03aab0a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:38.043334 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-115d8827-606c-4283-ac1c-6763f03aab0a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:38.049973 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-115d8827-606c-4283-ac1c-6763f03aab0a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:38.050432 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-115d8827-606c-4283-ac1c-6763f03aab0a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:38.051201 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-115d8827-606c-4283-ac1c-6763f03aab0a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:38.051641 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-115d8827-606c-4283-ac1c-6763f03aab0a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:38.111127 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-115d8827-606c-4283-ac1c-6763f03aab0a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:38.119112 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-115d8827-606c-4283-ac1c-6763f03aab0a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079906 Apr 08 11:32:38.119721 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1396/2332] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:38 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:39.054553 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c482d499-3092-4606-8df6-e97b388d7e93 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:39.055236 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c482d499-3092-4606-8df6-e97b388d7e93 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:39.061568 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c482d499-3092-4606-8df6-e97b388d7e93 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:39.062055 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c482d499-3092-4606-8df6-e97b388d7e93 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:39.062829 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c482d499-3092-4606-8df6-e97b388d7e93 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:39.063268 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c482d499-3092-4606-8df6-e97b388d7e93 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:39.197424 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c482d499-3092-4606-8df6-e97b388d7e93 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:39.205649 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c482d499-3092-4606-8df6-e97b388d7e93 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.154935 Apr 08 11:32:39.206257 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1397/2333] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:39 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:39.210656 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-df990a14-f025-441c-b6f0-3023d0aa50f0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:39.211265 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-df990a14-f025-441c-b6f0-3023d0aa50f0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:39.216774 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-df990a14-f025-441c-b6f0-3023d0aa50f0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:39.217216 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-df990a14-f025-441c-b6f0-3023d0aa50f0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:39.217999 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-df990a14-f025-441c-b6f0-3023d0aa50f0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:39.218433 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-df990a14-f025-441c-b6f0-3023d0aa50f0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:39.282492 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-df990a14-f025-441c-b6f0-3023d0aa50f0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:39.289893 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-df990a14-f025-441c-b6f0-3023d0aa50f0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082669 Apr 08 11:32:39.290468 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1398/2334] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:39 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:40.223222 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1893a6b4-fe37-419b-9177-d81f578e9f5b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:40.223913 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1893a6b4-fe37-419b-9177-d81f578e9f5b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:40.230284 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1893a6b4-fe37-419b-9177-d81f578e9f5b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:40.230744 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1893a6b4-fe37-419b-9177-d81f578e9f5b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:40.231528 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1893a6b4-fe37-419b-9177-d81f578e9f5b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:40.231971 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1893a6b4-fe37-419b-9177-d81f578e9f5b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:40.368111 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1893a6b4-fe37-419b-9177-d81f578e9f5b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:40.375670 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1893a6b4-fe37-419b-9177-d81f578e9f5b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.156876 Apr 08 11:32:40.376240 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1399/2335] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:40 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:40.380634 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5673f903-b164-4fbd-bf59-772943b9c5e0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:40.381238 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5673f903-b164-4fbd-bf59-772943b9c5e0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:40.386764 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5673f903-b164-4fbd-bf59-772943b9c5e0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:40.387219 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5673f903-b164-4fbd-bf59-772943b9c5e0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:40.387986 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5673f903-b164-4fbd-bf59-772943b9c5e0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:40.388428 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5673f903-b164-4fbd-bf59-772943b9c5e0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:40.446405 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5673f903-b164-4fbd-bf59-772943b9c5e0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:40.453709 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5673f903-b164-4fbd-bf59-772943b9c5e0 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.076527 Apr 08 11:32:40.454304 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1400/2336] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:40 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:41.393268 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2af2538d-768e-4b64-a983-d8f909b58b94 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:41.393989 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2af2538d-768e-4b64-a983-d8f909b58b94 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:41.400453 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2af2538d-768e-4b64-a983-d8f909b58b94 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:41.400900 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2af2538d-768e-4b64-a983-d8f909b58b94 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:41.401667 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2af2538d-768e-4b64-a983-d8f909b58b94 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:41.402136 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2af2538d-768e-4b64-a983-d8f909b58b94 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:41.542903 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2af2538d-768e-4b64-a983-d8f909b58b94 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:41.550853 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2af2538d-768e-4b64-a983-d8f909b58b94 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.161964 Apr 08 11:32:41.551426 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1401/2337] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:41 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:41.555841 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0c6a97a1-97f4-4921-8fa1-27dea790200c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:41.556445 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0c6a97a1-97f4-4921-8fa1-27dea790200c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:41.561943 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0c6a97a1-97f4-4921-8fa1-27dea790200c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:41.562400 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0c6a97a1-97f4-4921-8fa1-27dea790200c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:41.563784 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0c6a97a1-97f4-4921-8fa1-27dea790200c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:41.564228 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0c6a97a1-97f4-4921-8fa1-27dea790200c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:41.622616 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0c6a97a1-97f4-4921-8fa1-27dea790200c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:41.630560 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0c6a97a1-97f4-4921-8fa1-27dea790200c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078195 Apr 08 11:32:41.631128 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1402/2338] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:41 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:42.568320 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bbdcb553-73a1-4edb-9db9-a52c8ba10dc5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:42.569004 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-bbdcb553-73a1-4edb-9db9-a52c8ba10dc5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:42.575510 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bbdcb553-73a1-4edb-9db9-a52c8ba10dc5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:42.575961 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bbdcb553-73a1-4edb-9db9-a52c8ba10dc5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:42.576745 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bbdcb553-73a1-4edb-9db9-a52c8ba10dc5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:42.577188 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bbdcb553-73a1-4edb-9db9-a52c8ba10dc5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:42.712402 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-bbdcb553-73a1-4edb-9db9-a52c8ba10dc5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:42.720788 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-bbdcb553-73a1-4edb-9db9-a52c8ba10dc5 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.156199 Apr 08 11:32:42.721381 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1403/2339] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:42 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:42.726498 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-08a8d1c7-3a63-4ee3-add8-60437f8a318b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:42.727211 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-08a8d1c7-3a63-4ee3-add8-60437f8a318b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:42.733807 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-08a8d1c7-3a63-4ee3-add8-60437f8a318b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:42.734273 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-08a8d1c7-3a63-4ee3-add8-60437f8a318b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:42.735081 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-08a8d1c7-3a63-4ee3-add8-60437f8a318b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:42.735550 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-08a8d1c7-3a63-4ee3-add8-60437f8a318b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:42.801826 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-08a8d1c7-3a63-4ee3-add8-60437f8a318b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:42.809623 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-08a8d1c7-3a63-4ee3-add8-60437f8a318b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.087077 Apr 08 11:32:42.810255 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1404/2340] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:42 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:43.739324 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-fd162a1a-96de-4bf8-ba4c-c45eb30f9de3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:43.740030 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-fd162a1a-96de-4bf8-ba4c-c45eb30f9de3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:43.746554 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fd162a1a-96de-4bf8-ba4c-c45eb30f9de3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:43.746997 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fd162a1a-96de-4bf8-ba4c-c45eb30f9de3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:43.747756 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fd162a1a-96de-4bf8-ba4c-c45eb30f9de3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:43.748189 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fd162a1a-96de-4bf8-ba4c-c45eb30f9de3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:43.884504 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-fd162a1a-96de-4bf8-ba4c-c45eb30f9de3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:43.898226 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-fd162a1a-96de-4bf8-ba4c-c45eb30f9de3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.162657 Apr 08 11:32:43.898739 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1405/2341] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:43 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:43.903110 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-01d58673-675c-4ade-9f35-7ebdc7ac151a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:43.903706 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-01d58673-675c-4ade-9f35-7ebdc7ac151a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:43.910039 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-01d58673-675c-4ade-9f35-7ebdc7ac151a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:43.910487 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-01d58673-675c-4ade-9f35-7ebdc7ac151a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:43.911275 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-01d58673-675c-4ade-9f35-7ebdc7ac151a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:43.911713 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-01d58673-675c-4ade-9f35-7ebdc7ac151a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:43.970042 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-01d58673-675c-4ade-9f35-7ebdc7ac151a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:43.977264 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-01d58673-675c-4ade-9f35-7ebdc7ac151a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077596 Apr 08 11:32:43.977853 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1406/2342] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:43 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:44.915878 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-243d91f9-b95e-442c-93f5-c14e106900ad tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:44.916521 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-243d91f9-b95e-442c-93f5-c14e106900ad tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:44.923304 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-243d91f9-b95e-442c-93f5-c14e106900ad tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:44.923749 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-243d91f9-b95e-442c-93f5-c14e106900ad tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:44.924511 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-243d91f9-b95e-442c-93f5-c14e106900ad tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:44.924947 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-243d91f9-b95e-442c-93f5-c14e106900ad tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:45.067436 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-243d91f9-b95e-442c-93f5-c14e106900ad tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:45.075214 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-243d91f9-b95e-442c-93f5-c14e106900ad tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.163248 Apr 08 11:32:45.075797 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1407/2343] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:44 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:45.081060 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3f2a6827-3d63-4c62-8a7a-8a45beb39444 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:45.081861 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3f2a6827-3d63-4c62-8a7a-8a45beb39444 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:45.087941 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3f2a6827-3d63-4c62-8a7a-8a45beb39444 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:45.088403 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3f2a6827-3d63-4c62-8a7a-8a45beb39444 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:45.089189 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3f2a6827-3d63-4c62-8a7a-8a45beb39444 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:45.089669 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3f2a6827-3d63-4c62-8a7a-8a45beb39444 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:45.158656 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3f2a6827-3d63-4c62-8a7a-8a45beb39444 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:45.166135 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3f2a6827-3d63-4c62-8a7a-8a45beb39444 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.089287 Apr 08 11:32:45.166671 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1408/2344] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:45 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:46.092413 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-41415eb0-2182-43d6-884d-76b76f259bd4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:46.093066 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-41415eb0-2182-43d6-884d-76b76f259bd4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:46.099741 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-41415eb0-2182-43d6-884d-76b76f259bd4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:46.100203 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-41415eb0-2182-43d6-884d-76b76f259bd4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:46.100995 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-41415eb0-2182-43d6-884d-76b76f259bd4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:46.101439 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-41415eb0-2182-43d6-884d-76b76f259bd4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:46.247281 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-41415eb0-2182-43d6-884d-76b76f259bd4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:46.255306 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-41415eb0-2182-43d6-884d-76b76f259bd4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.166789 Apr 08 11:32:46.255882 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1409/2345] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:46 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:46.260289 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a12e926b-e81f-4774-b583-8c1a14b29169 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:46.260892 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a12e926b-e81f-4774-b583-8c1a14b29169 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:46.266726 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a12e926b-e81f-4774-b583-8c1a14b29169 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:46.267196 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a12e926b-e81f-4774-b583-8c1a14b29169 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:46.267960 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a12e926b-e81f-4774-b583-8c1a14b29169 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:46.268394 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a12e926b-e81f-4774-b583-8c1a14b29169 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:46.327252 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a12e926b-e81f-4774-b583-8c1a14b29169 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:46.335027 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a12e926b-e81f-4774-b583-8c1a14b29169 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078178 Apr 08 11:32:46.335601 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1410/2346] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:46 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:47.273016 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-72f2ba02-9a1f-4703-bfd3-39e4b6e9f00b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:47.273747 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-72f2ba02-9a1f-4703-bfd3-39e4b6e9f00b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:47.280012 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-72f2ba02-9a1f-4703-bfd3-39e4b6e9f00b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:47.280466 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-72f2ba02-9a1f-4703-bfd3-39e4b6e9f00b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:47.281250 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-72f2ba02-9a1f-4703-bfd3-39e4b6e9f00b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:47.281667 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-72f2ba02-9a1f-4703-bfd3-39e4b6e9f00b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:47.417345 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-72f2ba02-9a1f-4703-bfd3-39e4b6e9f00b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:47.424899 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-72f2ba02-9a1f-4703-bfd3-39e4b6e9f00b tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.155769 Apr 08 11:32:47.425508 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1411/2347] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:47 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:47.430081 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5f87be7b-f5aa-4355-b5b5-701d38d9843d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:47.430734 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5f87be7b-f5aa-4355-b5b5-701d38d9843d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:47.436229 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5f87be7b-f5aa-4355-b5b5-701d38d9843d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:47.436670 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5f87be7b-f5aa-4355-b5b5-701d38d9843d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:47.437464 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5f87be7b-f5aa-4355-b5b5-701d38d9843d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:47.438033 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5f87be7b-f5aa-4355-b5b5-701d38d9843d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:47.497049 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5f87be7b-f5aa-4355-b5b5-701d38d9843d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:47.504592 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5f87be7b-f5aa-4355-b5b5-701d38d9843d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078097 Apr 08 11:32:47.505160 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1412/2348] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:47 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:48.442291 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ffde075b-c1f1-49b0-91db-64d6e74f45c4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:48.442988 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ffde075b-c1f1-49b0-91db-64d6e74f45c4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:48.449077 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ffde075b-c1f1-49b0-91db-64d6e74f45c4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:48.449528 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ffde075b-c1f1-49b0-91db-64d6e74f45c4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:48.450316 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ffde075b-c1f1-49b0-91db-64d6e74f45c4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:48.450751 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ffde075b-c1f1-49b0-91db-64d6e74f45c4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:48.595126 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ffde075b-c1f1-49b0-91db-64d6e74f45c4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:48.602569 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ffde075b-c1f1-49b0-91db-64d6e74f45c4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.164077 Apr 08 11:32:48.603262 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1413/2349] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:48 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:48.608035 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3500f4da-6e56-4400-b564-05ebf131a048 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:48.608645 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3500f4da-6e56-4400-b564-05ebf131a048 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:48.614896 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3500f4da-6e56-4400-b564-05ebf131a048 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:48.615350 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3500f4da-6e56-4400-b564-05ebf131a048 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:48.616121 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3500f4da-6e56-4400-b564-05ebf131a048 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:48.616562 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3500f4da-6e56-4400-b564-05ebf131a048 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:48.675694 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3500f4da-6e56-4400-b564-05ebf131a048 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:48.683064 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3500f4da-6e56-4400-b564-05ebf131a048 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078863 Apr 08 11:32:48.683639 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1414/2350] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:48 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:49.620262 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ecbf31b5-ab9a-4b1b-8878-1e6cad2d0b26 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:49.621175 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ecbf31b5-ab9a-4b1b-8878-1e6cad2d0b26 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:49.627479 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ecbf31b5-ab9a-4b1b-8878-1e6cad2d0b26 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:49.627932 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ecbf31b5-ab9a-4b1b-8878-1e6cad2d0b26 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:49.628701 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ecbf31b5-ab9a-4b1b-8878-1e6cad2d0b26 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:49.629144 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ecbf31b5-ab9a-4b1b-8878-1e6cad2d0b26 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:49.763764 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ecbf31b5-ab9a-4b1b-8878-1e6cad2d0b26 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:49.771314 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ecbf31b5-ab9a-4b1b-8878-1e6cad2d0b26 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.154877 Apr 08 11:32:49.771916 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1415/2351] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:49 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:49.776340 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5a780210-4d60-4e7d-8487-9e589beb30e6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:49.776976 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5a780210-4d60-4e7d-8487-9e589beb30e6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:49.782497 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5a780210-4d60-4e7d-8487-9e589beb30e6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:49.782949 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5a780210-4d60-4e7d-8487-9e589beb30e6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:49.783717 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5a780210-4d60-4e7d-8487-9e589beb30e6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:49.784159 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5a780210-4d60-4e7d-8487-9e589beb30e6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:49.842452 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5a780210-4d60-4e7d-8487-9e589beb30e6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:49.849793 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5a780210-4d60-4e7d-8487-9e589beb30e6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.076888 Apr 08 11:32:49.850403 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1416/2352] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:49 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:50.788218 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a89a3607-35de-431c-ae3d-7ab8bc14134c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:50.788869 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a89a3607-35de-431c-ae3d-7ab8bc14134c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:50.795164 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a89a3607-35de-431c-ae3d-7ab8bc14134c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:50.795614 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a89a3607-35de-431c-ae3d-7ab8bc14134c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:50.796383 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a89a3607-35de-431c-ae3d-7ab8bc14134c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:50.797466 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a89a3607-35de-431c-ae3d-7ab8bc14134c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:50.932940 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a89a3607-35de-431c-ae3d-7ab8bc14134c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:50.940268 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a89a3607-35de-431c-ae3d-7ab8bc14134c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.155978 Apr 08 11:32:50.940840 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1417/2353] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:50 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:50.945168 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-195c9aee-9f71-4ee7-9f54-78af1bd05129 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:50.945786 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-195c9aee-9f71-4ee7-9f54-78af1bd05129 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:50.951433 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-195c9aee-9f71-4ee7-9f54-78af1bd05129 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:50.951881 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-195c9aee-9f71-4ee7-9f54-78af1bd05129 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:50.952639 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-195c9aee-9f71-4ee7-9f54-78af1bd05129 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:50.953080 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-195c9aee-9f71-4ee7-9f54-78af1bd05129 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:51.012111 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-195c9aee-9f71-4ee7-9f54-78af1bd05129 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:51.019940 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-195c9aee-9f71-4ee7-9f54-78af1bd05129 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078130 Apr 08 11:32:51.020515 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1418/2354] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:50 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:51.900925 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 11:32:51.901543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:32:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 11:32:51.957549 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-98461230-7be2-487a-8777-2f1c8adb373f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:51.958186 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-98461230-7be2-487a-8777-2f1c8adb373f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:51.964443 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-98461230-7be2-487a-8777-2f1c8adb373f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:51.964894 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-98461230-7be2-487a-8777-2f1c8adb373f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:51.965666 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-98461230-7be2-487a-8777-2f1c8adb373f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:51.966222 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-98461230-7be2-487a-8777-2f1c8adb373f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:52.100988 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-98461230-7be2-487a-8777-2f1c8adb373f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:52.108531 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-98461230-7be2-487a-8777-2f1c8adb373f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.155269 Apr 08 11:32:52.109103 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1419/2355] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:51 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:52.114101 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-25233019-4326-473f-9091-9386b8f0f35a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:52.114712 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-25233019-4326-473f-9091-9386b8f0f35a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:52.120459 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-25233019-4326-473f-9091-9386b8f0f35a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:52.121239 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-25233019-4326-473f-9091-9386b8f0f35a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:52.122323 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-25233019-4326-473f-9091-9386b8f0f35a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:52.122496 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-25233019-4326-473f-9091-9386b8f0f35a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:52.185952 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-25233019-4326-473f-9091-9386b8f0f35a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:52.196127 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-25233019-4326-473f-9091-9386b8f0f35a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.085350 Apr 08 11:32:52.196710 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1420/2356] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:52 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:53.126276 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1982a711-735b-4f7d-98b6-880780ad272f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:53.127002 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1982a711-735b-4f7d-98b6-880780ad272f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:53.133258 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1982a711-735b-4f7d-98b6-880780ad272f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:53.133719 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1982a711-735b-4f7d-98b6-880780ad272f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:53.134536 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1982a711-735b-4f7d-98b6-880780ad272f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:53.134980 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1982a711-735b-4f7d-98b6-880780ad272f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:53.277355 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1982a711-735b-4f7d-98b6-880780ad272f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:53.284839 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1982a711-735b-4f7d-98b6-880780ad272f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.163140 Apr 08 11:32:53.285437 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1421/2357] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:53 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:53.289749 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-64a62a27-1a89-4ce7-b383-f9fce6caca0b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:53.290380 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-64a62a27-1a89-4ce7-b383-f9fce6caca0b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:53.295823 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-64a62a27-1a89-4ce7-b383-f9fce6caca0b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:53.296276 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-64a62a27-1a89-4ce7-b383-f9fce6caca0b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:53.297052 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-64a62a27-1a89-4ce7-b383-f9fce6caca0b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:53.297493 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-64a62a27-1a89-4ce7-b383-f9fce6caca0b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:53.355941 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-64a62a27-1a89-4ce7-b383-f9fce6caca0b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:53.363795 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-64a62a27-1a89-4ce7-b383-f9fce6caca0b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077398 Apr 08 11:32:53.364374 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1422/2358] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:53 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:54.302569 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1da1e31c-8167-42a0-870e-4160c91ec8bb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:54.303194 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1da1e31c-8167-42a0-870e-4160c91ec8bb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:54.309354 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1da1e31c-8167-42a0-870e-4160c91ec8bb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:54.309825 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1da1e31c-8167-42a0-870e-4160c91ec8bb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:54.310583 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1da1e31c-8167-42a0-870e-4160c91ec8bb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:54.311013 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1da1e31c-8167-42a0-870e-4160c91ec8bb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:54.446630 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1da1e31c-8167-42a0-870e-4160c91ec8bb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:54.454102 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1da1e31c-8167-42a0-870e-4160c91ec8bb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.155381 Apr 08 11:32:54.454673 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1423/2359] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:54 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:54.459257 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0e67864f-4675-4ed7-932c-acc0d54903c9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:54.459857 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0e67864f-4675-4ed7-932c-acc0d54903c9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:54.465463 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0e67864f-4675-4ed7-932c-acc0d54903c9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:54.465940 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0e67864f-4675-4ed7-932c-acc0d54903c9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:54.466697 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0e67864f-4675-4ed7-932c-acc0d54903c9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:54.467128 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0e67864f-4675-4ed7-932c-acc0d54903c9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:54.525538 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0e67864f-4675-4ed7-932c-acc0d54903c9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:54.533372 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0e67864f-4675-4ed7-932c-acc0d54903c9 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077767 Apr 08 11:32:54.533961 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1424/2360] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:54 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:55.472886 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-59d2db08-a116-474f-98ad-ce11f4b3f0dc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:55.473577 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-59d2db08-a116-474f-98ad-ce11f4b3f0dc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:55.479711 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-59d2db08-a116-474f-98ad-ce11f4b3f0dc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:55.480157 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-59d2db08-a116-474f-98ad-ce11f4b3f0dc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:55.480914 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-59d2db08-a116-474f-98ad-ce11f4b3f0dc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:55.481345 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-59d2db08-a116-474f-98ad-ce11f4b3f0dc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:55.614372 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-59d2db08-a116-474f-98ad-ce11f4b3f0dc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:55.622217 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-59d2db08-a116-474f-98ad-ce11f4b3f0dc tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.153131 Apr 08 11:32:55.622792 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1425/2361] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:55 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:55.627153 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c975850c-5c56-432d-afa3-d0c89094a78d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:55.629226 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c975850c-5c56-432d-afa3-d0c89094a78d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:55.633694 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c975850c-5c56-432d-afa3-d0c89094a78d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:55.634182 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c975850c-5c56-432d-afa3-d0c89094a78d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:55.634956 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c975850c-5c56-432d-afa3-d0c89094a78d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:55.635398 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c975850c-5c56-432d-afa3-d0c89094a78d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:55.697613 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c975850c-5c56-432d-afa3-d0c89094a78d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:55.705565 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c975850c-5c56-432d-afa3-d0c89094a78d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081823 Apr 08 11:32:55.706170 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1426/2362] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:55 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:56.639473 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-738db3b8-426f-4574-9ef2-2a768cb76e5c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:56.640124 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-738db3b8-426f-4574-9ef2-2a768cb76e5c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:56.647049 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-738db3b8-426f-4574-9ef2-2a768cb76e5c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:56.647508 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-738db3b8-426f-4574-9ef2-2a768cb76e5c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:56.648292 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-738db3b8-426f-4574-9ef2-2a768cb76e5c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:56.648735 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-738db3b8-426f-4574-9ef2-2a768cb76e5c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:56.783152 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-738db3b8-426f-4574-9ef2-2a768cb76e5c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:56.790503 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-738db3b8-426f-4574-9ef2-2a768cb76e5c tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.154859 Apr 08 11:32:56.791073 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1427/2363] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:56 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:56.795396 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a8fa3b52-4647-4616-98d4-2e3bc0d6d17d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:56.796006 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a8fa3b52-4647-4616-98d4-2e3bc0d6d17d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:56.801883 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a8fa3b52-4647-4616-98d4-2e3bc0d6d17d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:56.802329 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a8fa3b52-4647-4616-98d4-2e3bc0d6d17d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:56.803092 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a8fa3b52-4647-4616-98d4-2e3bc0d6d17d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:56.803527 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a8fa3b52-4647-4616-98d4-2e3bc0d6d17d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:56.861590 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a8fa3b52-4647-4616-98d4-2e3bc0d6d17d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:56.869070 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a8fa3b52-4647-4616-98d4-2e3bc0d6d17d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077029 Apr 08 11:32:56.869645 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1428/2364] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:56 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:57.807761 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c7c7098f-0f32-4164-9ce9-08fafdf69921 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:57.808443 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c7c7098f-0f32-4164-9ce9-08fafdf69921 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:57.815276 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c7c7098f-0f32-4164-9ce9-08fafdf69921 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:57.815733 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c7c7098f-0f32-4164-9ce9-08fafdf69921 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:57.816503 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c7c7098f-0f32-4164-9ce9-08fafdf69921 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:57.816944 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c7c7098f-0f32-4164-9ce9-08fafdf69921 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:57.954913 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c7c7098f-0f32-4164-9ce9-08fafdf69921 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:57.962198 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c7c7098f-0f32-4164-9ce9-08fafdf69921 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.158307 Apr 08 11:32:57.962759 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1429/2365] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:57 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:57.967206 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2722a29b-c50e-4b54-b1da-5e3ec0ba5a3a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:57.967804 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2722a29b-c50e-4b54-b1da-5e3ec0ba5a3a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:57.974448 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2722a29b-c50e-4b54-b1da-5e3ec0ba5a3a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:57.974915 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2722a29b-c50e-4b54-b1da-5e3ec0ba5a3a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:57.975857 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2722a29b-c50e-4b54-b1da-5e3ec0ba5a3a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:57.976431 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2722a29b-c50e-4b54-b1da-5e3ec0ba5a3a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:58.046224 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2722a29b-c50e-4b54-b1da-5e3ec0ba5a3a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:58.054173 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2722a29b-c50e-4b54-b1da-5e3ec0ba5a3a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.090427 Apr 08 11:32:58.054755 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1430/2366] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:57 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:32:58.980733 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-fe57e1f6-f082-41a3-9d35-f8c3ba2f2250 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:58.981417 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-fe57e1f6-f082-41a3-9d35-f8c3ba2f2250 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:58.987791 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fe57e1f6-f082-41a3-9d35-f8c3ba2f2250 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:58.988241 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fe57e1f6-f082-41a3-9d35-f8c3ba2f2250 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:58.989076 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fe57e1f6-f082-41a3-9d35-f8c3ba2f2250 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:58.989576 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fe57e1f6-f082-41a3-9d35-f8c3ba2f2250 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:59.128436 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-fe57e1f6-f082-41a3-9d35-f8c3ba2f2250 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:59.135904 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-fe57e1f6-f082-41a3-9d35-f8c3ba2f2250 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.159368 Apr 08 11:32:59.136472 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1431/2367] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:58 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:32:59.141491 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6d9ddd25-f72f-46b9-8257-9cd9323b0d41 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:32:59.142111 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6d9ddd25-f72f-46b9-8257-9cd9323b0d41 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:32:59.147802 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6d9ddd25-f72f-46b9-8257-9cd9323b0d41 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:59.148250 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6d9ddd25-f72f-46b9-8257-9cd9323b0d41 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:59.149008 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6d9ddd25-f72f-46b9-8257-9cd9323b0d41 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:32:59.149442 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6d9ddd25-f72f-46b9-8257-9cd9323b0d41 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:32:59.207315 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6d9ddd25-f72f-46b9-8257-9cd9323b0d41 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:32:59.214573 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6d9ddd25-f72f-46b9-8257-9cd9323b0d41 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077176 Apr 08 11:32:59.215138 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1432/2368] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:32:59 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:33:00.153452 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-be699ed6-fab3-4b40-bde8-de4baea6f942 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:00.154154 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-be699ed6-fab3-4b40-bde8-de4baea6f942 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:00.161218 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-be699ed6-fab3-4b40-bde8-de4baea6f942 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:00.161673 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-be699ed6-fab3-4b40-bde8-de4baea6f942 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:00.162482 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-be699ed6-fab3-4b40-bde8-de4baea6f942 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:00.162926 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-be699ed6-fab3-4b40-bde8-de4baea6f942 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:00.300257 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-be699ed6-fab3-4b40-bde8-de4baea6f942 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:00.307567 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-be699ed6-fab3-4b40-bde8-de4baea6f942 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.158004 Apr 08 11:33:00.308131 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1433/2369] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:00 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:33:00.312414 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b91b9903-5eba-49cf-835b-d551c89c3f40 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:00.313007 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b91b9903-5eba-49cf-835b-d551c89c3f40 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:00.318586 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b91b9903-5eba-49cf-835b-d551c89c3f40 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:00.319032 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b91b9903-5eba-49cf-835b-d551c89c3f40 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:00.319789 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b91b9903-5eba-49cf-835b-d551c89c3f40 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:00.320220 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b91b9903-5eba-49cf-835b-d551c89c3f40 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:00.378485 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b91b9903-5eba-49cf-835b-d551c89c3f40 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:00.385888 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b91b9903-5eba-49cf-835b-d551c89c3f40 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.076806 Apr 08 11:33:00.386447 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1434/2370] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:00 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:33:01.324734 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-fa041b23-a5f1-46f5-bca6-3948f8eac0b8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:01.325434 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-fa041b23-a5f1-46f5-bca6-3948f8eac0b8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:01.331817 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fa041b23-a5f1-46f5-bca6-3948f8eac0b8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:01.332270 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fa041b23-a5f1-46f5-bca6-3948f8eac0b8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:01.333049 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fa041b23-a5f1-46f5-bca6-3948f8eac0b8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:01.333488 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fa041b23-a5f1-46f5-bca6-3948f8eac0b8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:01.469017 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-fa041b23-a5f1-46f5-bca6-3948f8eac0b8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:01.476533 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-fa041b23-a5f1-46f5-bca6-3948f8eac0b8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.155686 Apr 08 11:33:01.477104 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1435/2371] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:01 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:33:01.481469 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5645b9e3-89e0-4ee7-9664-90569859fecf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:01.482101 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5645b9e3-89e0-4ee7-9664-90569859fecf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:01.488397 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5645b9e3-89e0-4ee7-9664-90569859fecf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:01.488855 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5645b9e3-89e0-4ee7-9664-90569859fecf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:01.489626 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5645b9e3-89e0-4ee7-9664-90569859fecf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:01.490098 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5645b9e3-89e0-4ee7-9664-90569859fecf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:01.552695 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5645b9e3-89e0-4ee7-9664-90569859fecf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:01.561356 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5645b9e3-89e0-4ee7-9664-90569859fecf tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.083272 Apr 08 11:33:01.561955 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1436/2372] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:01 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:33:02.494072 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9b214da8-10fa-4ff0-a48f-5e34c2610d70 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:02.494777 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9b214da8-10fa-4ff0-a48f-5e34c2610d70 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:02.501500 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9b214da8-10fa-4ff0-a48f-5e34c2610d70 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:02.501923 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9b214da8-10fa-4ff0-a48f-5e34c2610d70 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:02.502705 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9b214da8-10fa-4ff0-a48f-5e34c2610d70 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:02.503148 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9b214da8-10fa-4ff0-a48f-5e34c2610d70 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:02.637793 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9b214da8-10fa-4ff0-a48f-5e34c2610d70 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:02.646103 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9b214da8-10fa-4ff0-a48f-5e34c2610d70 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.155775 Apr 08 11:33:02.646445 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1437/2373] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:02 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:33:02.650868 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5b105318-7257-4396-8f52-0590d46b54a5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:02.651469 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5b105318-7257-4396-8f52-0590d46b54a5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:02.658042 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5b105318-7257-4396-8f52-0590d46b54a5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:02.658485 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5b105318-7257-4396-8f52-0590d46b54a5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:02.659297 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5b105318-7257-4396-8f52-0590d46b54a5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:02.659765 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5b105318-7257-4396-8f52-0590d46b54a5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:02.719609 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5b105318-7257-4396-8f52-0590d46b54a5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:02.727059 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5b105318-7257-4396-8f52-0590d46b54a5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079666 Apr 08 11:33:02.727637 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1438/2374] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:02 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:33:03.663205 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-dfe7b5f0-d415-43e9-b700-452d4d743f9f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:03.663826 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-dfe7b5f0-d415-43e9-b700-452d4d743f9f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:03.670141 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dfe7b5f0-d415-43e9-b700-452d4d743f9f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:03.670596 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dfe7b5f0-d415-43e9-b700-452d4d743f9f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:03.671361 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dfe7b5f0-d415-43e9-b700-452d4d743f9f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:03.672416 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dfe7b5f0-d415-43e9-b700-452d4d743f9f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:03.808277 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-dfe7b5f0-d415-43e9-b700-452d4d743f9f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:03.815629 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-dfe7b5f0-d415-43e9-b700-452d4d743f9f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.156321 Apr 08 11:33:03.816233 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1439/2375] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:03 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:33:03.820597 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-94555ae8-9d1e-4fc6-a6de-e5b913e79ff5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:03.821198 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-94555ae8-9d1e-4fc6-a6de-e5b913e79ff5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:03.826755 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-94555ae8-9d1e-4fc6-a6de-e5b913e79ff5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:03.827204 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-94555ae8-9d1e-4fc6-a6de-e5b913e79ff5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:03.827968 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-94555ae8-9d1e-4fc6-a6de-e5b913e79ff5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:03.828407 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-94555ae8-9d1e-4fc6-a6de-e5b913e79ff5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:03.886835 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-94555ae8-9d1e-4fc6-a6de-e5b913e79ff5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:03.894640 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-94555ae8-9d1e-4fc6-a6de-e5b913e79ff5 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077407 Apr 08 11:33:03.895153 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1440/2376] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:03 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:33:04.833070 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-244f35ae-5371-4334-8842-36837f581716 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:04.833733 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-244f35ae-5371-4334-8842-36837f581716 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:04.840078 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-244f35ae-5371-4334-8842-36837f581716 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:04.840537 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-244f35ae-5371-4334-8842-36837f581716 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:04.841315 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-244f35ae-5371-4334-8842-36837f581716 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:04.841756 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-244f35ae-5371-4334-8842-36837f581716 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:04.973264 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-244f35ae-5371-4334-8842-36837f581716 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:04.980613 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-244f35ae-5371-4334-8842-36837f581716 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.151487 Apr 08 11:33:04.981178 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1441/2377] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:04 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:33:04.985623 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bcbaef73-e4b9-4be6-a085-20b82dd7fc80 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:04.986255 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-bcbaef73-e4b9-4be6-a085-20b82dd7fc80 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:04.991820 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bcbaef73-e4b9-4be6-a085-20b82dd7fc80 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:04.992261 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bcbaef73-e4b9-4be6-a085-20b82dd7fc80 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:04.993016 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bcbaef73-e4b9-4be6-a085-20b82dd7fc80 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:04.993449 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bcbaef73-e4b9-4be6-a085-20b82dd7fc80 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:05.057029 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-bcbaef73-e4b9-4be6-a085-20b82dd7fc80 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:05.065197 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-bcbaef73-e4b9-4be6-a085-20b82dd7fc80 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.083067 Apr 08 11:33:05.065759 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1442/2378] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:04 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:33:05.998081 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-990dc06d-f340-4342-b440-bf7ff45d1cc3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:05.998745 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-990dc06d-f340-4342-b440-bf7ff45d1cc3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:06.004898 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-990dc06d-f340-4342-b440-bf7ff45d1cc3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:06.005355 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-990dc06d-f340-4342-b440-bf7ff45d1cc3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:06.006155 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-990dc06d-f340-4342-b440-bf7ff45d1cc3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:06.006600 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-990dc06d-f340-4342-b440-bf7ff45d1cc3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:06.139217 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-990dc06d-f340-4342-b440-bf7ff45d1cc3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:06.147032 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-990dc06d-f340-4342-b440-bf7ff45d1cc3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.153175 Apr 08 11:33:06.147615 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1443/2379] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:05 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:33:06.152061 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b8ef378c-2221-4dd4-a7b5-9527d711e020 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:06.152658 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b8ef378c-2221-4dd4-a7b5-9527d711e020 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:06.158802 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b8ef378c-2221-4dd4-a7b5-9527d711e020 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:06.159248 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b8ef378c-2221-4dd4-a7b5-9527d711e020 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:06.160000 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b8ef378c-2221-4dd4-a7b5-9527d711e020 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:06.160433 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b8ef378c-2221-4dd4-a7b5-9527d711e020 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:06.217856 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b8ef378c-2221-4dd4-a7b5-9527d711e020 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:06.225795 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b8ef378c-2221-4dd4-a7b5-9527d711e020 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.077212 Apr 08 11:33:06.226386 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1444/2380] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:06 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:33:07.164665 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-adaa64f3-051b-4411-a3c7-c6a159d3f7f3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:07.165378 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-adaa64f3-051b-4411-a3c7-c6a159d3f7f3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:07.172012 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-adaa64f3-051b-4411-a3c7-c6a159d3f7f3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:07.172454 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-adaa64f3-051b-4411-a3c7-c6a159d3f7f3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:07.173206 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-adaa64f3-051b-4411-a3c7-c6a159d3f7f3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:07.173634 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-adaa64f3-051b-4411-a3c7-c6a159d3f7f3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:07.310525 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-adaa64f3-051b-4411-a3c7-c6a159d3f7f3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:07.317853 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-adaa64f3-051b-4411-a3c7-c6a159d3f7f3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.157013 Apr 08 11:33:07.318422 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1445/2381] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:07 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:33:07.322927 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7a784b58-c9a7-4faf-9975-d274d73f1e2b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:07.323526 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7a784b58-c9a7-4faf-9975-d274d73f1e2b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:07.328944 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7a784b58-c9a7-4faf-9975-d274d73f1e2b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:07.329402 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7a784b58-c9a7-4faf-9975-d274d73f1e2b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:07.330187 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7a784b58-c9a7-4faf-9975-d274d73f1e2b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:07.330626 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7a784b58-c9a7-4faf-9975-d274d73f1e2b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:07.390367 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7a784b58-c9a7-4faf-9975-d274d73f1e2b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:07.397605 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7a784b58-c9a7-4faf-9975-d274d73f1e2b tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.078242 Apr 08 11:33:07.398211 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1446/2382] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:07 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:33:08.335079 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9bf5b054-064e-4e3b-bca8-10e9550cdcc2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:08.335754 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9bf5b054-064e-4e3b-bca8-10e9550cdcc2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:08.342279 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9bf5b054-064e-4e3b-bca8-10e9550cdcc2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:08.342738 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9bf5b054-064e-4e3b-bca8-10e9550cdcc2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:08.344046 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9bf5b054-064e-4e3b-bca8-10e9550cdcc2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:08.344487 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9bf5b054-064e-4e3b-bca8-10e9550cdcc2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:08.480930 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9bf5b054-064e-4e3b-bca8-10e9550cdcc2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:08.488572 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9bf5b054-064e-4e3b-bca8-10e9550cdcc2 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.157446 Apr 08 11:33:08.489203 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1447/2383] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:08 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:33:08.494075 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f8e86b1b-5119-451f-9e82-ac2172db70d3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:08.494710 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f8e86b1b-5119-451f-9e82-ac2172db70d3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:08.501212 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f8e86b1b-5119-451f-9e82-ac2172db70d3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:08.501613 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f8e86b1b-5119-451f-9e82-ac2172db70d3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:08.502439 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f8e86b1b-5119-451f-9e82-ac2172db70d3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:08.502882 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f8e86b1b-5119-451f-9e82-ac2172db70d3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:08.566583 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f8e86b1b-5119-451f-9e82-ac2172db70d3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:08.574462 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f8e86b1b-5119-451f-9e82-ac2172db70d3 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.084205 Apr 08 11:33:08.575062 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1448/2384] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:08 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:33:09.506138 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9353efed-f4f8-439e-a48f-8136d0ecbc6d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:09.506848 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9353efed-f4f8-439e-a48f-8136d0ecbc6d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:09.513591 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9353efed-f4f8-439e-a48f-8136d0ecbc6d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:09.514075 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9353efed-f4f8-439e-a48f-8136d0ecbc6d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:09.514932 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9353efed-f4f8-439e-a48f-8136d0ecbc6d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:09.515374 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9353efed-f4f8-439e-a48f-8136d0ecbc6d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:09.672604 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9353efed-f4f8-439e-a48f-8136d0ecbc6d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:09.680052 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9353efed-f4f8-439e-a48f-8136d0ecbc6d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.177769 Apr 08 11:33:09.680634 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1449/2385] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:09 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:33:09.685141 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2874275e-528a-41f2-b32b-0027ed8dd47a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:09.685784 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2874275e-528a-41f2-b32b-0027ed8dd47a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:09.691850 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2874275e-528a-41f2-b32b-0027ed8dd47a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:09.692307 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2874275e-528a-41f2-b32b-0027ed8dd47a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:09.693117 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2874275e-528a-41f2-b32b-0027ed8dd47a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:09.693560 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2874275e-528a-41f2-b32b-0027ed8dd47a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:09.755974 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2874275e-528a-41f2-b32b-0027ed8dd47a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:09.763615 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2874275e-528a-41f2-b32b-0027ed8dd47a tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.081958 Apr 08 11:33:09.764107 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1450/2386] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:09 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:33:10.696518 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9f6fa135-a66d-4ea3-b0f4-177e756abcdb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:10.697170 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9f6fa135-a66d-4ea3-b0f4-177e756abcdb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:10.703995 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9f6fa135-a66d-4ea3-b0f4-177e756abcdb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:10.704450 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9f6fa135-a66d-4ea3-b0f4-177e756abcdb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:10.705228 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9f6fa135-a66d-4ea3-b0f4-177e756abcdb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:10.705674 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9f6fa135-a66d-4ea3-b0f4-177e756abcdb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:10.845463 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9f6fa135-a66d-4ea3-b0f4-177e756abcdb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:10.853231 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9f6fa135-a66d-4ea3-b0f4-177e756abcdb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.160550 Apr 08 11:33:10.853823 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1451/2387] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:10 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:33:10.858291 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-54464291-ec08-4f9c-8b16-b5fe651c30eb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:10.859419 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-54464291-ec08-4f9c-8b16-b5fe651c30eb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:10.866304 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-54464291-ec08-4f9c-8b16-b5fe651c30eb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:10.866751 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-54464291-ec08-4f9c-8b16-b5fe651c30eb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:10.867523 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-54464291-ec08-4f9c-8b16-b5fe651c30eb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:10.867961 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-54464291-ec08-4f9c-8b16-b5fe651c30eb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:10.929123 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-54464291-ec08-4f9c-8b16-b5fe651c30eb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:10.937744 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-54464291-ec08-4f9c-8b16-b5fe651c30eb tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082359 Apr 08 11:33:10.938354 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1452/2388] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:10 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:33:11.870381 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6e1acae3-6d40-4e27-855b-e69d1f3f3e61 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:11.871358 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6e1acae3-6d40-4e27-855b-e69d1f3f3e61 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:11.878135 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6e1acae3-6d40-4e27-855b-e69d1f3f3e61 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:11.878593 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6e1acae3-6d40-4e27-855b-e69d1f3f3e61 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:11.879371 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6e1acae3-6d40-4e27-855b-e69d1f3f3e61 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:11.879812 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6e1acae3-6d40-4e27-855b-e69d1f3f3e61 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:12.016590 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6e1acae3-6d40-4e27-855b-e69d1f3f3e61 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:12.027228 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6e1acae3-6d40-4e27-855b-e69d1f3f3e61 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.160595 Apr 08 11:33:12.027824 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1453/2389] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:11 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:33:12.032460 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ef51f15c-f0c7-4eb8-9370-668320563b58 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:12.033070 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ef51f15c-f0c7-4eb8-9370-668320563b58 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:12.040644 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ef51f15c-f0c7-4eb8-9370-668320563b58 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:12.041095 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ef51f15c-f0c7-4eb8-9370-668320563b58 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:12.041915 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ef51f15c-f0c7-4eb8-9370-668320563b58 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:12.042354 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ef51f15c-f0c7-4eb8-9370-668320563b58 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:12.104896 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ef51f15c-f0c7-4eb8-9370-668320563b58 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:12.112992 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ef51f15c-f0c7-4eb8-9370-668320563b58 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.084160 Apr 08 11:33:12.113572 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1454/2390] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:12 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:33:13.049839 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-202a3c5d-d3e7-43ea-85a7-0fd91c069a59 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:13.050905 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-202a3c5d-d3e7-43ea-85a7-0fd91c069a59 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:13.057073 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-202a3c5d-d3e7-43ea-85a7-0fd91c069a59 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:13.057522 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-202a3c5d-d3e7-43ea-85a7-0fd91c069a59 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:13.058330 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-202a3c5d-d3e7-43ea-85a7-0fd91c069a59 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:13.058766 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-202a3c5d-d3e7-43ea-85a7-0fd91c069a59 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:13.204230 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-202a3c5d-d3e7-43ea-85a7-0fd91c069a59 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:13.212143 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-202a3c5d-d3e7-43ea-85a7-0fd91c069a59 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.166119 Apr 08 11:33:13.212770 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1455/2391] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:13 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:33:13.217353 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3de743b6-89d4-490e-8ebf-35304515d629 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:13.218028 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3de743b6-89d4-490e-8ebf-35304515d629 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:13.224817 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3de743b6-89d4-490e-8ebf-35304515d629 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:13.225296 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3de743b6-89d4-490e-8ebf-35304515d629 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:13.226157 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3de743b6-89d4-490e-8ebf-35304515d629 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:13.226604 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3de743b6-89d4-490e-8ebf-35304515d629 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:13.290602 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3de743b6-89d4-490e-8ebf-35304515d629 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:13.298410 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3de743b6-89d4-490e-8ebf-35304515d629 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.084643 Apr 08 11:33:13.298992 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1456/2392] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:13 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:33:14.230736 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-616dd5ab-3b91-4990-8402-1a1411691abe tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:14.231460 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-616dd5ab-3b91-4990-8402-1a1411691abe tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:14.238794 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-616dd5ab-3b91-4990-8402-1a1411691abe tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:14.239240 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-616dd5ab-3b91-4990-8402-1a1411691abe tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:14.240024 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-616dd5ab-3b91-4990-8402-1a1411691abe tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:14.240461 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-616dd5ab-3b91-4990-8402-1a1411691abe tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:14.394809 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-616dd5ab-3b91-4990-8402-1a1411691abe tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:14.402426 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-616dd5ab-3b91-4990-8402-1a1411691abe tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.175736 Apr 08 11:33:14.403005 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1457/2393] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:14 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:33:14.408057 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-49d04747-9fa3-49e5-b7c8-054c75ecc38d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:14.408662 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-49d04747-9fa3-49e5-b7c8-054c75ecc38d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:14.414609 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-49d04747-9fa3-49e5-b7c8-054c75ecc38d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:14.415055 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-49d04747-9fa3-49e5-b7c8-054c75ecc38d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:14.415834 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-49d04747-9fa3-49e5-b7c8-054c75ecc38d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:14.416270 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-49d04747-9fa3-49e5-b7c8-054c75ecc38d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:14.476929 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-49d04747-9fa3-49e5-b7c8-054c75ecc38d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:14.484728 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-49d04747-9fa3-49e5-b7c8-054c75ecc38d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.080673 Apr 08 11:33:14.485273 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1458/2394] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:14 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:33:15.420341 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-619bd606-46ed-4068-a11b-24ad3c2fc72f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:15.421974 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-619bd606-46ed-4068-a11b-24ad3c2fc72f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:15.428317 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-619bd606-46ed-4068-a11b-24ad3c2fc72f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:15.428770 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-619bd606-46ed-4068-a11b-24ad3c2fc72f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:15.429559 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-619bd606-46ed-4068-a11b-24ad3c2fc72f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:15.430034 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-619bd606-46ed-4068-a11b-24ad3c2fc72f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:15.574145 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-619bd606-46ed-4068-a11b-24ad3c2fc72f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:15.584288 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-619bd606-46ed-4068-a11b-24ad3c2fc72f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.167750 Apr 08 11:33:15.584897 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1459/2395] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:15 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:33:15.589488 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-215db312-f6eb-4655-861a-d693234dcebe tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:15.590119 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-215db312-f6eb-4655-861a-d693234dcebe tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:15.597084 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-215db312-f6eb-4655-861a-d693234dcebe tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:15.597531 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-215db312-f6eb-4655-861a-d693234dcebe tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:15.598350 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-215db312-f6eb-4655-861a-d693234dcebe tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:15.598784 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-215db312-f6eb-4655-861a-d693234dcebe tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:15.660314 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-215db312-f6eb-4655-861a-d693234dcebe tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:15.670061 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-215db312-f6eb-4655-861a-d693234dcebe tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.084045 Apr 08 11:33:15.670995 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1460/2396] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:15 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:33:16.604256 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e6e33d77-47fe-4ce4-a2cb-6d61f9aeea3d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:16.605248 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e6e33d77-47fe-4ce4-a2cb-6d61f9aeea3d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:16.615586 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e6e33d77-47fe-4ce4-a2cb-6d61f9aeea3d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:16.616230 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e6e33d77-47fe-4ce4-a2cb-6d61f9aeea3d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:16.617247 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e6e33d77-47fe-4ce4-a2cb-6d61f9aeea3d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:16.617754 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e6e33d77-47fe-4ce4-a2cb-6d61f9aeea3d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:16.786611 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e6e33d77-47fe-4ce4-a2cb-6d61f9aeea3d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:16.794252 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e6e33d77-47fe-4ce4-a2cb-6d61f9aeea3d tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.195111 Apr 08 11:33:16.794825 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1461/2397] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:16 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:33:16.800166 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ff9fa1eb-a144-43fc-9ce1-e02ca5319af8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:16.800805 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ff9fa1eb-a144-43fc-9ce1-e02ca5319af8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:16.806608 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ff9fa1eb-a144-43fc-9ce1-e02ca5319af8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:16.807064 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ff9fa1eb-a144-43fc-9ce1-e02ca5319af8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:16.807841 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ff9fa1eb-a144-43fc-9ce1-e02ca5319af8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:16.808316 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ff9fa1eb-a144-43fc-9ce1-e02ca5319af8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:16.870208 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ff9fa1eb-a144-43fc-9ce1-e02ca5319af8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:16.878420 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ff9fa1eb-a144-43fc-9ce1-e02ca5319af8 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.082555 Apr 08 11:33:16.878990 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1462/2398] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:16 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:33:17.811523 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ab004e2a-fedb-4bfc-ab90-2a4d7bec3bd1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:17.812716 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ab004e2a-fedb-4bfc-ab90-2a4d7bec3bd1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:17.819170 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ab004e2a-fedb-4bfc-ab90-2a4d7bec3bd1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:17.819624 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ab004e2a-fedb-4bfc-ab90-2a4d7bec3bd1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:17.820394 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ab004e2a-fedb-4bfc-ab90-2a4d7bec3bd1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:17.820888 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ab004e2a-fedb-4bfc-ab90-2a4d7bec3bd1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:17.956085 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ab004e2a-fedb-4bfc-ab90-2a4d7bec3bd1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:17.963543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ab004e2a-fedb-4bfc-ab90-2a4d7bec3bd1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.155954 Apr 08 11:33:17.964114 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1463/2399] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:17 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:33:17.968513 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8e56c555-bc68-4b0f-827b-6b1e0b09c2fd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:17.969119 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8e56c555-bc68-4b0f-827b-6b1e0b09c2fd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:17.974769 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8e56c555-bc68-4b0f-827b-6b1e0b09c2fd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:17.975218 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8e56c555-bc68-4b0f-827b-6b1e0b09c2fd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:17.975980 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8e56c555-bc68-4b0f-827b-6b1e0b09c2fd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:17.976422 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8e56c555-bc68-4b0f-827b-6b1e0b09c2fd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:18.041407 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8e56c555-bc68-4b0f-827b-6b1e0b09c2fd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:18.049496 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8e56c555-bc68-4b0f-827b-6b1e0b09c2fd tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.084192 Apr 08 11:33:18.050171 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1464/2400] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:17 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:33:18.980653 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e355211b-6df4-4a14-9396-ceae9d5f91d3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:18.981305 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e355211b-6df4-4a14-9396-ceae9d5f91d3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:18.987549 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e355211b-6df4-4a14-9396-ceae9d5f91d3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:18.987997 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e355211b-6df4-4a14-9396-ceae9d5f91d3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:18.988761 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e355211b-6df4-4a14-9396-ceae9d5f91d3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:18.989196 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e355211b-6df4-4a14-9396-ceae9d5f91d3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:19.130832 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e355211b-6df4-4a14-9396-ceae9d5f91d3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:19.138200 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e355211b-6df4-4a14-9396-ceae9d5f91d3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.161443 Apr 08 11:33:19.138770 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1465/2401] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:18 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:33:19.143673 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8a3e0eb0-5a59-4b7c-a7d7-10f684f06bde tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:19.144277 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8a3e0eb0-5a59-4b7c-a7d7-10f684f06bde tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:19.150123 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8a3e0eb0-5a59-4b7c-a7d7-10f684f06bde tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:19.150582 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8a3e0eb0-5a59-4b7c-a7d7-10f684f06bde tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:19.151348 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8a3e0eb0-5a59-4b7c-a7d7-10f684f06bde tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:19.151791 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8a3e0eb0-5a59-4b7c-a7d7-10f684f06bde tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:19.211652 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8a3e0eb0-5a59-4b7c-a7d7-10f684f06bde tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:19.219840 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8a3e0eb0-5a59-4b7c-a7d7-10f684f06bde tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.079451 Apr 08 11:33:19.220406 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1466/2402] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:19 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:33:20.155327 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c3f7985d-81e4-4870-a5da-0798cc8f4db1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:20.156015 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c3f7985d-81e4-4870-a5da-0798cc8f4db1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:20.162850 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c3f7985d-81e4-4870-a5da-0798cc8f4db1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:20.163330 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c3f7985d-81e4-4870-a5da-0798cc8f4db1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:20.164105 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c3f7985d-81e4-4870-a5da-0798cc8f4db1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:20.164549 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c3f7985d-81e4-4870-a5da-0798cc8f4db1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:20.307204 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c3f7985d-81e4-4870-a5da-0798cc8f4db1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:20.314893 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c3f7985d-81e4-4870-a5da-0798cc8f4db1 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.163532 Apr 08 11:33:20.315485 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1467/2403] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:20 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:33:20.319988 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-045f3b07-4310-4740-ac77-255bc1d20782 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:20.320594 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-045f3b07-4310-4740-ac77-255bc1d20782 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:20.326350 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-045f3b07-4310-4740-ac77-255bc1d20782 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:20.326801 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-045f3b07-4310-4740-ac77-255bc1d20782 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:20.327568 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-045f3b07-4310-4740-ac77-255bc1d20782 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:20.328011 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-045f3b07-4310-4740-ac77-255bc1d20782 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:20.392486 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-045f3b07-4310-4740-ac77-255bc1d20782 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:20.400089 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-045f3b07-4310-4740-ac77-255bc1d20782 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.083639 Apr 08 11:33:20.400657 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1468/2404] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:20 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:33:20.879098 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 11:33:20.879360 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:33:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 11:33:21.332615 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-25d43e4b-ae69-46a6-91f1-ced182a14567 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:21.333326 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-25d43e4b-ae69-46a6-91f1-ced182a14567 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:21.339736 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-25d43e4b-ae69-46a6-91f1-ced182a14567 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:21.340197 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-25d43e4b-ae69-46a6-91f1-ced182a14567 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:21.340984 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-25d43e4b-ae69-46a6-91f1-ced182a14567 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:21.341427 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-25d43e4b-ae69-46a6-91f1-ced182a14567 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:21.476896 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-25d43e4b-ae69-46a6-91f1-ced182a14567 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:21.484627 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-25d43e4b-ae69-46a6-91f1-ced182a14567 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.156311 Apr 08 11:33:21.485266 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1469/2405] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:21 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:33:21.490488 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5f56ec93-6f48-4627-9450-795bdc3d676d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:21.491102 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5f56ec93-6f48-4627-9450-795bdc3d676d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:21.497456 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5f56ec93-6f48-4627-9450-795bdc3d676d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:21.497939 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5f56ec93-6f48-4627-9450-795bdc3d676d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:21.498795 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5f56ec93-6f48-4627-9450-795bdc3d676d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:21.499235 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5f56ec93-6f48-4627-9450-795bdc3d676d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:21.563996 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5f56ec93-6f48-4627-9450-795bdc3d676d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:21.571827 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5f56ec93-6f48-4627-9450-795bdc3d676d tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.085425 Apr 08 11:33:21.572418 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1470/2406] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:21 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:33:22.503700 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9c80f0e7-d9e4-416e-a637-44d21dd65e9e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:22.504393 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9c80f0e7-d9e4-416e-a637-44d21dd65e9e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:22.511003 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9c80f0e7-d9e4-416e-a637-44d21dd65e9e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:22.511267 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9c80f0e7-d9e4-416e-a637-44d21dd65e9e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:22.512060 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9c80f0e7-d9e4-416e-a637-44d21dd65e9e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:22.512475 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9c80f0e7-d9e4-416e-a637-44d21dd65e9e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:22.653525 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9c80f0e7-d9e4-416e-a637-44d21dd65e9e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:22.661328 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9c80f0e7-d9e4-416e-a637-44d21dd65e9e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.162115 Apr 08 11:33:22.661952 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1471/2407] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:22 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:33:22.666750 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d656814a-3b76-4ab1-a4af-307e66bccf98 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:22.667337 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d656814a-3b76-4ab1-a4af-307e66bccf98 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:22.674592 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d656814a-3b76-4ab1-a4af-307e66bccf98 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:22.675048 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d656814a-3b76-4ab1-a4af-307e66bccf98 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:22.676102 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d656814a-3b76-4ab1-a4af-307e66bccf98 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:22.676579 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d656814a-3b76-4ab1-a4af-307e66bccf98 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:22.752525 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d656814a-3b76-4ab1-a4af-307e66bccf98 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:22.766149 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d656814a-3b76-4ab1-a4af-307e66bccf98 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.102560 Apr 08 11:33:22.766856 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1472/2408] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:22 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:33:23.681567 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ae581529-37f3-4269-9400-3d2314624b07 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:23.682266 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ae581529-37f3-4269-9400-3d2314624b07 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:23.689131 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ae581529-37f3-4269-9400-3d2314624b07 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:23.694379 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ae581529-37f3-4269-9400-3d2314624b07 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:23.694379 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ae581529-37f3-4269-9400-3d2314624b07 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:23.694379 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ae581529-37f3-4269-9400-3d2314624b07 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:23.840981 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ae581529-37f3-4269-9400-3d2314624b07 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:23.849073 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ae581529-37f3-4269-9400-3d2314624b07 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.171273 Apr 08 11:33:23.849664 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1473/2409] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:23 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:33:23.854454 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d3682942-32b7-488f-9f95-dff7f659b73f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:23.855071 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d3682942-32b7-488f-9f95-dff7f659b73f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:23.861395 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d3682942-32b7-488f-9f95-dff7f659b73f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:23.861877 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d3682942-32b7-488f-9f95-dff7f659b73f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:23.862669 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d3682942-32b7-488f-9f95-dff7f659b73f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:23.863110 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d3682942-32b7-488f-9f95-dff7f659b73f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:23.927933 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d3682942-32b7-488f-9f95-dff7f659b73f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:23.935842 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d3682942-32b7-488f-9f95-dff7f659b73f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.084980 Apr 08 11:33:23.936441 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1474/2410] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:23 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:33:24.868309 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-01ee769f-d495-4a24-9124-22e30e8255fb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:24.869065 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-01ee769f-d495-4a24-9124-22e30e8255fb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:24.877282 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-01ee769f-d495-4a24-9124-22e30e8255fb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:24.877708 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-01ee769f-d495-4a24-9124-22e30e8255fb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:24.878511 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-01ee769f-d495-4a24-9124-22e30e8255fb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:24.879017 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-01ee769f-d495-4a24-9124-22e30e8255fb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:25.028410 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-01ee769f-d495-4a24-9124-22e30e8255fb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:25.036788 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-01ee769f-d495-4a24-9124-22e30e8255fb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.173508 Apr 08 11:33:25.037376 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1475/2411] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:24 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:33:25.042015 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d085279a-8390-498a-af93-f08864a82ee2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:25.042628 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d085279a-8390-498a-af93-f08864a82ee2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:25.050075 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d085279a-8390-498a-af93-f08864a82ee2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:25.056457 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d085279a-8390-498a-af93-f08864a82ee2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:25.056457 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d085279a-8390-498a-af93-f08864a82ee2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:25.056457 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d085279a-8390-498a-af93-f08864a82ee2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:25.115241 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d085279a-8390-498a-af93-f08864a82ee2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:25.123646 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d085279a-8390-498a-af93-f08864a82ee2 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.085199 Apr 08 11:33:25.124229 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1476/2412] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:25 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:33:26.063941 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d9c7008e-70bc-469d-b897-5562bb7dde97 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:26.064642 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d9c7008e-70bc-469d-b897-5562bb7dde97 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:26.071184 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d9c7008e-70bc-469d-b897-5562bb7dde97 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:26.071640 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d9c7008e-70bc-469d-b897-5562bb7dde97 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:26.072424 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d9c7008e-70bc-469d-b897-5562bb7dde97 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:26.072869 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d9c7008e-70bc-469d-b897-5562bb7dde97 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:26.222502 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d9c7008e-70bc-469d-b897-5562bb7dde97 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:26.230312 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d9c7008e-70bc-469d-b897-5562bb7dde97 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.170759 Apr 08 11:33:26.230921 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1477/2413] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:26 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:33:26.236005 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5735e772-5271-446b-8d08-5993704b1036 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:26.237907 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5735e772-5271-446b-8d08-5993704b1036 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:26.242989 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5735e772-5271-446b-8d08-5993704b1036 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:26.243447 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5735e772-5271-446b-8d08-5993704b1036 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:26.244234 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5735e772-5271-446b-8d08-5993704b1036 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:26.244717 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5735e772-5271-446b-8d08-5993704b1036 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:26.309413 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5735e772-5271-446b-8d08-5993704b1036 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:26.317678 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5735e772-5271-446b-8d08-5993704b1036 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.085587 Apr 08 11:33:26.318211 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1478/2414] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:26 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:33:27.248114 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2b400bb5-d4a0-49b6-b45a-50c31290507a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:27.248812 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2b400bb5-d4a0-49b6-b45a-50c31290507a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:27.255922 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2b400bb5-d4a0-49b6-b45a-50c31290507a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:27.256379 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2b400bb5-d4a0-49b6-b45a-50c31290507a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:27.257178 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2b400bb5-d4a0-49b6-b45a-50c31290507a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:27.257620 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2b400bb5-d4a0-49b6-b45a-50c31290507a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:27.414050 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2b400bb5-d4a0-49b6-b45a-50c31290507a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:27.422165 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2b400bb5-d4a0-49b6-b45a-50c31290507a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.178051 Apr 08 11:33:27.422769 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1479/2415] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:27 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:33:27.427517 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d876cfd5-ff44-4f8f-8c2a-ec6464c5ed8c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:27.428159 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d876cfd5-ff44-4f8f-8c2a-ec6464c5ed8c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] [instance: fcbe20ff-6f97-41c3-bde7-c03ad1d3634c] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:27.434615 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d876cfd5-ff44-4f8f-8c2a-ec6464c5ed8c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:27.435067 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d876cfd5-ff44-4f8f-8c2a-ec6464c5ed8c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:27.435860 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d876cfd5-ff44-4f8f-8c2a-ec6464c5ed8c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:27.436306 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d876cfd5-ff44-4f8f-8c2a-ec6464c5ed8c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:27.503911 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d876cfd5-ff44-4f8f-8c2a-ec6464c5ed8c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa60dc2a9994faab01551d6bc7c62b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925fd2ad2f3946e688dbe1a4c4068db9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:27.514244 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d876cfd5-ff44-4f8f-8c2a-ec6464c5ed8c tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c" status: 200 len: 1225 microversion: 2.1 time: 0.090265 Apr 08 11:33:27.515257 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1480/2416] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:27 2022] GET /compute/v2.1/servers/fcbe20ff-6f97-41c3-bde7-c03ad1d3634c => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:33:28.439759 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e768e662-be3e-416f-8043-a3a461870dbf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:28.440439 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e768e662-be3e-416f-8043-a3a461870dbf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:28.446692 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e768e662-be3e-416f-8043-a3a461870dbf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:28.447146 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e768e662-be3e-416f-8043-a3a461870dbf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:28.447916 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e768e662-be3e-416f-8043-a3a461870dbf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:28.448354 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e768e662-be3e-416f-8043-a3a461870dbf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:28.587722 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e768e662-be3e-416f-8043-a3a461870dbf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:28.596053 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e768e662-be3e-416f-8043-a3a461870dbf tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.160145 Apr 08 11:33:28.596630 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1481/2417] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:28 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:33:29.613693 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3084b86b-0306-45fb-b02a-8ee52f9f5942 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:29.614414 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3084b86b-0306-45fb-b02a-8ee52f9f5942 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:29.620937 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3084b86b-0306-45fb-b02a-8ee52f9f5942 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:29.621415 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3084b86b-0306-45fb-b02a-8ee52f9f5942 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:29.622496 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3084b86b-0306-45fb-b02a-8ee52f9f5942 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:29.622962 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3084b86b-0306-45fb-b02a-8ee52f9f5942 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:29.761856 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3084b86b-0306-45fb-b02a-8ee52f9f5942 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:29.769630 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3084b86b-0306-45fb-b02a-8ee52f9f5942 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.160404 Apr 08 11:33:29.779347 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1482/2418] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:29 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:33:30.790219 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d3dd5cfc-fa77-45e9-9689-0724a8d008c4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:30.790957 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d3dd5cfc-fa77-45e9-9689-0724a8d008c4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:30.797254 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d3dd5cfc-fa77-45e9-9689-0724a8d008c4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:30.797708 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d3dd5cfc-fa77-45e9-9689-0724a8d008c4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:30.798509 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d3dd5cfc-fa77-45e9-9689-0724a8d008c4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:30.798951 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d3dd5cfc-fa77-45e9-9689-0724a8d008c4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:30.930318 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d3dd5cfc-fa77-45e9-9689-0724a8d008c4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:33:30.937548 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d3dd5cfc-fa77-45e9-9689-0724a8d008c4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.152901 Apr 08 11:33:30.938765 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1483/2419] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:33:30 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:33:31.468591 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0e2b50a8-82ca-4634-abe3-1f06d938f816 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:33:31.469093 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0e2b50a8-82ca-4634-abe3-1f06d938f816 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:33:31.475972 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0e2b50a8-82ca-4634-abe3-1f06d938f816 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:31.476416 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0e2b50a8-82ca-4634-abe3-1f06d938f816 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:33:31.477192 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0e2b50a8-82ca-4634-abe3-1f06d938f816 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:33:31.477635 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0e2b50a8-82ca-4634-abe3-1f06d938f816 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:34:58.103269 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 11:34:58.104036 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:34:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd (ip 10.222.0.46) !!! Apr 08 11:35:31.633495 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-0e2b50a8-82ca-4634-abe3-1f06d938f816 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lazy-loading 'services' on Instance uuid cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8 {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 11:36:11.909809 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 11:36:11.910511 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:36:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd (ip 10.222.0.46) !!! Apr 08 11:36:37.870767 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0e2b50a8-82ca-4634-abe3-1f06d938f816 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd" status: 202 len: 0 microversion: 2.1 time: 186.406593 Apr 08 11:36:37.871906 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1484/2420] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Apr 8 11:33:31 2022] DELETE /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd => generated 0 bytes in 186408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 11:36:37.877713 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1d4b5ee3-6795-4303-bda9-5f1a42a53302 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:36:37.878451 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1d4b5ee3-6795-4303-bda9-5f1a42a53302 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:36:37.886609 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1d4b5ee3-6795-4303-bda9-5f1a42a53302 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:36:37.887170 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1d4b5ee3-6795-4303-bda9-5f1a42a53302 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:36:37.888213 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1d4b5ee3-6795-4303-bda9-5f1a42a53302 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:36:37.889317 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1d4b5ee3-6795-4303-bda9-5f1a42a53302 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:36:38.056232 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1d4b5ee3-6795-4303-bda9-5f1a42a53302 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:36:38.064188 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1d4b5ee3-6795-4303-bda9-5f1a42a53302 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.191447 Apr 08 11:36:38.064760 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1485/2421] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:36:37 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:36:38.069432 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-205b4274-5115-45e1-b199-9d4ff0211d5a tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:36:38.069966 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-205b4274-5115-45e1-b199-9d4ff0211d5a tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:36:38.075945 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-205b4274-5115-45e1-b199-9d4ff0211d5a tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:36:38.076395 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-205b4274-5115-45e1-b199-9d4ff0211d5a tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:36:38.077212 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-205b4274-5115-45e1-b199-9d4ff0211d5a tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:36:38.077660 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-205b4274-5115-45e1-b199-9d4ff0211d5a tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:36:40.889062 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 11:36:40.889791 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:36:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd (ip 10.222.0.46) !!! Apr 08 11:37:31.914973 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-205b4274-5115-45e1-b199-9d4ff0211d5a tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lazy-loading 'services' on Instance uuid cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8 {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 11:37:32.082899 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-205b4274-5115-45e1-b199-9d4ff0211d5a tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-574c6838-250e-470c-b597-baf2cb1c3632) Apr 08 11:37:32.083514 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-205b4274-5115-45e1-b199-9d4ff0211d5a tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-574c6838-250e-470c-b597-baf2cb1c3632) {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:37:32.084368 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-205b4274-5115-45e1-b199-9d4ff0211d5a tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd" status: 400 len: 269 microversion: 2.1 time: 54.018661 Apr 08 11:37:32.084927 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1486/2422] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Apr 8 11:36:38 2022] DELETE /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd => generated 269 bytes in 54020 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 08 11:37:32.161847 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-75b5b774-df2e-4f62-be01-0a5ce7bdba04 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:37:32.168345 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-75b5b774-df2e-4f62-be01-0a5ce7bdba04 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:37:32.170232 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-75b5b774-df2e-4f62-be01-0a5ce7bdba04 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:37:32.170680 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-75b5b774-df2e-4f62-be01-0a5ce7bdba04 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:37:32.171452 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-75b5b774-df2e-4f62-be01-0a5ce7bdba04 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:37:32.171884 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-75b5b774-df2e-4f62-be01-0a5ce7bdba04 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:37:32.315747 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-75b5b774-df2e-4f62-be01-0a5ce7bdba04 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:37:32.323243 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-75b5b774-df2e-4f62-be01-0a5ce7bdba04 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1449 microversion: 2.1 time: 0.237200 Apr 08 11:37:32.323841 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1487/2423] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:37:32 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1449 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:37:32.328562 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-41dacfb1-5854-48fe-bb62-26c432dd1af9 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:37:32.329057 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-41dacfb1-5854-48fe-bb62-26c432dd1af9 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:37:32.335500 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-41dacfb1-5854-48fe-bb62-26c432dd1af9 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:37:32.335956 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-41dacfb1-5854-48fe-bb62-26c432dd1af9 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:37:32.336786 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-41dacfb1-5854-48fe-bb62-26c432dd1af9 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:37:32.337222 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-41dacfb1-5854-48fe-bb62-26c432dd1af9 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:37:32.419261 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-41dacfb1-5854-48fe-bb62-26c432dd1af9 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lazy-loading 'services' on Instance uuid cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8 {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 11:37:32.476969 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-41dacfb1-5854-48fe-bb62-26c432dd1af9 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6ec6ea36-0d16-4129-82b2-76454929eb20) Apr 08 11:37:32.477568 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-41dacfb1-5854-48fe-bb62-26c432dd1af9 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6ec6ea36-0d16-4129-82b2-76454929eb20) {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:37:32.478477 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-41dacfb1-5854-48fe-bb62-26c432dd1af9 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd" status: 400 len: 269 microversion: 2.1 time: 0.153620 Apr 08 11:37:32.479082 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1488/2424] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Apr 8 11:37:32 2022] DELETE /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd => generated 269 bytes in 155 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 08 11:37:32.483701 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5141f956-7e0b-45a7-a66e-0aa0ed81704f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:37:32.484312 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5141f956-7e0b-45a7-a66e-0aa0ed81704f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:37:32.490287 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5141f956-7e0b-45a7-a66e-0aa0ed81704f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:37:32.490745 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5141f956-7e0b-45a7-a66e-0aa0ed81704f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:37:32.491527 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5141f956-7e0b-45a7-a66e-0aa0ed81704f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:37:32.491964 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5141f956-7e0b-45a7-a66e-0aa0ed81704f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:37:32.632727 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5141f956-7e0b-45a7-a66e-0aa0ed81704f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:37:32.641496 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5141f956-7e0b-45a7-a66e-0aa0ed81704f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1443 microversion: 2.1 time: 0.161381 Apr 08 11:37:32.642324 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1489/2425] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:37:32 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1443 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:37:32.647044 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e799c60b-db6b-4293-bb96-9ec60caba8ee tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:37:32.647544 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e799c60b-db6b-4293-bb96-9ec60caba8ee tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:37:32.653560 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e799c60b-db6b-4293-bb96-9ec60caba8ee tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:37:32.654125 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e799c60b-db6b-4293-bb96-9ec60caba8ee tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:37:32.659387 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e799c60b-db6b-4293-bb96-9ec60caba8ee tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:37:32.659387 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e799c60b-db6b-4293-bb96-9ec60caba8ee tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:37:32.784298 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-e799c60b-db6b-4293-bb96-9ec60caba8ee tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lazy-loading 'services' on Instance uuid cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8 {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 11:37:32.825007 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-e799c60b-db6b-4293-bb96-9ec60caba8ee tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d9d58eb2-2ff5-491b-8e20-03589ee48f93) Apr 08 11:37:32.825696 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e799c60b-db6b-4293-bb96-9ec60caba8ee tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d9d58eb2-2ff5-491b-8e20-03589ee48f93) {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:37:32.826670 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e799c60b-db6b-4293-bb96-9ec60caba8ee tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd" status: 400 len: 269 microversion: 2.1 time: 0.183644 Apr 08 11:37:32.832614 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1490/2426] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Apr 8 11:37:32 2022] DELETE /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd => generated 269 bytes in 185 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 08 11:37:32.832614 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8c61c201-6606-4650-80ce-7295350f2d50 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:37:32.832614 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8c61c201-6606-4650-80ce-7295350f2d50 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:37:32.838864 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8c61c201-6606-4650-80ce-7295350f2d50 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:37:32.839317 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8c61c201-6606-4650-80ce-7295350f2d50 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:37:32.840122 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8c61c201-6606-4650-80ce-7295350f2d50 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:37:32.840543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8c61c201-6606-4650-80ce-7295350f2d50 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:37:32.907283 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8c61c201-6606-4650-80ce-7295350f2d50 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:37:32.915358 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8c61c201-6606-4650-80ce-7295350f2d50 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1376 microversion: 2.1 time: 0.087141 Apr 08 11:37:32.915966 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1491/2427] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:37:32 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:37:32.920610 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-39a84861-1bfb-4024-9c0e-16f418c2aa81 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:37:32.921109 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-39a84861-1bfb-4024-9c0e-16f418c2aa81 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:37:32.927410 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-39a84861-1bfb-4024-9c0e-16f418c2aa81 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:37:32.927865 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-39a84861-1bfb-4024-9c0e-16f418c2aa81 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:37:32.928636 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-39a84861-1bfb-4024-9c0e-16f418c2aa81 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:37:32.929080 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-39a84861-1bfb-4024-9c0e-16f418c2aa81 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:38:38.603628 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-39a84861-1bfb-4024-9c0e-16f418c2aa81 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "DELETE /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/os-volume_attachments/669b69f8-d539-406d-a440-9704f783db13" status: 202 len: 0 microversion: 2.20 time: 65.686472 Apr 08 11:38:38.604559 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1492/2428] 10.222.0.46 () {60 vars in 1456 bytes} [Fri Apr 8 11:37:32 2022] DELETE /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/os-volume_attachments/669b69f8-d539-406d-a440-9704f783db13 => generated 0 bytes in 65688 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 08 11:38:38.704938 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bda8a0e6-107d-42cd-bede-b266695ca67f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:38:38.706424 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-bda8a0e6-107d-42cd-bede-b266695ca67f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:38:38.713753 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bda8a0e6-107d-42cd-bede-b266695ca67f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:38:38.714246 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bda8a0e6-107d-42cd-bede-b266695ca67f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:38:38.715250 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bda8a0e6-107d-42cd-bede-b266695ca67f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:38:38.715737 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bda8a0e6-107d-42cd-bede-b266695ca67f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:38:38.747735 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-bda8a0e6-107d-42cd-bede-b266695ca67f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142532 Apr 08 11:38:38.748321 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1493/2429] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:38:38 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:38:38.753032 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-49ea08fc-b1a4-4598-960e-53fe1f33d565 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:38:38.753520 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-49ea08fc-b1a4-4598-960e-53fe1f33d565 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:38:38.760843 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-49ea08fc-b1a4-4598-960e-53fe1f33d565 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:38:38.761292 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-49ea08fc-b1a4-4598-960e-53fe1f33d565 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:38:38.762097 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-49ea08fc-b1a4-4598-960e-53fe1f33d565 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:38:38.762536 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-49ea08fc-b1a4-4598-960e-53fe1f33d565 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:39:31.918152 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 11:39:31.918928 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:39:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd (ip 10.222.0.46) !!! Apr 08 11:39:33.124493 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-49ea08fc-b1a4-4598-960e-53fe1f33d565 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lazy-loading 'services' on Instance uuid cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8 {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 11:40:00.898149 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 11:40:00.898859 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:40:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd (ip 10.222.0.46) !!! Apr 08 11:40:38.780843 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-49ea08fc-b1a4-4598-960e-53fe1f33d565 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5ed19560-d2a1-4bbb-b760-0ba4d7b96746) Apr 08 11:40:38.781544 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-49ea08fc-b1a4-4598-960e-53fe1f33d565 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5ed19560-d2a1-4bbb-b760-0ba4d7b96746) {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:40:38.782513 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-49ea08fc-b1a4-4598-960e-53fe1f33d565 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd" status: 400 len: 269 microversion: 2.1 time: 120.033276 Apr 08 11:40:38.783153 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1494/2430] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Apr 8 11:38:38 2022] DELETE /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd => generated 269 bytes in 120034 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 08 11:40:38.789002 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2b91cfd9-3111-40b5-9b2f-2a8c837b03cb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:40:38.789611 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2b91cfd9-3111-40b5-9b2f-2a8c837b03cb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:40:38.795413 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2b91cfd9-3111-40b5-9b2f-2a8c837b03cb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:40:38.795861 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2b91cfd9-3111-40b5-9b2f-2a8c837b03cb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:40:38.796629 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2b91cfd9-3111-40b5-9b2f-2a8c837b03cb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:40:38.797066 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2b91cfd9-3111-40b5-9b2f-2a8c837b03cb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:40:38.857605 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2b91cfd9-3111-40b5-9b2f-2a8c837b03cb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:40:38.865818 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2b91cfd9-3111-40b5-9b2f-2a8c837b03cb tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1214 microversion: 2.1 time: 0.080988 Apr 08 11:40:38.866400 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1495/2431] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:40:38 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:40:38.925061 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-508d31ec-73f6-4930-8ad9-39274f9ed378 req-866035e3-27b5-4c7e-a4c2-3ead00c8aeaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6031de3c-c187-4e54-b340-ad53edbe9ee6", "name": "network-vif-deleted", "tag": "58170f46-0bda-4d91-90b4-61e81203f4f5"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:40:38.933216 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-508d31ec-73f6-4930-8ad9-39274f9ed378 req-866035e3-27b5-4c7e-a4c2-3ead00c8aeaf service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:40:38.933655 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-508d31ec-73f6-4930-8ad9-39274f9ed378 req-866035e3-27b5-4c7e-a4c2-3ead00c8aeaf service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:40:38.944095 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-508d31ec-73f6-4930-8ad9-39274f9ed378 req-866035e3-27b5-4c7e-a4c2-3ead00c8aeaf service nova] Creating event network-vif-deleted:58170f46-0bda-4d91-90b4-61e81203f4f5 for instance 6031de3c-c187-4e54-b340-ad53edbe9ee6 on hv-cinder-83607 Apr 08 11:40:38.952255 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-508d31ec-73f6-4930-8ad9-39274f9ed378 req-866035e3-27b5-4c7e-a4c2-3ead00c8aeaf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084648 Apr 08 11:40:38.952850 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1496/2432] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:40:38.958108 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-de01b91a-5751-48f0-b41a-53fcb3aefdaf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:40:38.958679 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-de01b91a-5751-48f0-b41a-53fcb3aefdaf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:40:38.964745 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-de01b91a-5751-48f0-b41a-53fcb3aefdaf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:40:38.965195 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-de01b91a-5751-48f0-b41a-53fcb3aefdaf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:40:38.966093 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-de01b91a-5751-48f0-b41a-53fcb3aefdaf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:40:38.966525 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-de01b91a-5751-48f0-b41a-53fcb3aefdaf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:41:33.269396 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-de01b91a-5751-48f0-b41a-53fcb3aefdaf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] HTTP exception thrown: Instance 594ceb52-9d1f-494f-818d-eb66144bc49d is not attached to volume 669b69f8-d539-406d-a440-9704f783db13 Apr 08 11:41:33.270134 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-de01b91a-5751-48f0-b41a-53fcb3aefdaf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Returning 404 to user: Instance 594ceb52-9d1f-494f-818d-eb66144bc49d is not attached to volume 669b69f8-d539-406d-a440-9704f783db13 {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:41:33.271024 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-de01b91a-5751-48f0-b41a-53fcb3aefdaf tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "DELETE /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/os-volume_attachments/669b69f8-d539-406d-a440-9704f783db13" status: 404 len: 154 microversion: 2.20 time: 54.317070 Apr 08 11:41:33.271804 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1497/2433] 10.222.0.46 () {60 vars in 1456 bytes} [Fri Apr 8 11:40:38 2022] DELETE /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/os-volume_attachments/669b69f8-d539-406d-a440-9704f783db13 => generated 154 bytes in 54318 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 08 11:41:33.276248 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0d18d6a0-4d35-42f0-af3b-c6507fc04a89 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:41:33.277705 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0d18d6a0-4d35-42f0-af3b-c6507fc04a89 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:41:33.283540 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0d18d6a0-4d35-42f0-af3b-c6507fc04a89 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:41:33.283995 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0d18d6a0-4d35-42f0-af3b-c6507fc04a89 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:41:33.284776 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0d18d6a0-4d35-42f0-af3b-c6507fc04a89 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:41:33.285215 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0d18d6a0-4d35-42f0-af3b-c6507fc04a89 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:41:33.314798 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0d18d6a0-4d35-42f0-af3b-c6507fc04a89 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042095 Apr 08 11:41:33.315616 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1498/2434] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:41:33 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:41:33.320292 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-91f042cc-a01c-49cd-982c-94c86d2650c8 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:41:33.321396 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-91f042cc-a01c-49cd-982c-94c86d2650c8 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:41:33.327021 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-91f042cc-a01c-49cd-982c-94c86d2650c8 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:41:33.327470 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-91f042cc-a01c-49cd-982c-94c86d2650c8 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:41:33.328238 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-91f042cc-a01c-49cd-982c-94c86d2650c8 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:41:33.328675 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-91f042cc-a01c-49cd-982c-94c86d2650c8 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:42:39.146743 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-91f042cc-a01c-49cd-982c-94c86d2650c8 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lazy-loading 'services' on Instance uuid cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8 {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 11:42:51.926564 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 11:42:51.927256 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:42:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd (ip 10.222.0.46) !!! Apr 08 11:43:18.118287 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 11:43:18.119537 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:43:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd (ip 10.222.0.46) !!! Apr 08 11:43:20.906724 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 11:43:20.907358 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:43:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd (ip 10.222.0.46) !!! Apr 08 11:43:33.409938 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-91f042cc-a01c-49cd-982c-94c86d2650c8 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-89522533-3897-414c-aeff-2ff70ed51b15) Apr 08 11:43:33.410563 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-91f042cc-a01c-49cd-982c-94c86d2650c8 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-89522533-3897-414c-aeff-2ff70ed51b15) {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:43:33.411418 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-91f042cc-a01c-49cd-982c-94c86d2650c8 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd" status: 400 len: 269 microversion: 2.1 time: 120.094892 Apr 08 11:43:33.411935 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:43:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd (ip 10.222.0.46) !!! Apr 08 11:43:33.411935 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:43:33 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd (10.222.0.46) Apr 08 11:43:33.412750 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: CRITICAL nova [None req-91f042cc-a01c-49cd-982c-94c86d2650c8 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Unhandled error: OSError: write error Apr 08 11:43:33.412750 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: ERROR nova OSError: write error Apr 08 11:43:33.412750 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: ERROR nova Apr 08 11:43:33.413021 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1499/2435] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Apr 8 11:41:33 2022] DELETE /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd => generated 0 bytes in 120097 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Apr 08 11:43:33.552173 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-884a5d7d-9a65-42c3-84d2-33a4eda4e9c3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:43:33.552780 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-884a5d7d-9a65-42c3-84d2-33a4eda4e9c3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:43:33.559875 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-884a5d7d-9a65-42c3-84d2-33a4eda4e9c3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:43:33.560323 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-884a5d7d-9a65-42c3-84d2-33a4eda4e9c3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:43:33.561153 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-884a5d7d-9a65-42c3-84d2-33a4eda4e9c3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:43:33.562630 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-884a5d7d-9a65-42c3-84d2-33a4eda4e9c3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:43:33.625877 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-884a5d7d-9a65-42c3-84d2-33a4eda4e9c3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:43:33.633257 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-884a5d7d-9a65-42c3-84d2-33a4eda4e9c3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1214 microversion: 2.1 time: 0.219481 Apr 08 11:43:33.633806 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:43:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 (ip 10.222.0.46) !!! Apr 08 11:43:33.633806 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:43:33 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 (10.222.0.46) Apr 08 11:43:33.634357 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: CRITICAL nova [None req-884a5d7d-9a65-42c3-84d2-33a4eda4e9c3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Unhandled error: OSError: write error Apr 08 11:43:33.634357 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: ERROR nova OSError: write error Apr 08 11:43:33.634357 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: ERROR nova Apr 08 11:43:33.634623 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1500/2436] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:43:33 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 0 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Apr 08 11:43:33.745167 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-94e0ee58-e8cf-4e09-accb-e908556976ea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:43:33.746223 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-94e0ee58-e8cf-4e09-accb-e908556976ea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:43:33.752319 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-94e0ee58-e8cf-4e09-accb-e908556976ea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:43:33.752775 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-94e0ee58-e8cf-4e09-accb-e908556976ea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:43:33.753558 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-94e0ee58-e8cf-4e09-accb-e908556976ea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:43:33.754039 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-94e0ee58-e8cf-4e09-accb-e908556976ea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:44:39.583893 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-94e0ee58-e8cf-4e09-accb-e908556976ea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] HTTP exception thrown: Instance 594ceb52-9d1f-494f-818d-eb66144bc49d is not attached to volume 669b69f8-d539-406d-a440-9704f783db13 Apr 08 11:44:39.584539 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-94e0ee58-e8cf-4e09-accb-e908556976ea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Returning 404 to user: Instance 594ceb52-9d1f-494f-818d-eb66144bc49d is not attached to volume 669b69f8-d539-406d-a440-9704f783db13 {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:44:39.585365 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-94e0ee58-e8cf-4e09-accb-e908556976ea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "DELETE /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/os-volume_attachments/669b69f8-d539-406d-a440-9704f783db13" status: 404 len: 154 microversion: 2.20 time: 65.950014 Apr 08 11:44:39.585899 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:44:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/os-volume_attachments/669b69f8-d539-406d-a440-9704f783db13 (ip 10.222.0.46) !!! Apr 08 11:44:39.585899 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:44:39 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/os-volume_attachments/669b69f8-d539-406d-a440-9704f783db13 (10.222.0.46) Apr 08 11:44:39.586480 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: CRITICAL nova [None req-94e0ee58-e8cf-4e09-accb-e908556976ea tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Unhandled error: OSError: write error Apr 08 11:44:39.586480 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: ERROR nova OSError: write error Apr 08 11:44:39.586480 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: ERROR nova Apr 08 11:44:39.586829 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1501/2437] 10.222.0.46 () {60 vars in 1456 bytes} [Fri Apr 8 11:43:33 2022] DELETE /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/os-volume_attachments/669b69f8-d539-406d-a440-9704f783db13 => generated 0 bytes in 65952 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Apr 08 11:44:39.713210 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a0c9deaa-93db-4192-b253-44f14aa93048 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:44:39.714824 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a0c9deaa-93db-4192-b253-44f14aa93048 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:44:39.720590 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a0c9deaa-93db-4192-b253-44f14aa93048 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:44:39.721044 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a0c9deaa-93db-4192-b253-44f14aa93048 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:44:39.721831 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a0c9deaa-93db-4192-b253-44f14aa93048 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:44:39.722272 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a0c9deaa-93db-4192-b253-44f14aa93048 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:44:39.751016 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a0c9deaa-93db-4192-b253-44f14aa93048 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.163443 Apr 08 11:44:39.751519 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:44:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/os-volume_attachments (ip 10.222.0.46) !!! Apr 08 11:44:39.751519 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:44:39 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/os-volume_attachments (10.222.0.46) Apr 08 11:44:39.752091 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: CRITICAL nova [None req-a0c9deaa-93db-4192-b253-44f14aa93048 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Unhandled error: OSError: write error Apr 08 11:44:39.752091 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: ERROR nova OSError: write error Apr 08 11:44:39.752091 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: ERROR nova Apr 08 11:44:39.752349 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1502/2438] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:44:39 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/os-volume_attachments => generated 0 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Apr 08 11:44:39.756642 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f4bf4e01-47e1-42f8-b0f8-29251f8acb78 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:44:39.757122 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f4bf4e01-47e1-42f8-b0f8-29251f8acb78 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:44:39.762433 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f4bf4e01-47e1-42f8-b0f8-29251f8acb78 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:44:39.762879 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f4bf4e01-47e1-42f8-b0f8-29251f8acb78 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:44:39.763626 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f4bf4e01-47e1-42f8-b0f8-29251f8acb78 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:44:39.764059 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f4bf4e01-47e1-42f8-b0f8-29251f8acb78 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:45:33.631606 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-f4bf4e01-47e1-42f8-b0f8-29251f8acb78 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lazy-loading 'services' on Instance uuid cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8 {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 11:46:11.936118 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 11:46:11.936815 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:46:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd (ip 10.222.0.46) !!! Apr 08 11:46:38.126923 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 11:46:38.127683 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:46:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd (ip 10.222.0.46) !!! Apr 08 11:46:39.768096 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-f4bf4e01-47e1-42f8-b0f8-29251f8acb78 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-78cb879e-2b37-4157-96f4-01d919ddd31a) Apr 08 11:46:39.768713 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f4bf4e01-47e1-42f8-b0f8-29251f8acb78 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-78cb879e-2b37-4157-96f4-01d919ddd31a) {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:46:39.769565 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f4bf4e01-47e1-42f8-b0f8-29251f8acb78 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd" status: 400 len: 269 microversion: 2.1 time: 120.016487 Apr 08 11:46:39.770129 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:46:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd (ip 10.222.0.46) !!! Apr 08 11:46:39.770129 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:46:39 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd (10.222.0.46) Apr 08 11:46:39.770768 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: CRITICAL nova [None req-f4bf4e01-47e1-42f8-b0f8-29251f8acb78 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Unhandled error: OSError: write error Apr 08 11:46:39.770768 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: ERROR nova OSError: write error Apr 08 11:46:39.770768 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: ERROR nova Apr 08 11:46:39.770768 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1503/2439] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Apr 8 11:44:39 2022] DELETE /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd => generated 0 bytes in 120018 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Apr 08 11:46:39.776186 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-547afc1c-f5bb-49c8-a728-25bc19a5be2e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:46:39.776802 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-547afc1c-f5bb-49c8-a728-25bc19a5be2e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:46:39.783153 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-547afc1c-f5bb-49c8-a728-25bc19a5be2e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:46:39.783612 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-547afc1c-f5bb-49c8-a728-25bc19a5be2e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:46:39.784388 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-547afc1c-f5bb-49c8-a728-25bc19a5be2e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:46:39.784829 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-547afc1c-f5bb-49c8-a728-25bc19a5be2e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:46:39.846746 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-547afc1c-f5bb-49c8-a728-25bc19a5be2e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:46:39.854228 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-547afc1c-f5bb-49c8-a728-25bc19a5be2e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1214 microversion: 2.1 time: 0.082434 Apr 08 11:46:39.854773 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:46:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 (ip 10.222.0.46) !!! Apr 08 11:46:39.854773 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:46:39 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 (10.222.0.46) Apr 08 11:46:39.855347 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: CRITICAL nova [None req-547afc1c-f5bb-49c8-a728-25bc19a5be2e tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Unhandled error: OSError: write error Apr 08 11:46:39.855347 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: ERROR nova OSError: write error Apr 08 11:46:39.855347 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: ERROR nova Apr 08 11:46:39.855638 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1504/2440] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:46:39 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 0 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Apr 08 11:46:39.860165 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c5c9a7f0-d517-4455-a0a8-69b7a19079f7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:46:39.860651 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c5c9a7f0-d517-4455-a0a8-69b7a19079f7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:46:39.866230 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c5c9a7f0-d517-4455-a0a8-69b7a19079f7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:46:39.866673 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c5c9a7f0-d517-4455-a0a8-69b7a19079f7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:46:39.867435 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c5c9a7f0-d517-4455-a0a8-69b7a19079f7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:46:39.867868 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c5c9a7f0-d517-4455-a0a8-69b7a19079f7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:46:39.941996 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-c5c9a7f0-d517-4455-a0a8-69b7a19079f7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] HTTP exception thrown: Instance 594ceb52-9d1f-494f-818d-eb66144bc49d is not attached to volume 669b69f8-d539-406d-a440-9704f783db13 Apr 08 11:46:39.942596 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c5c9a7f0-d517-4455-a0a8-69b7a19079f7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Returning 404 to user: Instance 594ceb52-9d1f-494f-818d-eb66144bc49d is not attached to volume 669b69f8-d539-406d-a440-9704f783db13 {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:46:39.943442 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c5c9a7f0-d517-4455-a0a8-69b7a19079f7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "DELETE /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/os-volume_attachments/669b69f8-d539-406d-a440-9704f783db13" status: 404 len: 154 microversion: 2.20 time: 0.087105 Apr 08 11:46:39.944289 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:46:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/os-volume_attachments/669b69f8-d539-406d-a440-9704f783db13 (ip 10.222.0.46) !!! Apr 08 11:46:39.944289 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:46:39 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/os-volume_attachments/669b69f8-d539-406d-a440-9704f783db13 (10.222.0.46) Apr 08 11:46:39.944528 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: CRITICAL nova [None req-c5c9a7f0-d517-4455-a0a8-69b7a19079f7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Unhandled error: OSError: write error Apr 08 11:46:39.944528 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: ERROR nova OSError: write error Apr 08 11:46:39.944528 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: ERROR nova Apr 08 11:46:39.944784 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1505/2441] 10.222.0.46 () {60 vars in 1456 bytes} [Fri Apr 8 11:46:39 2022] DELETE /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/os-volume_attachments/669b69f8-d539-406d-a440-9704f783db13 => generated 0 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Apr 08 11:46:39.949163 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e237d117-8b9e-4999-9a82-56e52bf34987 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:46:39.950171 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e237d117-8b9e-4999-9a82-56e52bf34987 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:46:39.956222 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e237d117-8b9e-4999-9a82-56e52bf34987 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:46:39.956677 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e237d117-8b9e-4999-9a82-56e52bf34987 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:46:39.957454 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e237d117-8b9e-4999-9a82-56e52bf34987 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:46:39.957924 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e237d117-8b9e-4999-9a82-56e52bf34987 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:46:39.986639 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e237d117-8b9e-4999-9a82-56e52bf34987 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040993 Apr 08 11:46:39.987159 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:46:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/os-volume_attachments (ip 10.222.0.46) !!! Apr 08 11:46:39.987159 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:46:39 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/os-volume_attachments (10.222.0.46) Apr 08 11:46:39.987747 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: CRITICAL nova [None req-e237d117-8b9e-4999-9a82-56e52bf34987 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Unhandled error: OSError: write error Apr 08 11:46:39.987747 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: ERROR nova OSError: write error Apr 08 11:46:39.987747 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: ERROR nova Apr 08 11:46:39.988018 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1506/2442] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:46:39 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/os-volume_attachments => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Apr 08 11:46:39.992352 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-54ed9ffc-3a2e-4891-8359-74297d605eb1 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:46:39.992839 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-54ed9ffc-3a2e-4891-8359-74297d605eb1 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:46:39.998307 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-54ed9ffc-3a2e-4891-8359-74297d605eb1 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:46:39.998759 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-54ed9ffc-3a2e-4891-8359-74297d605eb1 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:46:39.999533 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-54ed9ffc-3a2e-4891-8359-74297d605eb1 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:46:39.999977 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-54ed9ffc-3a2e-4891-8359-74297d605eb1 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:46:40.078130 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-54ed9ffc-3a2e-4891-8359-74297d605eb1 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lazy-loading 'services' on Instance uuid cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8 {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 11:46:40.132263 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-54ed9ffc-3a2e-4891-8359-74297d605eb1 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5eb74fe7-f5c2-43ee-885e-32d4693af043) Apr 08 11:46:40.132867 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-54ed9ffc-3a2e-4891-8359-74297d605eb1 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5eb74fe7-f5c2-43ee-885e-32d4693af043) {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:46:40.133716 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-54ed9ffc-3a2e-4891-8359-74297d605eb1 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd" status: 400 len: 269 microversion: 2.1 time: 0.144969 Apr 08 11:46:40.134247 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:46:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd (ip 10.222.0.46) !!! Apr 08 11:46:40.134247 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:46:40 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd (10.222.0.46) Apr 08 11:46:40.134818 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: CRITICAL nova [None req-54ed9ffc-3a2e-4891-8359-74297d605eb1 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Unhandled error: OSError: write error Apr 08 11:46:40.134818 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: ERROR nova OSError: write error Apr 08 11:46:40.134818 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: ERROR nova Apr 08 11:46:40.135175 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1507/2443] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Apr 8 11:46:39 2022] DELETE /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd => generated 0 bytes in 147 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Apr 08 11:46:40.139948 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3708ac0a-20f9-45f4-abd2-d7ad64b4b54f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:46:40.140544 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3708ac0a-20f9-45f4-abd2-d7ad64b4b54f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:46:40.147102 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3708ac0a-20f9-45f4-abd2-d7ad64b4b54f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:46:40.147555 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3708ac0a-20f9-45f4-abd2-d7ad64b4b54f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:46:40.148582 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3708ac0a-20f9-45f4-abd2-d7ad64b4b54f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:46:40.149019 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3708ac0a-20f9-45f4-abd2-d7ad64b4b54f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:46:40.208700 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3708ac0a-20f9-45f4-abd2-d7ad64b4b54f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:46:40.216178 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3708ac0a-20f9-45f4-abd2-d7ad64b4b54f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1214 microversion: 2.1 time: 0.080329 Apr 08 11:46:40.216734 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:46:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 (ip 10.222.0.46) !!! Apr 08 11:46:40.216734 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:46:40 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 (10.222.0.46) Apr 08 11:46:40.217320 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: CRITICAL nova [None req-3708ac0a-20f9-45f4-abd2-d7ad64b4b54f tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Unhandled error: OSError: write error Apr 08 11:46:40.217320 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: ERROR nova OSError: write error Apr 08 11:46:40.217320 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: ERROR nova Apr 08 11:46:40.217588 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1508/2444] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:46:40 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 0 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Apr 08 11:46:40.221979 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e5520496-1034-4a92-a472-fccfc493095e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:46:40.222507 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e5520496-1034-4a92-a472-fccfc493095e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:46:40.227873 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e5520496-1034-4a92-a472-fccfc493095e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:46:40.228323 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e5520496-1034-4a92-a472-fccfc493095e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:46:40.229081 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e5520496-1034-4a92-a472-fccfc493095e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:46:40.229517 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e5520496-1034-4a92-a472-fccfc493095e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:46:40.309967 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-e5520496-1034-4a92-a472-fccfc493095e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] HTTP exception thrown: Instance 594ceb52-9d1f-494f-818d-eb66144bc49d is not attached to volume 669b69f8-d539-406d-a440-9704f783db13 Apr 08 11:46:40.317110 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e5520496-1034-4a92-a472-fccfc493095e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Returning 404 to user: Instance 594ceb52-9d1f-494f-818d-eb66144bc49d is not attached to volume 669b69f8-d539-406d-a440-9704f783db13 {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:46:40.317110 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e5520496-1034-4a92-a472-fccfc493095e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "DELETE /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/os-volume_attachments/669b69f8-d539-406d-a440-9704f783db13" status: 404 len: 154 microversion: 2.20 time: 0.093583 Apr 08 11:46:40.317110 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:46:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/os-volume_attachments/669b69f8-d539-406d-a440-9704f783db13 (ip 10.222.0.46) !!! Apr 08 11:46:40.317110 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:46:40 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/os-volume_attachments/669b69f8-d539-406d-a440-9704f783db13 (10.222.0.46) Apr 08 11:46:40.317110 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: CRITICAL nova [None req-e5520496-1034-4a92-a472-fccfc493095e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Unhandled error: OSError: write error Apr 08 11:46:40.317110 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: ERROR nova OSError: write error Apr 08 11:46:40.317110 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: ERROR nova Apr 08 11:46:40.317110 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1509/2445] 10.222.0.46 () {60 vars in 1456 bytes} [Fri Apr 8 11:46:40 2022] DELETE /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/os-volume_attachments/669b69f8-d539-406d-a440-9704f783db13 => generated 0 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Apr 08 11:46:40.318457 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a58d5619-d64f-4efc-8154-9d7c7504ddde tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:46:40.319375 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a58d5619-d64f-4efc-8154-9d7c7504ddde tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:46:40.325231 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a58d5619-d64f-4efc-8154-9d7c7504ddde tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:46:40.325673 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a58d5619-d64f-4efc-8154-9d7c7504ddde tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:46:40.327156 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a58d5619-d64f-4efc-8154-9d7c7504ddde tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:46:40.327496 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a58d5619-d64f-4efc-8154-9d7c7504ddde tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:46:40.355799 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a58d5619-d64f-4efc-8154-9d7c7504ddde tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041462 Apr 08 11:46:40.356296 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:46:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/os-volume_attachments (ip 10.222.0.46) !!! Apr 08 11:46:40.356296 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:46:40 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/os-volume_attachments (10.222.0.46) Apr 08 11:46:40.356869 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: CRITICAL nova [None req-a58d5619-d64f-4efc-8154-9d7c7504ddde tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Unhandled error: OSError: write error Apr 08 11:46:40.356869 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: ERROR nova OSError: write error Apr 08 11:46:40.356869 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: ERROR nova Apr 08 11:46:40.357125 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1510/2446] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:46:40 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/os-volume_attachments => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Apr 08 11:46:40.361502 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ee7c860b-d494-463a-80c3-99e18e41a3e7 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:46:40.362014 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ee7c860b-d494-463a-80c3-99e18e41a3e7 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:46:40.367904 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ee7c860b-d494-463a-80c3-99e18e41a3e7 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:46:40.368350 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ee7c860b-d494-463a-80c3-99e18e41a3e7 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:46:40.369105 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ee7c860b-d494-463a-80c3-99e18e41a3e7 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:46:40.369536 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ee7c860b-d494-463a-80c3-99e18e41a3e7 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:46:40.450390 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-ee7c860b-d494-463a-80c3-99e18e41a3e7 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lazy-loading 'services' on Instance uuid cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8 {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 11:46:40.503984 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-ee7c860b-d494-463a-80c3-99e18e41a3e7 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0c82f60b-60a4-49b9-b02e-e3714e67d983) Apr 08 11:46:40.504597 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ee7c860b-d494-463a-80c3-99e18e41a3e7 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0c82f60b-60a4-49b9-b02e-e3714e67d983) {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:46:40.505438 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ee7c860b-d494-463a-80c3-99e18e41a3e7 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd" status: 400 len: 269 microversion: 2.1 time: 0.147580 Apr 08 11:46:40.506014 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:46:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd (ip 10.222.0.46) !!! Apr 08 11:46:40.506014 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:46:40 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd (10.222.0.46) Apr 08 11:46:40.506589 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: CRITICAL nova [None req-ee7c860b-d494-463a-80c3-99e18e41a3e7 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Unhandled error: OSError: write error Apr 08 11:46:40.506589 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: ERROR nova OSError: write error Apr 08 11:46:40.506589 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: ERROR nova Apr 08 11:46:40.506841 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1511/2447] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Apr 8 11:46:40 2022] DELETE /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd => generated 0 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Apr 08 11:46:40.511174 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-27aad161-229e-4806-9a51-c160e83342c8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:46:40.511776 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-27aad161-229e-4806-9a51-c160e83342c8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:46:40.518736 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-27aad161-229e-4806-9a51-c160e83342c8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:46:40.519182 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-27aad161-229e-4806-9a51-c160e83342c8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:46:40.519966 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-27aad161-229e-4806-9a51-c160e83342c8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:46:40.520391 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-27aad161-229e-4806-9a51-c160e83342c8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:46:40.581987 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-27aad161-229e-4806-9a51-c160e83342c8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:46:40.589317 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-27aad161-229e-4806-9a51-c160e83342c8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1214 microversion: 2.1 time: 0.081703 Apr 08 11:46:40.589855 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:46:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 (ip 10.222.0.46) !!! Apr 08 11:46:40.589855 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:46:40 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 (10.222.0.46) Apr 08 11:46:40.590435 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: CRITICAL nova [None req-27aad161-229e-4806-9a51-c160e83342c8 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Unhandled error: OSError: write error Apr 08 11:46:40.590435 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: ERROR nova OSError: write error Apr 08 11:46:40.590435 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: ERROR nova Apr 08 11:46:40.590740 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1512/2448] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:46:40 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 0 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Apr 08 11:46:40.595054 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e02586b2-a359-45e3-a79b-c68d24c38b0f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:46:40.595543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e02586b2-a359-45e3-a79b-c68d24c38b0f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:46:40.600917 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e02586b2-a359-45e3-a79b-c68d24c38b0f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:46:40.601367 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e02586b2-a359-45e3-a79b-c68d24c38b0f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:46:40.602156 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e02586b2-a359-45e3-a79b-c68d24c38b0f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:46:40.602596 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e02586b2-a359-45e3-a79b-c68d24c38b0f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:46:40.915560 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 11:46:40.916236 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:46:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/os-volume_attachments/669b69f8-d539-406d-a440-9704f783db13 (ip 10.222.0.46) !!! Apr 08 11:47:33.746991 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-e02586b2-a359-45e3-a79b-c68d24c38b0f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] HTTP exception thrown: Instance 594ceb52-9d1f-494f-818d-eb66144bc49d is not attached to volume 669b69f8-d539-406d-a440-9704f783db13 Apr 08 11:47:33.748001 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e02586b2-a359-45e3-a79b-c68d24c38b0f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Returning 404 to user: Instance 594ceb52-9d1f-494f-818d-eb66144bc49d is not attached to volume 669b69f8-d539-406d-a440-9704f783db13 {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:47:33.749481 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e02586b2-a359-45e3-a79b-c68d24c38b0f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "DELETE /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/os-volume_attachments/669b69f8-d539-406d-a440-9704f783db13" status: 404 len: 154 microversion: 2.20 time: 53.157744 Apr 08 11:47:33.750401 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:47:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/os-volume_attachments/669b69f8-d539-406d-a440-9704f783db13 (ip 10.222.0.46) !!! Apr 08 11:47:33.750401 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:47:33 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/os-volume_attachments/669b69f8-d539-406d-a440-9704f783db13 (10.222.0.46) Apr 08 11:47:33.751900 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: CRITICAL nova [None req-e02586b2-a359-45e3-a79b-c68d24c38b0f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Unhandled error: OSError: write error Apr 08 11:47:33.751900 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: ERROR nova OSError: write error Apr 08 11:47:33.751900 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: ERROR nova Apr 08 11:47:33.752227 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1513/2449] 10.222.0.46 () {60 vars in 1456 bytes} [Fri Apr 8 11:46:40 2022] DELETE /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/os-volume_attachments/669b69f8-d539-406d-a440-9704f783db13 => generated 0 bytes in 53161 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Apr 08 11:47:33.760544 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-aa4cc94c-b127-48b7-8dbc-5bf10bbe75f9 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:33.763142 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-aa4cc94c-b127-48b7-8dbc-5bf10bbe75f9 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:33.774073 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aa4cc94c-b127-48b7-8dbc-5bf10bbe75f9 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:33.775125 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aa4cc94c-b127-48b7-8dbc-5bf10bbe75f9 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:33.776354 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aa4cc94c-b127-48b7-8dbc-5bf10bbe75f9 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:33.777081 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aa4cc94c-b127-48b7-8dbc-5bf10bbe75f9 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:33.832569 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-aa4cc94c-b127-48b7-8dbc-5bf10bbe75f9 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078715 Apr 08 11:47:33.833570 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:47:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/os-volume_attachments (ip 10.222.0.46) !!! Apr 08 11:47:33.833570 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:47:33 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/os-volume_attachments (10.222.0.46) Apr 08 11:47:33.834598 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: CRITICAL nova [None req-aa4cc94c-b127-48b7-8dbc-5bf10bbe75f9 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Unhandled error: OSError: write error Apr 08 11:47:33.834598 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: ERROR nova OSError: write error Apr 08 11:47:33.834598 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: ERROR nova Apr 08 11:47:33.834911 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1514/2450] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:47:33 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/os-volume_attachments => generated 0 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Apr 08 11:47:33.843566 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1cb32184-0062-46d3-9af1-4fbdc9b7ccfb tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:33.844466 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1cb32184-0062-46d3-9af1-4fbdc9b7ccfb tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:33.854553 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1cb32184-0062-46d3-9af1-4fbdc9b7ccfb tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:33.855353 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1cb32184-0062-46d3-9af1-4fbdc9b7ccfb tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:33.856771 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1cb32184-0062-46d3-9af1-4fbdc9b7ccfb tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:33.857473 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1cb32184-0062-46d3-9af1-4fbdc9b7ccfb tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:33.949501 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-1cb32184-0062-46d3-9af1-4fbdc9b7ccfb tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lazy-loading 'services' on Instance uuid cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8 {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 11:47:34.007596 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-1cb32184-0062-46d3-9af1-4fbdc9b7ccfb tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bb1ca37f-e31a-434c-9e0a-7c00d87867b4) Apr 08 11:47:34.008203 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1cb32184-0062-46d3-9af1-4fbdc9b7ccfb tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bb1ca37f-e31a-434c-9e0a-7c00d87867b4) {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:47:34.009044 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1cb32184-0062-46d3-9af1-4fbdc9b7ccfb tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd" status: 400 len: 269 microversion: 2.1 time: 0.172965 Apr 08 11:47:34.009585 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:47:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd (ip 10.222.0.46) !!! Apr 08 11:47:34.009585 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:47:34 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd (10.222.0.46) Apr 08 11:47:34.010184 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: CRITICAL nova [None req-1cb32184-0062-46d3-9af1-4fbdc9b7ccfb tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Unhandled error: OSError: write error Apr 08 11:47:34.010184 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: ERROR nova OSError: write error Apr 08 11:47:34.010184 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: ERROR nova Apr 08 11:47:34.010448 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1515/2451] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Apr 8 11:47:33 2022] DELETE /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd => generated 0 bytes in 175 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Apr 08 11:47:34.015076 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0461a37b-0fe3-49cc-a561-602a8d2b2b1a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:34.015742 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0461a37b-0fe3-49cc-a561-602a8d2b2b1a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:34.022721 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0461a37b-0fe3-49cc-a561-602a8d2b2b1a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:34.023202 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0461a37b-0fe3-49cc-a561-602a8d2b2b1a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:34.023979 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0461a37b-0fe3-49cc-a561-602a8d2b2b1a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:34.024412 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0461a37b-0fe3-49cc-a561-602a8d2b2b1a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:34.057698 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0461a37b-0fe3-49cc-a561-602a8d2b2b1a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:34.058172 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0461a37b-0fe3-49cc-a561-602a8d2b2b1a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:34.058628 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-0461a37b-0fe3-49cc-a561-602a8d2b2b1a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lazy-loading 'fault' on Instance uuid 6031de3c-c187-4e54-b340-ad53edbe9ee6 {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 11:47:34.101799 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0461a37b-0fe3-49cc-a561-602a8d2b2b1a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f00b50061845bab2717e8483efec94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b145acd79ca42c2a72a54be4e950a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:34.110398 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0461a37b-0fe3-49cc-a561-602a8d2b2b1a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 200 len: 1314 microversion: 2.1 time: 0.098772 Apr 08 11:47:34.111891 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:47:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 (ip 10.222.0.46) !!! Apr 08 11:47:34.111891 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:47:34 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 (10.222.0.46) Apr 08 11:47:34.112808 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: CRITICAL nova [None req-0461a37b-0fe3-49cc-a561-602a8d2b2b1a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Unhandled error: OSError: write error Apr 08 11:47:34.112808 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: ERROR nova OSError: write error Apr 08 11:47:34.112808 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: ERROR nova Apr 08 11:47:34.113252 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1516/2452] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:47:34 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 0 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Apr 08 11:47:34.118507 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-53562af1-a155-4f1b-8380-1726407803b9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:34.119019 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-53562af1-a155-4f1b-8380-1726407803b9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:34.125474 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-53562af1-a155-4f1b-8380-1726407803b9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:34.126048 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-53562af1-a155-4f1b-8380-1726407803b9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:34.127410 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-53562af1-a155-4f1b-8380-1726407803b9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:34.127851 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-53562af1-a155-4f1b-8380-1726407803b9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:34.218453 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-53562af1-a155-4f1b-8380-1726407803b9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] HTTP exception thrown: Instance 594ceb52-9d1f-494f-818d-eb66144bc49d is not attached to volume 669b69f8-d539-406d-a440-9704f783db13 Apr 08 11:47:34.219759 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-53562af1-a155-4f1b-8380-1726407803b9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Returning 404 to user: Instance 594ceb52-9d1f-494f-818d-eb66144bc49d is not attached to volume 669b69f8-d539-406d-a440-9704f783db13 {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:47:34.221353 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-53562af1-a155-4f1b-8380-1726407803b9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "DELETE /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/os-volume_attachments/669b69f8-d539-406d-a440-9704f783db13" status: 404 len: 154 microversion: 2.20 time: 0.106919 Apr 08 11:47:34.222386 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1517/2453] 10.222.0.46 () {60 vars in 1456 bytes} [Fri Apr 8 11:47:34 2022] DELETE /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/os-volume_attachments/669b69f8-d539-406d-a440-9704f783db13 => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 08 11:47:34.231364 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d9fdddaa-f3ba-4bf5-b32c-60378fb7085b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:34.232961 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d9fdddaa-f3ba-4bf5-b32c-60378fb7085b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:34.241521 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d9fdddaa-f3ba-4bf5-b32c-60378fb7085b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:34.242085 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d9fdddaa-f3ba-4bf5-b32c-60378fb7085b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:34.242875 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d9fdddaa-f3ba-4bf5-b32c-60378fb7085b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:34.243311 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d9fdddaa-f3ba-4bf5-b32c-60378fb7085b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:34.279195 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d9fdddaa-f3ba-4bf5-b32c-60378fb7085b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055181 Apr 08 11:47:34.279795 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1518/2454] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:47:34 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:47:34.284607 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b4b1a366-00b5-4841-83c8-c5dae91914ca tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:34.285116 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b4b1a366-00b5-4841-83c8-c5dae91914ca tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:34.291575 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b4b1a366-00b5-4841-83c8-c5dae91914ca tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:34.292032 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b4b1a366-00b5-4841-83c8-c5dae91914ca tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:34.292835 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b4b1a366-00b5-4841-83c8-c5dae91914ca tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:34.293282 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b4b1a366-00b5-4841-83c8-c5dae91914ca tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:34.320304 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b4b1a366-00b5-4841-83c8-c5dae91914ca tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Going to try to terminate instance {{(pid=117800) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 08 11:47:34.740198 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b4b1a366-00b5-4841-83c8-c5dae91914ca tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "DELETE /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 204 len: 0 microversion: 2.1 time: 0.459063 Apr 08 11:47:34.740971 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1519/2455] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 8 11:47:34 2022] DELETE /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 11:47:34.746586 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3d87ec53-9f94-4fca-bc64-4108264093e1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '.version_select at 0x7f041f5e9940>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:34.855865 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3d87ec53-9f94-4fca-bc64-4108264093e1 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-237000854" status: 202 len: 0 microversion: 2.1 time: 0.113407 Apr 08 11:47:34.856617 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1520/2456] 10.222.0.46 () {58 vars in 1259 bytes} [Fri Apr 8 11:47:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-237000854 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 11:47:34.861688 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3b10a285-2f5c-4f69-8be4-2a20811ec9dd tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:34.862349 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3b10a285-2f5c-4f69-8be4-2a20811ec9dd tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:34.869589 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3b10a285-2f5c-4f69-8be4-2a20811ec9dd tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:34.870080 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3b10a285-2f5c-4f69-8be4-2a20811ec9dd tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:34.870883 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3b10a285-2f5c-4f69-8be4-2a20811ec9dd tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:34.871332 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3b10a285-2f5c-4f69-8be4-2a20811ec9dd tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:34.963944 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-3b10a285-2f5c-4f69-8be4-2a20811ec9dd tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lazy-loading 'services' on Instance uuid cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8 {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 11:47:35.025990 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-3b10a285-2f5c-4f69-8be4-2a20811ec9dd tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d8b46843-fffa-471e-a2d7-357b0a40b6e5) Apr 08 11:47:35.025990 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3b10a285-2f5c-4f69-8be4-2a20811ec9dd tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d8b46843-fffa-471e-a2d7-357b0a40b6e5) {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:47:35.025990 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3b10a285-2f5c-4f69-8be4-2a20811ec9dd tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd" status: 400 len: 269 microversion: 2.1 time: 0.167948 Apr 08 11:47:35.026344 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1521/2457] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Apr 8 11:47:34 2022] DELETE /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8/os-volume_attachments/d348daf5-6c07-4a76-ad4c-c62fbc6003fd => generated 269 bytes in 169 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 08 11:47:35.030978 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9be3b505-c9e1-4c29-ac91-ff7b94a4c39a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:35.031595 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9be3b505-c9e1-4c29-ac91-ff7b94a4c39a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] [instance: 6031de3c-c187-4e54-b340-ad53edbe9ee6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:35.038751 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9be3b505-c9e1-4c29-ac91-ff7b94a4c39a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:35.039209 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9be3b505-c9e1-4c29-ac91-ff7b94a4c39a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:35.040003 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9be3b505-c9e1-4c29-ac91-ff7b94a4c39a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:35.040446 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9be3b505-c9e1-4c29-ac91-ff7b94a4c39a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:35.055021 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-9be3b505-c9e1-4c29-ac91-ff7b94a4c39a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] HTTP exception thrown: Instance 6031de3c-c187-4e54-b340-ad53edbe9ee6 could not be found. Apr 08 11:47:35.055626 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9be3b505-c9e1-4c29-ac91-ff7b94a4c39a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Returning 404 to user: Instance 6031de3c-c187-4e54-b340-ad53edbe9ee6 could not be found. {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:47:35.056489 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9be3b505-c9e1-4c29-ac91-ff7b94a4c39a tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6" status: 404 len: 111 microversion: 2.1 time: 0.029402 Apr 08 11:47:35.057100 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1522/2458] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:47:35 2022] GET /compute/v2.1/servers/6031de3c-c187-4e54-b340-ad53edbe9ee6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 11:47:35.062128 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-492c35ee-3303-48e1-bc19-50a521c5b3b0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:35.062627 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-492c35ee-3303-48e1-bc19-50a521c5b3b0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:35.069000 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-492c35ee-3303-48e1-bc19-50a521c5b3b0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:35.071401 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-492c35ee-3303-48e1-bc19-50a521c5b3b0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:35.071401 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-492c35ee-3303-48e1-bc19-50a521c5b3b0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:35.071401 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-492c35ee-3303-48e1-bc19-50a521c5b3b0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:35.151439 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-492c35ee-3303-48e1-bc19-50a521c5b3b0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] HTTP exception thrown: Instance 594ceb52-9d1f-494f-818d-eb66144bc49d is not attached to volume 669b69f8-d539-406d-a440-9704f783db13 Apr 08 11:47:35.152043 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-492c35ee-3303-48e1-bc19-50a521c5b3b0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Returning 404 to user: Instance 594ceb52-9d1f-494f-818d-eb66144bc49d is not attached to volume 669b69f8-d539-406d-a440-9704f783db13 {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:47:35.152898 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-492c35ee-3303-48e1-bc19-50a521c5b3b0 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "DELETE /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/os-volume_attachments/669b69f8-d539-406d-a440-9704f783db13" status: 404 len: 154 microversion: 2.20 time: 0.094866 Apr 08 11:47:35.153478 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1523/2459] 10.222.0.46 () {60 vars in 1456 bytes} [Fri Apr 8 11:47:35 2022] DELETE /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/os-volume_attachments/669b69f8-d539-406d-a440-9704f783db13 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 08 11:47:35.159181 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-296fb7ae-6361-4d53-b9c8-7d96e280989f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:35.160030 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-296fb7ae-6361-4d53-b9c8-7d96e280989f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:35.166485 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-296fb7ae-6361-4d53-b9c8-7d96e280989f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:35.166940 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-296fb7ae-6361-4d53-b9c8-7d96e280989f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:35.167726 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-296fb7ae-6361-4d53-b9c8-7d96e280989f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:35.168163 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-296fb7ae-6361-4d53-b9c8-7d96e280989f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:35.208349 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-296fb7ae-6361-4d53-b9c8-7d96e280989f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053594 Apr 08 11:47:35.208931 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1524/2460] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:47:35 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:47:35.214255 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-98bb4bcb-441d-468f-9d3e-f1fbff48910f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:35.214838 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-98bb4bcb-441d-468f-9d3e-f1fbff48910f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:35.221376 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-98bb4bcb-441d-468f-9d3e-f1fbff48910f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:35.221873 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-98bb4bcb-441d-468f-9d3e-f1fbff48910f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:35.224676 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-98bb4bcb-441d-468f-9d3e-f1fbff48910f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:35.224676 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-98bb4bcb-441d-468f-9d3e-f1fbff48910f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:35.249816 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-98bb4bcb-441d-468f-9d3e-f1fbff48910f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Going to try to terminate instance {{(pid=117800) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 08 11:47:35.383116 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.compute.api [None req-98bb4bcb-441d-468f-9d3e-f1fbff48910f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Instance is already in deleting state, ignoring this request Apr 08 11:47:35.383938 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-98bb4bcb-441d-468f-9d3e-f1fbff48910f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "DELETE /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 204 len: 0 microversion: 2.1 time: 0.173950 Apr 08 11:47:35.384537 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1525/2461] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 8 11:47:35 2022] DELETE /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 11:47:35.389310 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4d8f5471-8bbd-4c4f-aa82-e214d54c6af6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '.version_select at 0x7f041f6fc8b0>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:35.408559 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-4d8f5471-8bbd-4c4f-aa82-e214d54c6af6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] HTTP exception thrown: Keypair tempest-TestVolumeBootPattern-237000854 not found for user 4fa60dc2a9994faab01551d6bc7c62b9 Apr 08 11:47:35.409160 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4d8f5471-8bbd-4c4f-aa82-e214d54c6af6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Returning 404 to user: Keypair tempest-TestVolumeBootPattern-237000854 not found for user 4fa60dc2a9994faab01551d6bc7c62b9 {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:47:35.410092 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4d8f5471-8bbd-4c4f-aa82-e214d54c6af6 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-237000854" status: 404 len: 145 microversion: 2.1 time: 0.024410 Apr 08 11:47:35.410605 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1526/2462] 10.222.0.46 () {58 vars in 1259 bytes} [Fri Apr 8 11:47:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-237000854 => generated 145 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 11:47:35.415310 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3a35a1c1-06b1-4ed2-98e3-9ec0dbd95d25 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '.version_select at 0x7f04287375e0>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:35.507396 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3a35a1c1-06b1-4ed2-98e3-9ec0dbd95d25 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1239149749" status: 202 len: 0 microversion: 2.1 time: 0.095537 Apr 08 11:47:35.507996 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1527/2463] 10.222.0.46 () {58 vars in 1253 bytes} [Fri Apr 8 11:47:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1239149749 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 11:47:35.513146 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9407a591-866e-4aa4-97f0-697980254708 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:35.513654 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9407a591-866e-4aa4-97f0-697980254708 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:35.520983 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9407a591-866e-4aa4-97f0-697980254708 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:35.521430 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9407a591-866e-4aa4-97f0-697980254708 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:35.522275 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9407a591-866e-4aa4-97f0-697980254708 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:35.522710 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9407a591-866e-4aa4-97f0-697980254708 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:35.606411 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-9407a591-866e-4aa4-97f0-697980254708 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] HTTP exception thrown: Instance 594ceb52-9d1f-494f-818d-eb66144bc49d is not attached to volume 669b69f8-d539-406d-a440-9704f783db13 Apr 08 11:47:35.607021 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9407a591-866e-4aa4-97f0-697980254708 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Returning 404 to user: Instance 594ceb52-9d1f-494f-818d-eb66144bc49d is not attached to volume 669b69f8-d539-406d-a440-9704f783db13 {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:47:35.607903 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9407a591-866e-4aa4-97f0-697980254708 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "DELETE /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/os-volume_attachments/669b69f8-d539-406d-a440-9704f783db13" status: 404 len: 154 microversion: 2.20 time: 0.098932 Apr 08 11:47:35.608501 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1528/2464] 10.222.0.46 () {60 vars in 1456 bytes} [Fri Apr 8 11:47:35 2022] DELETE /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/os-volume_attachments/669b69f8-d539-406d-a440-9704f783db13 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 08 11:47:35.613903 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9108f933-97c1-452a-8f7c-21775708a7db tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:35.614850 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9108f933-97c1-452a-8f7c-21775708a7db tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:35.620875 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9108f933-97c1-452a-8f7c-21775708a7db tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:35.621360 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9108f933-97c1-452a-8f7c-21775708a7db tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:35.622167 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9108f933-97c1-452a-8f7c-21775708a7db tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:35.622607 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9108f933-97c1-452a-8f7c-21775708a7db tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:35.654872 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9108f933-97c1-452a-8f7c-21775708a7db tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045305 Apr 08 11:47:35.655452 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1529/2465] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:47:35 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:47:35.659952 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b408952c-caed-4278-8979-dc7824060962 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:35.660538 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b408952c-caed-4278-8979-dc7824060962 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:35.666418 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b408952c-caed-4278-8979-dc7824060962 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:35.666875 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b408952c-caed-4278-8979-dc7824060962 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:35.667662 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b408952c-caed-4278-8979-dc7824060962 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:35.668102 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b408952c-caed-4278-8979-dc7824060962 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:35.693642 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b408952c-caed-4278-8979-dc7824060962 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Going to try to terminate instance {{(pid=117800) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 08 11:47:35.806442 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.compute.api [None req-b408952c-caed-4278-8979-dc7824060962 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Instance is already in deleting state, ignoring this request Apr 08 11:47:35.807287 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b408952c-caed-4278-8979-dc7824060962 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "DELETE /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 204 len: 0 microversion: 2.1 time: 0.150913 Apr 08 11:47:35.807888 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1530/2466] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 8 11:47:35 2022] DELETE /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 11:47:35.812760 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-aaf704df-c14d-4cb7-9cd4-2d63c2d8415f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '.version_select at 0x7f04287393a0>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:35.825640 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-aaf704df-c14d-4cb7-9cd4-2d63c2d8415f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] HTTP exception thrown: Keypair tempest-TestVolumeBootPattern-237000854 not found for user 4fa60dc2a9994faab01551d6bc7c62b9 Apr 08 11:47:35.831334 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-aaf704df-c14d-4cb7-9cd4-2d63c2d8415f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Returning 404 to user: Keypair tempest-TestVolumeBootPattern-237000854 not found for user 4fa60dc2a9994faab01551d6bc7c62b9 {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:47:35.831334 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-aaf704df-c14d-4cb7-9cd4-2d63c2d8415f tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-237000854" status: 404 len: 145 microversion: 2.1 time: 0.018287 Apr 08 11:47:35.831334 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1531/2467] 10.222.0.46 () {58 vars in 1259 bytes} [Fri Apr 8 11:47:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-237000854 => generated 145 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 11:47:35.832547 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9dfc0984-ac90-42af-94c7-42993aaf1d75 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '.version_select at 0x7f041f6fc3a0>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:35.846408 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-9dfc0984-ac90-42af-94c7-42993aaf1d75 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] HTTP exception thrown: Keypair tempest-TestShelveInstance-1239149749 not found for user f5f00b50061845bab2717e8483efec94 Apr 08 11:47:35.847047 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9dfc0984-ac90-42af-94c7-42993aaf1d75 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Returning 404 to user: Keypair tempest-TestShelveInstance-1239149749 not found for user f5f00b50061845bab2717e8483efec94 {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:47:35.851625 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9dfc0984-ac90-42af-94c7-42993aaf1d75 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1239149749" status: 404 len: 143 microversion: 2.1 time: 0.022828 Apr 08 11:47:35.853116 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1532/2468] 10.222.0.46 () {58 vars in 1253 bytes} [Fri Apr 8 11:47:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1239149749 => generated 143 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 11:47:35.858814 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2f248e07-0dca-42ac-8061-344be6b3fd96 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:35.859624 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2f248e07-0dca-42ac-8061-344be6b3fd96 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:35.866094 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2f248e07-0dca-42ac-8061-344be6b3fd96 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:35.866548 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2f248e07-0dca-42ac-8061-344be6b3fd96 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:35.867365 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2f248e07-0dca-42ac-8061-344be6b3fd96 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:35.867794 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2f248e07-0dca-42ac-8061-344be6b3fd96 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:35.985009 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-2f248e07-0dca-42ac-8061-344be6b3fd96 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] HTTP exception thrown: Instance 594ceb52-9d1f-494f-818d-eb66144bc49d is not attached to volume 669b69f8-d539-406d-a440-9704f783db13 Apr 08 11:47:35.985610 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2f248e07-0dca-42ac-8061-344be6b3fd96 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Returning 404 to user: Instance 594ceb52-9d1f-494f-818d-eb66144bc49d is not attached to volume 669b69f8-d539-406d-a440-9704f783db13 {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:47:35.987059 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2f248e07-0dca-42ac-8061-344be6b3fd96 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "DELETE /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/os-volume_attachments/669b69f8-d539-406d-a440-9704f783db13" status: 404 len: 154 microversion: 2.20 time: 0.132338 Apr 08 11:47:35.987625 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1533/2469] 10.222.0.46 () {60 vars in 1456 bytes} [Fri Apr 8 11:47:35 2022] DELETE /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/os-volume_attachments/669b69f8-d539-406d-a440-9704f783db13 => generated 154 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 08 11:47:35.992313 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2e3f658a-f8e6-4553-a0ca-16b2c84e6235 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:35.993249 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2e3f658a-f8e6-4553-a0ca-16b2c84e6235 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:36.000382 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2e3f658a-f8e6-4553-a0ca-16b2c84e6235 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:36.000828 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2e3f658a-f8e6-4553-a0ca-16b2c84e6235 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:36.001657 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2e3f658a-f8e6-4553-a0ca-16b2c84e6235 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:36.002120 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2e3f658a-f8e6-4553-a0ca-16b2c84e6235 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:36.037330 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2e3f658a-f8e6-4553-a0ca-16b2c84e6235 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048380 Apr 08 11:47:36.038224 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1534/2470] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:47:35 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:47:36.043495 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a82ce5aa-fbdb-49ae-9388-a51faebd1a9e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:36.044108 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a82ce5aa-fbdb-49ae-9388-a51faebd1a9e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:36.052636 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a82ce5aa-fbdb-49ae-9388-a51faebd1a9e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:36.053379 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a82ce5aa-fbdb-49ae-9388-a51faebd1a9e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:36.054630 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a82ce5aa-fbdb-49ae-9388-a51faebd1a9e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:36.055306 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a82ce5aa-fbdb-49ae-9388-a51faebd1a9e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:36.084458 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a82ce5aa-fbdb-49ae-9388-a51faebd1a9e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Going to try to terminate instance {{(pid=117800) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 08 11:47:36.138204 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.compute.api [None req-a82ce5aa-fbdb-49ae-9388-a51faebd1a9e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Instance is already in deleting state, ignoring this request Apr 08 11:47:36.139055 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a82ce5aa-fbdb-49ae-9388-a51faebd1a9e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "DELETE /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 204 len: 0 microversion: 2.1 time: 0.099883 Apr 08 11:47:36.139656 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1535/2471] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 8 11:47:36 2022] DELETE /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 11:47:36.144412 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5ab0c77e-7d9a-4f06-bbb6-6c97122a7d61 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '.version_select at 0x7f041f5e9160>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:36.155531 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-5ab0c77e-7d9a-4f06-bbb6-6c97122a7d61 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] HTTP exception thrown: Keypair tempest-TestVolumeBootPattern-237000854 not found for user 4fa60dc2a9994faab01551d6bc7c62b9 Apr 08 11:47:36.156158 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5ab0c77e-7d9a-4f06-bbb6-6c97122a7d61 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Returning 404 to user: Keypair tempest-TestVolumeBootPattern-237000854 not found for user 4fa60dc2a9994faab01551d6bc7c62b9 {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:47:36.157012 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5ab0c77e-7d9a-4f06-bbb6-6c97122a7d61 tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-237000854" status: 404 len: 145 microversion: 2.1 time: 0.016412 Apr 08 11:47:36.158294 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1536/2472] 10.222.0.46 () {58 vars in 1259 bytes} [Fri Apr 8 11:47:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-237000854 => generated 145 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 11:47:36.162976 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3506e45f-4079-4341-84ed-63fd2ebae0d3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '.version_select at 0x7f04241ce700>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:36.175577 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-3506e45f-4079-4341-84ed-63fd2ebae0d3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] HTTP exception thrown: Keypair tempest-TestShelveInstance-1239149749 not found for user f5f00b50061845bab2717e8483efec94 Apr 08 11:47:36.180209 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3506e45f-4079-4341-84ed-63fd2ebae0d3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Returning 404 to user: Keypair tempest-TestShelveInstance-1239149749 not found for user f5f00b50061845bab2717e8483efec94 {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:47:36.180209 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3506e45f-4079-4341-84ed-63fd2ebae0d3 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1239149749" status: 404 len: 143 microversion: 2.1 time: 0.017979 Apr 08 11:47:36.180209 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1537/2473] 10.222.0.46 () {58 vars in 1253 bytes} [Fri Apr 8 11:47:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1239149749 => generated 143 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 11:47:36.182578 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4b06e795-7b91-437a-815a-42cb58e9635b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:36.183085 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4b06e795-7b91-437a-815a-42cb58e9635b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:36.192187 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4b06e795-7b91-437a-815a-42cb58e9635b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:36.193035 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4b06e795-7b91-437a-815a-42cb58e9635b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:36.194439 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4b06e795-7b91-437a-815a-42cb58e9635b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:36.195211 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4b06e795-7b91-437a-815a-42cb58e9635b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:36.297914 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-4b06e795-7b91-437a-815a-42cb58e9635b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] HTTP exception thrown: Instance 594ceb52-9d1f-494f-818d-eb66144bc49d is not attached to volume 669b69f8-d539-406d-a440-9704f783db13 Apr 08 11:47:36.299757 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4b06e795-7b91-437a-815a-42cb58e9635b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Returning 404 to user: Instance 594ceb52-9d1f-494f-818d-eb66144bc49d is not attached to volume 669b69f8-d539-406d-a440-9704f783db13 {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:47:36.306777 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4b06e795-7b91-437a-815a-42cb58e9635b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "DELETE /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/os-volume_attachments/669b69f8-d539-406d-a440-9704f783db13" status: 404 len: 154 microversion: 2.20 time: 0.122553 Apr 08 11:47:36.306777 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1538/2474] 10.222.0.46 () {60 vars in 1456 bytes} [Fri Apr 8 11:47:36 2022] DELETE /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/os-volume_attachments/669b69f8-d539-406d-a440-9704f783db13 => generated 154 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 08 11:47:36.310320 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9115a051-d4a7-4828-acb9-ae926735ab85 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:36.311751 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9115a051-d4a7-4828-acb9-ae926735ab85 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:36.321781 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9115a051-d4a7-4828-acb9-ae926735ab85 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:36.322271 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9115a051-d4a7-4828-acb9-ae926735ab85 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:36.323057 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9115a051-d4a7-4828-acb9-ae926735ab85 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:36.323507 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9115a051-d4a7-4828-acb9-ae926735ab85 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:36.355986 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9115a051-d4a7-4828-acb9-ae926735ab85 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052148 Apr 08 11:47:36.356620 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1539/2475] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:47:36 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:47:36.361158 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-56a1ecb1-a08c-4cb8-9fdf-34f88728dad9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:36.363788 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-56a1ecb1-a08c-4cb8-9fdf-34f88728dad9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:36.367908 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-56a1ecb1-a08c-4cb8-9fdf-34f88728dad9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:36.368369 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-56a1ecb1-a08c-4cb8-9fdf-34f88728dad9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:36.369150 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-56a1ecb1-a08c-4cb8-9fdf-34f88728dad9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:36.369725 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-56a1ecb1-a08c-4cb8-9fdf-34f88728dad9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:36.402436 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-56a1ecb1-a08c-4cb8-9fdf-34f88728dad9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Going to try to terminate instance {{(pid=117800) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 08 11:47:36.449014 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.compute.api [None req-56a1ecb1-a08c-4cb8-9fdf-34f88728dad9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Instance is already in deleting state, ignoring this request Apr 08 11:47:36.449757 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-56a1ecb1-a08c-4cb8-9fdf-34f88728dad9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "DELETE /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 204 len: 0 microversion: 2.1 time: 0.092212 Apr 08 11:47:36.450560 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1540/2476] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 8 11:47:36 2022] DELETE /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 11:47:36.455821 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-fb0d2ddb-e75b-4318-a825-db34b629face tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Calling method '.version_select at 0x7f041f5b2280>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:36.468101 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-fb0d2ddb-e75b-4318-a825-db34b629face tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] HTTP exception thrown: Keypair tempest-TestVolumeBootPattern-237000854 not found for user 4fa60dc2a9994faab01551d6bc7c62b9 Apr 08 11:47:36.469245 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-fb0d2ddb-e75b-4318-a825-db34b629face tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] Returning 404 to user: Keypair tempest-TestVolumeBootPattern-237000854 not found for user 4fa60dc2a9994faab01551d6bc7c62b9 {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:47:36.470986 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-fb0d2ddb-e75b-4318-a825-db34b629face tempest-TestVolumeBootPattern-427325176 tempest-TestVolumeBootPattern-427325176-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-237000854" status: 404 len: 145 microversion: 2.1 time: 0.018669 Apr 08 11:47:36.482374 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1541/2477] 10.222.0.46 () {58 vars in 1259 bytes} [Fri Apr 8 11:47:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-237000854 => generated 145 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 11:47:36.482374 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5fc21648-4cee-4ac5-ade3-7322eacd47b4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Calling method '.version_select at 0x7f0424198c10>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:36.521022 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-5fc21648-4cee-4ac5-ade3-7322eacd47b4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] HTTP exception thrown: Keypair tempest-TestShelveInstance-1239149749 not found for user f5f00b50061845bab2717e8483efec94 Apr 08 11:47:36.521022 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5fc21648-4cee-4ac5-ade3-7322eacd47b4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] Returning 404 to user: Keypair tempest-TestShelveInstance-1239149749 not found for user f5f00b50061845bab2717e8483efec94 {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:47:36.521022 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5fc21648-4cee-4ac5-ade3-7322eacd47b4 tempest-TestShelveInstance-910588812 tempest-TestShelveInstance-910588812-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1239149749" status: 404 len: 143 microversion: 2.1 time: 0.020752 Apr 08 11:47:36.521022 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1542/2478] 10.222.0.46 () {58 vars in 1253 bytes} [Fri Apr 8 11:47:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1239149749 => generated 143 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 11:47:36.521022 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4dfe2677-aa2e-4247-927c-2c8fe086d53f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:36.521641 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4dfe2677-aa2e-4247-927c-2c8fe086d53f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:36.521641 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4dfe2677-aa2e-4247-927c-2c8fe086d53f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:36.521641 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4dfe2677-aa2e-4247-927c-2c8fe086d53f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:36.521641 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4dfe2677-aa2e-4247-927c-2c8fe086d53f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:36.522050 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4dfe2677-aa2e-4247-927c-2c8fe086d53f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:36.545461 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4dfe2677-aa2e-4247-927c-2c8fe086d53f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050306 Apr 08 11:47:36.546260 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1543/2479] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Apr 8 11:47:36 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:47:36.550915 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ea04e29e-1fe0-4103-a70c-d6e4655389bf tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:36.551511 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ea04e29e-1fe0-4103-a70c-d6e4655389bf tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:36.560895 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ea04e29e-1fe0-4103-a70c-d6e4655389bf tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:36.561661 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ea04e29e-1fe0-4103-a70c-d6e4655389bf tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:36.564343 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ea04e29e-1fe0-4103-a70c-d6e4655389bf tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:36.565397 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ea04e29e-1fe0-4103-a70c-d6e4655389bf tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:36.664014 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ea04e29e-1fe0-4103-a70c-d6e4655389bf tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:36.672803 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ea04e29e-1fe0-4103-a70c-d6e4655389bf tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1667 microversion: 2.1 time: 0.125541 Apr 08 11:47:36.673752 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1544/2480] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:47:36 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1667 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:47:36.678576 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1ed902c6-2cf8-4927-8962-1c582166b773 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:36.679082 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1ed902c6-2cf8-4927-8962-1c582166b773 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:36.685938 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ed902c6-2cf8-4927-8962-1c582166b773 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:36.686397 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ed902c6-2cf8-4927-8962-1c582166b773 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:36.687190 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ed902c6-2cf8-4927-8962-1c582166b773 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:36.687813 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ed902c6-2cf8-4927-8962-1c582166b773 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:36.713839 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1ed902c6-2cf8-4927-8962-1c582166b773 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Going to try to terminate instance {{(pid=117800) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 08 11:47:36.719875 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.compute.api [None req-1ed902c6-2cf8-4927-8962-1c582166b773 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Working on deleting snapshot 0d3e34a2-2129-45fb-aacd-68c5b5beb81b from shelved instance... Apr 08 11:47:38.453854 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1ed902c6-2cf8-4927-8962-1c582166b773 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Doing local delete in cell d6edf63b-1f02-42e6-8c3b-21b0e04531ff(cell1) {{(pid=117800) _delete /opt/stack/nova/nova/compute/api.py:2489}} Apr 08 11:47:38.454943 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ed902c6-2cf8-4927-8962-1c582166b773 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:38.455301 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ed902c6-2cf8-4927-8962-1c582166b773 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:38.455744 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.compute.api [None req-1ed902c6-2cf8-4927-8962-1c582166b773 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Apr 08 11:47:38.459818 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.network.neutron [None req-1ed902c6-2cf8-4927-8962-1c582166b773 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] deallocate_for_instance() {{(pid=117800) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1789}} Apr 08 11:47:41.207475 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.network.neutron [None req-1ed902c6-2cf8-4927-8962-1c582166b773 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Updating instance_info_cache with network_info: [] {{(pid=117800) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 08 11:47:41.755822 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.scheduler.client.report [None req-1ed902c6-2cf8-4927-8962-1c582166b773 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Deleted allocations for instance 594ceb52-9d1f-494f-818d-eb66144bc49d Apr 08 11:47:42.217752 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1ed902c6-2cf8-4927-8962-1c582166b773 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "DELETE /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 204 len: 0 microversion: 2.20 time: 5.542959 Apr 08 11:47:42.218694 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1545/2481] 10.222.0.46 () {60 vars in 1279 bytes} [Fri Apr 8 11:47:36 2022] DELETE /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 0 bytes in 5545 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 08 11:47:42.343709 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-cb9e3aa3-2967-46f9-bb58-71cbd9de2804 req-c2fac1d1-4fa2-4472-b950-4c992a900b18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb50c1bb-d2f9-47b0-bc8b-3b6759348c47", "name": "network-vif-deleted", "tag": "c15e181d-7b77-4316-acf3-d678657a02e0"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:47:42.359462 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-cb9e3aa3-2967-46f9-bb58-71cbd9de2804 req-c2fac1d1-4fa2-4472-b950-4c992a900b18 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:42.361505 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-cb9e3aa3-2967-46f9-bb58-71cbd9de2804 req-c2fac1d1-4fa2-4472-b950-4c992a900b18 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:42.385856 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-cb9e3aa3-2967-46f9-bb58-71cbd9de2804 req-c2fac1d1-4fa2-4472-b950-4c992a900b18 service nova] Creating event network-vif-deleted:c15e181d-7b77-4316-acf3-d678657a02e0 for instance bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 on hv-cinder-83607 Apr 08 11:47:42.400848 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-cb9e3aa3-2967-46f9-bb58-71cbd9de2804 req-c2fac1d1-4fa2-4472-b950-4c992a900b18 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176313 Apr 08 11:47:42.401576 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1546/2482] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:47:42.413312 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a7a8599d-98b9-4ba3-a183-f3d177a8b828 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:47:42.414549 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a7a8599d-98b9-4ba3-a183-f3d177a8b828 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:42.421508 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a7a8599d-98b9-4ba3-a183-f3d177a8b828 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:42.422089 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a7a8599d-98b9-4ba3-a183-f3d177a8b828 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:42.423735 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a7a8599d-98b9-4ba3-a183-f3d177a8b828 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:42.424288 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a7a8599d-98b9-4ba3-a183-f3d177a8b828 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:42.552147 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a7a8599d-98b9-4ba3-a183-f3d177a8b828 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "POST /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/action" status: 200 len: 76232 microversion: 2.1 time: 0.148689 Apr 08 11:47:42.560319 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1547/2483] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Apr 8 11:47:42 2022] POST /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0/action => generated 76232 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 11:47:42.648673 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-72c37688-4cf6-4ec7-b3f1-d6546bfb309d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:42.651317 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-72c37688-4cf6-4ec7-b3f1-d6546bfb309d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:42.661311 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-72c37688-4cf6-4ec7-b3f1-d6546bfb309d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:42.661899 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-72c37688-4cf6-4ec7-b3f1-d6546bfb309d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:42.662945 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-72c37688-4cf6-4ec7-b3f1-d6546bfb309d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:42.671819 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-72c37688-4cf6-4ec7-b3f1-d6546bfb309d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:42.851487 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-72c37688-4cf6-4ec7-b3f1-d6546bfb309d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:42.871255 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-72c37688-4cf6-4ec7-b3f1-d6546bfb309d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.316081 Apr 08 11:47:42.884539 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1548/2484] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:47:42 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:47:42.946993 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-efc394d6-3f58-44e8-9338-0d578a569096 req-d323b37e-9151-4685-99c9-f0ef50b3e720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "594ceb52-9d1f-494f-818d-eb66144bc49d", "name": "network-vif-deleted", "tag": "0095761d-6242-494c-b486-fc86278e0746"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:47:42.965736 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-efc394d6-3f58-44e8-9338-0d578a569096 req-d323b37e-9151-4685-99c9-f0ef50b3e720 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:42.966238 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-efc394d6-3f58-44e8-9338-0d578a569096 req-d323b37e-9151-4685-99c9-f0ef50b3e720 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:42.983061 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.compute.server_external_events [req-efc394d6-3f58-44e8-9338-0d578a569096 req-d323b37e-9151-4685-99c9-f0ef50b3e720 service nova] Unable to find a host for instance 594ceb52-9d1f-494f-818d-eb66144bc49d. Dropping event network-vif-deleted {{(pid=117800) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Apr 08 11:47:42.984009 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-efc394d6-3f58-44e8-9338-0d578a569096 req-d323b37e-9151-4685-99c9-f0ef50b3e720 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.111212 Apr 08 11:47:42.984639 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1549/2485] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 112 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 08 11:47:42.990200 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1b102623-0ba2-45a9-8ce7-c42f5a3e2555 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:42.990828 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1b102623-0ba2-45a9-8ce7-c42f5a3e2555 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:42.997109 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1b102623-0ba2-45a9-8ce7-c42f5a3e2555 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:42.997567 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1b102623-0ba2-45a9-8ce7-c42f5a3e2555 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:42.998383 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1b102623-0ba2-45a9-8ce7-c42f5a3e2555 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:42.998949 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1b102623-0ba2-45a9-8ce7-c42f5a3e2555 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:43.012997 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-1b102623-0ba2-45a9-8ce7-c42f5a3e2555 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] HTTP exception thrown: Instance 594ceb52-9d1f-494f-818d-eb66144bc49d could not be found. Apr 08 11:47:43.014147 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1b102623-0ba2-45a9-8ce7-c42f5a3e2555 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Returning 404 to user: Instance 594ceb52-9d1f-494f-818d-eb66144bc49d could not be found. {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:47:43.014618 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1b102623-0ba2-45a9-8ce7-c42f5a3e2555 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 404 len: 111 microversion: 2.20 time: 0.029037 Apr 08 11:47:43.015187 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1550/2486] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:47:42 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 08 11:47:43.026395 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-dd40f6bf-a20f-4485-a3b3-3b3b3e8de2c6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '.version_select at 0x7f041f6ace50>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:43.129568 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-dd40f6bf-a20f-4485-a3b3-3b3b3e8de2c6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1181798372" status: 204 len: 0 microversion: 2.20 time: 0.108168 Apr 08 11:47:43.134106 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1551/2487] 10.222.0.46 () {60 vars in 1261 bytes} [Fri Apr 8 11:47:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1181798372 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 08 11:47:43.890474 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a0ee51eb-1428-441a-8c94-7bcba59b1f47 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:43.891474 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a0ee51eb-1428-441a-8c94-7bcba59b1f47 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:43.899573 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a0ee51eb-1428-441a-8c94-7bcba59b1f47 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:43.900642 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a0ee51eb-1428-441a-8c94-7bcba59b1f47 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:43.901666 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a0ee51eb-1428-441a-8c94-7bcba59b1f47 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:43.902217 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a0ee51eb-1428-441a-8c94-7bcba59b1f47 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:43.988063 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a0ee51eb-1428-441a-8c94-7bcba59b1f47 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:43.996554 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a0ee51eb-1428-441a-8c94-7bcba59b1f47 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.111806 Apr 08 11:47:43.997423 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1552/2488] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:47:43 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:47:44.627747 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2fd64751-b636-4e88-aa71-751516fb62c5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Action: 'create', calling method: .version_select at 0x7f041f6ac310>, body: {"keypair": {"name": "tempest-keypair-1132330898"}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:47:44.655813 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-2fd64751-b636-4e88-aa71-751516fb62c5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Getting quotas for project a5dd9671a5114358a9c0b092a8f1ac1b. Resources: {'key_pairs'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 11:47:44.661090 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-2fd64751-b636-4e88-aa71-751516fb62c5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Getting quotas for user bc136334416c403780722f1c3bb6bc7e and project a5dd9671a5114358a9c0b092a8f1ac1b. Resources: {'key_pairs'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 11:47:44.832859 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-2fd64751-b636-4e88-aa71-751516fb62c5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Getting quotas for project a5dd9671a5114358a9c0b092a8f1ac1b. Resources: {'key_pairs'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 11:47:44.836803 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-2fd64751-b636-4e88-aa71-751516fb62c5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Getting quotas for user bc136334416c403780722f1c3bb6bc7e and project a5dd9671a5114358a9c0b092a8f1ac1b. Resources: {'key_pairs'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 11:47:44.851358 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2fd64751-b636-4e88-aa71-751516fb62c5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.227784 Apr 08 11:47:44.852072 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1553/2489] 10.222.0.46 () {62 vars in 1198 bytes} [Fri Apr 8 11:47:44 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 229 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Apr 08 11:47:45.016760 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c240473f-07b0-4f3d-8055-bba8e4d958a9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:45.018226 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c240473f-07b0-4f3d-8055-bba8e4d958a9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:45.027890 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c240473f-07b0-4f3d-8055-bba8e4d958a9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:45.029393 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c240473f-07b0-4f3d-8055-bba8e4d958a9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:45.031123 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c240473f-07b0-4f3d-8055-bba8e4d958a9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:45.035006 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c240473f-07b0-4f3d-8055-bba8e4d958a9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:45.259594 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c240473f-07b0-4f3d-8055-bba8e4d958a9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:45.272465 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c240473f-07b0-4f3d-8055-bba8e4d958a9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.259638 Apr 08 11:47:45.273050 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1554/2490] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:47:45 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:47:46.291608 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bcf46412-f5bb-4b24-bc0b-6e7fd2dfe10a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:46.292797 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-bcf46412-f5bb-4b24-bc0b-6e7fd2dfe10a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:46.300297 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bcf46412-f5bb-4b24-bc0b-6e7fd2dfe10a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:46.300750 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bcf46412-f5bb-4b24-bc0b-6e7fd2dfe10a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:46.301534 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bcf46412-f5bb-4b24-bc0b-6e7fd2dfe10a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:46.302549 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bcf46412-f5bb-4b24-bc0b-6e7fd2dfe10a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:46.381010 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-bcf46412-f5bb-4b24-bc0b-6e7fd2dfe10a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:46.389411 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-bcf46412-f5bb-4b24-bc0b-6e7fd2dfe10a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.103248 Apr 08 11:47:46.390335 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1555/2491] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:47:46 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:47:47.408530 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0206a9fe-c610-4a4e-a58b-8b80711a0f2f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:47.409335 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0206a9fe-c610-4a4e-a58b-8b80711a0f2f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:47.417243 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0206a9fe-c610-4a4e-a58b-8b80711a0f2f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:47.417751 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0206a9fe-c610-4a4e-a58b-8b80711a0f2f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:47.418587 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0206a9fe-c610-4a4e-a58b-8b80711a0f2f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:47.419019 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0206a9fe-c610-4a4e-a58b-8b80711a0f2f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:47.713612 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0206a9fe-c610-4a4e-a58b-8b80711a0f2f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:47.722441 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0206a9fe-c610-4a4e-a58b-8b80711a0f2f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.318783 Apr 08 11:47:47.723033 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1556/2492] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:47:47 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:47:47.727901 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-53d9d70d-7933-42e9-b415-c34945c845ca tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-86489154", "imageRef": "35b8d8d2-a0e9-4c3e-8586-5e088dec27e6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d2ff69fa-d82a-41b3-8cb1-2e8417495ebf"}], "security_groups": [{"name": "tempest-securitygroup--1123090706"}], "key_name": "tempest-keypair-1132330898", "user_data": "}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:47:47.875342 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.network.neutron [None req-53d9d70d-7933-42e9-b415-c34945c845ca tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] validate_networks() for [('d2ff69fa-d82a-41b3-8cb1-2e8417495ebf', None, None, None, None, None)] {{(pid=117800) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 08 11:47:48.496651 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-53d9d70d-7933-42e9-b415-c34945c845ca tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Flavor limits 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 11:47:48.497356 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-53d9d70d-7933-42e9-b415-c34945c845ca tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Image limits 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 11:47:48.497902 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-53d9d70d-7933-42e9-b415-c34945c845ca tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Flavor pref 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 11:47:48.498570 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-53d9d70d-7933-42e9-b415-c34945c845ca tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Image pref 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 11:47:48.499257 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-53d9d70d-7933-42e9-b415-c34945c845ca tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 11:47:48.510929 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-53d9d70d-7933-42e9-b415-c34945c845ca tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:48.511754 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-53d9d70d-7933-42e9-b415-c34945c845ca tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:48.512819 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-53d9d70d-7933-42e9-b415-c34945c845ca tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:48.513526 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-53d9d70d-7933-42e9-b415-c34945c845ca tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:48.538224 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-53d9d70d-7933-42e9-b415-c34945c845ca tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Getting quotas for project a5dd9671a5114358a9c0b092a8f1ac1b. Resources: {'instances', 'ram', 'cores'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 11:47:48.543386 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-53d9d70d-7933-42e9-b415-c34945c845ca tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Getting quotas for user bc136334416c403780722f1c3bb6bc7e and project a5dd9671a5114358a9c0b092a8f1ac1b. Resources: {'instances', 'ram', 'cores'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 11:47:48.557619 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-53d9d70d-7933-42e9-b415-c34945c845ca tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Going to run 1 instances... {{(pid=117800) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 08 11:47:48.561601 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-53d9d70d-7933-42e9-b415-c34945c845ca tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='35b8d8d2-a0e9-4c3e-8586-5e088dec27e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 08 11:47:48.703989 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-53d9d70d-7933-42e9-b415-c34945c845ca tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.979860 Apr 08 11:47:48.707039 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1557/2493] 10.222.0.46 () {62 vars in 1187 bytes} [Fri Apr 8 11:47:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 983 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 08 11:47:48.724032 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c8233a3c-0841-4a82-834c-f7416872dc44 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:48.724915 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c8233a3c-0841-4a82-834c-f7416872dc44 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:48.787615 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c8233a3c-0841-4a82-834c-f7416872dc44 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:48.797994 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c8233a3c-0841-4a82-834c-f7416872dc44 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:48.800214 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c8233a3c-0841-4a82-834c-f7416872dc44 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:48.801395 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c8233a3c-0841-4a82-834c-f7416872dc44 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1280 microversion: 2.20 time: 0.090532 Apr 08 11:47:48.801983 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1558/2494] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:47:48 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1280 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:47:48.806522 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c1a7c6f6-6b2b-41ee-aad8-d9fac7919212 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:48.807431 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c1a7c6f6-6b2b-41ee-aad8-d9fac7919212 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:48.818399 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c1a7c6f6-6b2b-41ee-aad8-d9fac7919212 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:48.818851 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c1a7c6f6-6b2b-41ee-aad8-d9fac7919212 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:48.819782 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c1a7c6f6-6b2b-41ee-aad8-d9fac7919212 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:48.820549 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c1a7c6f6-6b2b-41ee-aad8-d9fac7919212 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:48.887548 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c1a7c6f6-6b2b-41ee-aad8-d9fac7919212 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:48.895511 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c1a7c6f6-6b2b-41ee-aad8-d9fac7919212 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.092395 Apr 08 11:47:48.896089 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1559/2495] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:47:48 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:47:49.820397 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6907314f-27bf-43d3-bc54-53738abc59f6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:49.821202 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6907314f-27bf-43d3-bc54-53738abc59f6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:49.922352 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6907314f-27bf-43d3-bc54-53738abc59f6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:49.934103 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6907314f-27bf-43d3-bc54-53738abc59f6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:49.936066 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6907314f-27bf-43d3-bc54-53738abc59f6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:49.940047 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6907314f-27bf-43d3-bc54-53738abc59f6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1280 microversion: 2.20 time: 0.123869 Apr 08 11:47:49.940884 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1560/2496] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:47:49 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1280 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:47:49.962946 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-498b372b-7c56-4071-aab8-c170e4a97d8d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:49.965291 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-498b372b-7c56-4071-aab8-c170e4a97d8d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:49.974079 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-498b372b-7c56-4071-aab8-c170e4a97d8d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:49.976419 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-498b372b-7c56-4071-aab8-c170e4a97d8d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:49.977896 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-498b372b-7c56-4071-aab8-c170e4a97d8d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:49.978985 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-498b372b-7c56-4071-aab8-c170e4a97d8d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:50.069571 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-498b372b-7c56-4071-aab8-c170e4a97d8d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:50.084915 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-498b372b-7c56-4071-aab8-c170e4a97d8d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.132158 Apr 08 11:47:50.085936 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1561/2497] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:47:49 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:47:50.961044 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-230236c0-1f44-4596-95e8-2e4ddf1638f3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:50.962560 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-230236c0-1f44-4596-95e8-2e4ddf1638f3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:51.022990 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-230236c0-1f44-4596-95e8-2e4ddf1638f3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:51.030911 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-230236c0-1f44-4596-95e8-2e4ddf1638f3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:51.032441 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-230236c0-1f44-4596-95e8-2e4ddf1638f3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:51.033556 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-230236c0-1f44-4596-95e8-2e4ddf1638f3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1280 microversion: 2.20 time: 0.080060 Apr 08 11:47:51.034132 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1562/2498] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:47:50 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1280 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:47:51.105114 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-07ce732f-4f53-4d7e-b836-96ddbcc330ca tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:51.105114 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-07ce732f-4f53-4d7e-b836-96ddbcc330ca tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:51.119116 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-07ce732f-4f53-4d7e-b836-96ddbcc330ca tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:51.119578 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-07ce732f-4f53-4d7e-b836-96ddbcc330ca tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:51.120380 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-07ce732f-4f53-4d7e-b836-96ddbcc330ca tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:51.120824 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-07ce732f-4f53-4d7e-b836-96ddbcc330ca tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:51.225466 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-07ce732f-4f53-4d7e-b836-96ddbcc330ca tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:51.235475 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-07ce732f-4f53-4d7e-b836-96ddbcc330ca tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.136649 Apr 08 11:47:51.236222 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1563/2499] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:47:51 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:47:52.052329 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-dce8568f-0b6a-42b5-aafa-007d854158f4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:52.053009 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-dce8568f-0b6a-42b5-aafa-007d854158f4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:52.115692 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-dce8568f-0b6a-42b5-aafa-007d854158f4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:52.123546 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-dce8568f-0b6a-42b5-aafa-007d854158f4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:52.125070 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-dce8568f-0b6a-42b5-aafa-007d854158f4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:52.126294 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-dce8568f-0b6a-42b5-aafa-007d854158f4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1280 microversion: 2.20 time: 0.078538 Apr 08 11:47:52.126776 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1564/2500] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:47:52 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1280 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:47:52.253464 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-882de0bb-9ff4-41d1-bee5-fa5db143a756 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:52.254174 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-882de0bb-9ff4-41d1-bee5-fa5db143a756 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:52.261143 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-882de0bb-9ff4-41d1-bee5-fa5db143a756 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:52.261600 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-882de0bb-9ff4-41d1-bee5-fa5db143a756 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:52.262427 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-882de0bb-9ff4-41d1-bee5-fa5db143a756 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:52.262843 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-882de0bb-9ff4-41d1-bee5-fa5db143a756 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:52.331463 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-882de0bb-9ff4-41d1-bee5-fa5db143a756 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:52.336710 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-882de0bb-9ff4-41d1-bee5-fa5db143a756 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.086926 Apr 08 11:47:52.337309 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1565/2501] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:47:52 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:47:53.151640 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-28a9fef1-4895-4a86-b187-0a08059ee199 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:53.151640 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-28a9fef1-4895-4a86-b187-0a08059ee199 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:53.154608 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-28a9fef1-4895-4a86-b187-0a08059ee199 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:53.155471 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-28a9fef1-4895-4a86-b187-0a08059ee199 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:53.156433 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-28a9fef1-4895-4a86-b187-0a08059ee199 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:53.156873 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-28a9fef1-4895-4a86-b187-0a08059ee199 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:53.241697 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-28a9fef1-4895-4a86-b187-0a08059ee199 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:53.250338 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-28a9fef1-4895-4a86-b187-0a08059ee199 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:53.251899 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-28a9fef1-4895-4a86-b187-0a08059ee199 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:53.253042 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-28a9fef1-4895-4a86-b187-0a08059ee199 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1284 microversion: 2.20 time: 0.112550 Apr 08 11:47:53.253626 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1566/2502] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:47:53 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:47:53.353414 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d5335dc4-9478-4df2-a0a3-43c95a0205de tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:53.354061 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d5335dc4-9478-4df2-a0a3-43c95a0205de tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:53.361149 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d5335dc4-9478-4df2-a0a3-43c95a0205de tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:53.361611 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d5335dc4-9478-4df2-a0a3-43c95a0205de tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:53.362430 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d5335dc4-9478-4df2-a0a3-43c95a0205de tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:53.362874 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d5335dc4-9478-4df2-a0a3-43c95a0205de tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:53.431480 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d5335dc4-9478-4df2-a0a3-43c95a0205de tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:53.440019 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d5335dc4-9478-4df2-a0a3-43c95a0205de tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.090451 Apr 08 11:47:53.440610 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1567/2503] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:47:53 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:47:54.271171 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d6d34dc8-f13c-4b39-bc82-4d0fe4960c9b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:54.272004 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d6d34dc8-f13c-4b39-bc82-4d0fe4960c9b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:54.278921 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d6d34dc8-f13c-4b39-bc82-4d0fe4960c9b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:54.279378 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d6d34dc8-f13c-4b39-bc82-4d0fe4960c9b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:54.280193 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d6d34dc8-f13c-4b39-bc82-4d0fe4960c9b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:54.280637 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d6d34dc8-f13c-4b39-bc82-4d0fe4960c9b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:54.345482 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d6d34dc8-f13c-4b39-bc82-4d0fe4960c9b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:54.353553 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d6d34dc8-f13c-4b39-bc82-4d0fe4960c9b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:54.355143 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d6d34dc8-f13c-4b39-bc82-4d0fe4960c9b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:54.356255 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d6d34dc8-f13c-4b39-bc82-4d0fe4960c9b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1284 microversion: 2.20 time: 0.089142 Apr 08 11:47:54.356819 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1568/2504] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:47:54 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:47:54.456807 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3b3e8898-f712-4dd5-8a15-081799b578c5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:54.457431 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3b3e8898-f712-4dd5-8a15-081799b578c5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:54.463334 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3b3e8898-f712-4dd5-8a15-081799b578c5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:54.463790 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3b3e8898-f712-4dd5-8a15-081799b578c5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:54.464572 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3b3e8898-f712-4dd5-8a15-081799b578c5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:54.465016 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3b3e8898-f712-4dd5-8a15-081799b578c5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:54.529111 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3b3e8898-f712-4dd5-8a15-081799b578c5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:54.533168 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3b3e8898-f712-4dd5-8a15-081799b578c5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.080297 Apr 08 11:47:54.533790 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1569/2505] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:47:54 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:47:55.374294 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a4134e16-1da1-40eb-8e34-d460f598694b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:55.374943 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a4134e16-1da1-40eb-8e34-d460f598694b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:55.381600 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a4134e16-1da1-40eb-8e34-d460f598694b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:55.382089 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a4134e16-1da1-40eb-8e34-d460f598694b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:55.382858 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a4134e16-1da1-40eb-8e34-d460f598694b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:55.383324 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a4134e16-1da1-40eb-8e34-d460f598694b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:55.460773 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a4134e16-1da1-40eb-8e34-d460f598694b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:55.460773 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a4134e16-1da1-40eb-8e34-d460f598694b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:55.462670 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a4134e16-1da1-40eb-8e34-d460f598694b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:55.464300 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a4134e16-1da1-40eb-8e34-d460f598694b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1340 microversion: 2.20 time: 0.094148 Apr 08 11:47:55.465111 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1570/2506] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:47:55 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1340 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:47:55.551955 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-03a59e02-fcc6-4021-9f1d-b72f1846d88d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:55.553054 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-03a59e02-fcc6-4021-9f1d-b72f1846d88d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:55.561656 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-03a59e02-fcc6-4021-9f1d-b72f1846d88d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:55.562420 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-03a59e02-fcc6-4021-9f1d-b72f1846d88d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:55.563823 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-03a59e02-fcc6-4021-9f1d-b72f1846d88d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:55.564592 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-03a59e02-fcc6-4021-9f1d-b72f1846d88d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:55.641554 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-03a59e02-fcc6-4021-9f1d-b72f1846d88d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:55.653268 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-03a59e02-fcc6-4021-9f1d-b72f1846d88d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.105643 Apr 08 11:47:55.653879 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1571/2507] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:47:55 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:47:56.484252 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b5cd7be9-3b26-49cc-8363-599dac018b84 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:56.485656 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b5cd7be9-3b26-49cc-8363-599dac018b84 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:56.497027 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b5cd7be9-3b26-49cc-8363-599dac018b84 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:56.497482 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b5cd7be9-3b26-49cc-8363-599dac018b84 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:56.498525 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b5cd7be9-3b26-49cc-8363-599dac018b84 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:56.498967 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b5cd7be9-3b26-49cc-8363-599dac018b84 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:56.654052 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b5cd7be9-3b26-49cc-8363-599dac018b84 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:56.663169 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b5cd7be9-3b26-49cc-8363-599dac018b84 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:56.672263 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b5cd7be9-3b26-49cc-8363-599dac018b84 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:56.672263 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b5cd7be9-3b26-49cc-8363-599dac018b84 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1406 microversion: 2.20 time: 0.187157 Apr 08 11:47:56.672263 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1572/2508] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:47:56 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:47:56.672263 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d95872d4-c310-46f0-9011-e6c14ec9e5ee tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:56.672984 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d95872d4-c310-46f0-9011-e6c14ec9e5ee tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:56.679231 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d95872d4-c310-46f0-9011-e6c14ec9e5ee tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:56.679682 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d95872d4-c310-46f0-9011-e6c14ec9e5ee tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:56.680557 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d95872d4-c310-46f0-9011-e6c14ec9e5ee tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:56.680948 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d95872d4-c310-46f0-9011-e6c14ec9e5ee tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:56.740439 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d95872d4-c310-46f0-9011-e6c14ec9e5ee tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:56.748526 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d95872d4-c310-46f0-9011-e6c14ec9e5ee tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.080390 Apr 08 11:47:56.749150 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1573/2509] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:47:56 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:47:57.231651 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-8ce6b550-4ef8-4485-bdfe-2b04ded0e413 req-39c7e420-58f7-4fb3-b521-d7df25a28f42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1da27a98-0639-4251-ae77-64f51d7f8f76", "tag": "d23a90b6-9e66-48bf-9f26-cdd76a4924a4"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:47:57.240014 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-8ce6b550-4ef8-4485-bdfe-2b04ded0e413 req-39c7e420-58f7-4fb3-b521-d7df25a28f42 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:57.240464 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-8ce6b550-4ef8-4485-bdfe-2b04ded0e413 req-39c7e420-58f7-4fb3-b521-d7df25a28f42 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:57.258272 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-8ce6b550-4ef8-4485-bdfe-2b04ded0e413 req-39c7e420-58f7-4fb3-b521-d7df25a28f42 service nova] Creating event network-changed:d23a90b6-9e66-48bf-9f26-cdd76a4924a4 for instance 1da27a98-0639-4251-ae77-64f51d7f8f76 on hv-cinder-83607 Apr 08 11:47:57.270508 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-8ce6b550-4ef8-4485-bdfe-2b04ded0e413 req-39c7e420-58f7-4fb3-b521-d7df25a28f42 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042520 Apr 08 11:47:57.271299 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1574/2510] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:47:57.687492 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-55093a51-9c0c-4e8b-9f98-2da3482c5743 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:57.695131 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-55093a51-9c0c-4e8b-9f98-2da3482c5743 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:57.695773 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-55093a51-9c0c-4e8b-9f98-2da3482c5743 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:57.696786 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-55093a51-9c0c-4e8b-9f98-2da3482c5743 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:57.698203 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-55093a51-9c0c-4e8b-9f98-2da3482c5743 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:57.698971 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-55093a51-9c0c-4e8b-9f98-2da3482c5743 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:57.867472 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-55093a51-9c0c-4e8b-9f98-2da3482c5743 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:57.875429 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-55093a51-9c0c-4e8b-9f98-2da3482c5743 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:57.876946 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-55093a51-9c0c-4e8b-9f98-2da3482c5743 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:57.878084 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-55093a51-9c0c-4e8b-9f98-2da3482c5743 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1406 microversion: 2.20 time: 0.196165 Apr 08 11:47:57.878654 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1575/2511] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:47:57 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1406 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:47:57.883477 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e6255b59-1d55-46a8-b841-867b8b58ea22 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:57.884096 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e6255b59-1d55-46a8-b841-867b8b58ea22 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:57.890282 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e6255b59-1d55-46a8-b841-867b8b58ea22 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:57.890735 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e6255b59-1d55-46a8-b841-867b8b58ea22 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:57.891544 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e6255b59-1d55-46a8-b841-867b8b58ea22 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:57.891984 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e6255b59-1d55-46a8-b841-867b8b58ea22 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:57.965160 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e6255b59-1d55-46a8-b841-867b8b58ea22 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:57.975163 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e6255b59-1d55-46a8-b841-867b8b58ea22 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.095332 Apr 08 11:47:57.975767 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1576/2512] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:47:57 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:47:58.895880 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6e4cc83a-c8bc-4956-a5cc-10c221593ac4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:58.897130 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6e4cc83a-c8bc-4956-a5cc-10c221593ac4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:58.903807 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6e4cc83a-c8bc-4956-a5cc-10c221593ac4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:58.904264 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6e4cc83a-c8bc-4956-a5cc-10c221593ac4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:58.905208 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6e4cc83a-c8bc-4956-a5cc-10c221593ac4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:58.905656 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6e4cc83a-c8bc-4956-a5cc-10c221593ac4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:59.043706 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6e4cc83a-c8bc-4956-a5cc-10c221593ac4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:59.052447 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6e4cc83a-c8bc-4956-a5cc-10c221593ac4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:59.053998 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6e4cc83a-c8bc-4956-a5cc-10c221593ac4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:59.055147 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6e4cc83a-c8bc-4956-a5cc-10c221593ac4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1406 microversion: 2.20 time: 0.163160 Apr 08 11:47:59.055727 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1577/2513] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:47:58 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:47:59.060063 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f0a4ec1c-d4e8-471c-8f9a-958aad45431a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:47:59.060673 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f0a4ec1c-d4e8-471c-8f9a-958aad45431a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:47:59.066988 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f0a4ec1c-d4e8-471c-8f9a-958aad45431a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:59.067443 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f0a4ec1c-d4e8-471c-8f9a-958aad45431a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:59.068222 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f0a4ec1c-d4e8-471c-8f9a-958aad45431a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:47:59.068668 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f0a4ec1c-d4e8-471c-8f9a-958aad45431a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:47:59.129591 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f0a4ec1c-d4e8-471c-8f9a-958aad45431a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:47:59.138025 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f0a4ec1c-d4e8-471c-8f9a-958aad45431a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.081264 Apr 08 11:47:59.138642 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1578/2514] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:47:59 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:48:00.073597 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5ebce119-863a-4553-8419-116634d3355d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:00.074324 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5ebce119-863a-4553-8419-116634d3355d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:00.081144 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5ebce119-863a-4553-8419-116634d3355d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:00.081594 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5ebce119-863a-4553-8419-116634d3355d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:00.082400 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5ebce119-863a-4553-8419-116634d3355d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:00.082836 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5ebce119-863a-4553-8419-116634d3355d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:00.215382 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5ebce119-863a-4553-8419-116634d3355d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:00.223189 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5ebce119-863a-4553-8419-116634d3355d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:00.224702 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5ebce119-863a-4553-8419-116634d3355d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:00.225840 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5ebce119-863a-4553-8419-116634d3355d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1406 microversion: 2.20 time: 0.156136 Apr 08 11:48:00.226407 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1579/2515] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:48:00 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:48:00.230739 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c1e96971-8cf6-4f1c-b946-e194344c6698 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:00.231353 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c1e96971-8cf6-4f1c-b946-e194344c6698 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:00.237116 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c1e96971-8cf6-4f1c-b946-e194344c6698 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:00.237571 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c1e96971-8cf6-4f1c-b946-e194344c6698 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:00.238406 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c1e96971-8cf6-4f1c-b946-e194344c6698 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:00.238855 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c1e96971-8cf6-4f1c-b946-e194344c6698 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:00.299636 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c1e96971-8cf6-4f1c-b946-e194344c6698 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:00.307689 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c1e96971-8cf6-4f1c-b946-e194344c6698 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.080325 Apr 08 11:48:00.308306 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1580/2516] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:00 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:48:01.243624 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5dd22bec-e977-461b-ad04-955da3c46b2c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:01.244282 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5dd22bec-e977-461b-ad04-955da3c46b2c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:01.250765 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5dd22bec-e977-461b-ad04-955da3c46b2c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:01.251223 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5dd22bec-e977-461b-ad04-955da3c46b2c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:01.252002 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5dd22bec-e977-461b-ad04-955da3c46b2c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:01.252500 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5dd22bec-e977-461b-ad04-955da3c46b2c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:01.386708 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5dd22bec-e977-461b-ad04-955da3c46b2c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:01.394938 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5dd22bec-e977-461b-ad04-955da3c46b2c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:01.396448 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5dd22bec-e977-461b-ad04-955da3c46b2c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:01.397552 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5dd22bec-e977-461b-ad04-955da3c46b2c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1406 microversion: 2.20 time: 0.157833 Apr 08 11:48:01.398150 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1581/2517] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:48:01 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:48:01.402704 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9d342179-a389-49f4-9c57-80499e6c7621 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:01.403305 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9d342179-a389-49f4-9c57-80499e6c7621 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:01.409691 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9d342179-a389-49f4-9c57-80499e6c7621 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:01.410207 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9d342179-a389-49f4-9c57-80499e6c7621 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:01.411006 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9d342179-a389-49f4-9c57-80499e6c7621 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:01.411446 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9d342179-a389-49f4-9c57-80499e6c7621 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:01.469640 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9d342179-a389-49f4-9c57-80499e6c7621 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:01.477369 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9d342179-a389-49f4-9c57-80499e6c7621 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.078275 Apr 08 11:48:01.477971 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1582/2518] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:01 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:48:02.415424 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-794c7e75-938c-42bb-89d5-f9adf3b0f27c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:02.416092 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-794c7e75-938c-42bb-89d5-f9adf3b0f27c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:02.422387 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-794c7e75-938c-42bb-89d5-f9adf3b0f27c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:02.422829 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-794c7e75-938c-42bb-89d5-f9adf3b0f27c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:02.423591 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-794c7e75-938c-42bb-89d5-f9adf3b0f27c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:02.424655 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-794c7e75-938c-42bb-89d5-f9adf3b0f27c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:02.558272 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-794c7e75-938c-42bb-89d5-f9adf3b0f27c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:02.566086 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-794c7e75-938c-42bb-89d5-f9adf3b0f27c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:02.567597 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-794c7e75-938c-42bb-89d5-f9adf3b0f27c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:02.568696 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-794c7e75-938c-42bb-89d5-f9adf3b0f27c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1406 microversion: 2.20 time: 0.157199 Apr 08 11:48:02.569261 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1583/2519] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:48:02 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:48:02.573554 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4d4549e9-62ba-42a9-97d7-cad61ee5dad3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:02.574171 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4d4549e9-62ba-42a9-97d7-cad61ee5dad3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:02.579585 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4d4549e9-62ba-42a9-97d7-cad61ee5dad3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:02.580038 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4d4549e9-62ba-42a9-97d7-cad61ee5dad3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:02.581311 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4d4549e9-62ba-42a9-97d7-cad61ee5dad3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:02.581753 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4d4549e9-62ba-42a9-97d7-cad61ee5dad3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:02.640055 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4d4549e9-62ba-42a9-97d7-cad61ee5dad3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:02.648679 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4d4549e9-62ba-42a9-97d7-cad61ee5dad3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.078434 Apr 08 11:48:02.649293 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1584/2520] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:02 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:48:03.454028 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-534fd8df-eb2f-42a0-b34a-415ca64423a2 req-e5ef383c-b4b9-4199-9e61-5ed6a37b5701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1da27a98-0639-4251-ae77-64f51d7f8f76", "name": "network-vif-plugged", "status": "completed", "tag": "d23a90b6-9e66-48bf-9f26-cdd76a4924a4"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:48:03.462130 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-534fd8df-eb2f-42a0-b34a-415ca64423a2 req-e5ef383c-b4b9-4199-9e61-5ed6a37b5701 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:03.462586 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-534fd8df-eb2f-42a0-b34a-415ca64423a2 req-e5ef383c-b4b9-4199-9e61-5ed6a37b5701 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:03.473553 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-534fd8df-eb2f-42a0-b34a-415ca64423a2 req-e5ef383c-b4b9-4199-9e61-5ed6a37b5701 service nova] Creating event network-vif-plugged:d23a90b6-9e66-48bf-9f26-cdd76a4924a4 for instance 1da27a98-0639-4251-ae77-64f51d7f8f76 on hv-cinder-83607 Apr 08 11:48:03.478763 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-534fd8df-eb2f-42a0-b34a-415ca64423a2 req-e5ef383c-b4b9-4199-9e61-5ed6a37b5701 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198710 Apr 08 11:48:03.479371 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1585/2521] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:48:03.587165 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3fe1c793-ea2a-42b7-a163-b072ae7adcf3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:03.587855 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3fe1c793-ea2a-42b7-a163-b072ae7adcf3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:03.594104 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3fe1c793-ea2a-42b7-a163-b072ae7adcf3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:03.594552 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3fe1c793-ea2a-42b7-a163-b072ae7adcf3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:03.595311 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3fe1c793-ea2a-42b7-a163-b072ae7adcf3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:03.595844 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3fe1c793-ea2a-42b7-a163-b072ae7adcf3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:03.735278 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3fe1c793-ea2a-42b7-a163-b072ae7adcf3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:03.743896 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3fe1c793-ea2a-42b7-a163-b072ae7adcf3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:03.745427 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3fe1c793-ea2a-42b7-a163-b072ae7adcf3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:03.746568 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3fe1c793-ea2a-42b7-a163-b072ae7adcf3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1406 microversion: 2.20 time: 0.163676 Apr 08 11:48:03.750653 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1586/2522] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:48:03 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:48:03.751619 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9377c490-68af-4280-a9bd-52932081da1e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:03.752228 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9377c490-68af-4280-a9bd-52932081da1e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:03.758272 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9377c490-68af-4280-a9bd-52932081da1e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:03.758729 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9377c490-68af-4280-a9bd-52932081da1e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:03.759542 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9377c490-68af-4280-a9bd-52932081da1e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:03.759985 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9377c490-68af-4280-a9bd-52932081da1e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:03.821070 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9377c490-68af-4280-a9bd-52932081da1e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:03.829155 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9377c490-68af-4280-a9bd-52932081da1e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.080965 Apr 08 11:48:03.829742 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1587/2523] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:03 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:48:04.764639 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6ac9897f-dba5-46ae-a3a4-a85512f6dc23 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:04.765372 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6ac9897f-dba5-46ae-a3a4-a85512f6dc23 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:04.772072 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6ac9897f-dba5-46ae-a3a4-a85512f6dc23 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:04.772520 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6ac9897f-dba5-46ae-a3a4-a85512f6dc23 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:04.773279 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6ac9897f-dba5-46ae-a3a4-a85512f6dc23 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:04.773714 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6ac9897f-dba5-46ae-a3a4-a85512f6dc23 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:04.906375 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6ac9897f-dba5-46ae-a3a4-a85512f6dc23 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:04.914860 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6ac9897f-dba5-46ae-a3a4-a85512f6dc23 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:04.916365 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6ac9897f-dba5-46ae-a3a4-a85512f6dc23 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:04.917461 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6ac9897f-dba5-46ae-a3a4-a85512f6dc23 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1406 microversion: 2.20 time: 0.156701 Apr 08 11:48:04.918059 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1588/2524] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:48:04 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:48:04.922330 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-88ad5b9e-b6bc-455a-9c94-49fbc74a1035 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:04.922925 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-88ad5b9e-b6bc-455a-9c94-49fbc74a1035 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:04.928621 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-88ad5b9e-b6bc-455a-9c94-49fbc74a1035 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:04.929063 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-88ad5b9e-b6bc-455a-9c94-49fbc74a1035 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:04.929839 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-88ad5b9e-b6bc-455a-9c94-49fbc74a1035 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:04.930271 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-88ad5b9e-b6bc-455a-9c94-49fbc74a1035 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:04.989157 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-88ad5b9e-b6bc-455a-9c94-49fbc74a1035 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:04.997030 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-88ad5b9e-b6bc-455a-9c94-49fbc74a1035 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.078027 Apr 08 11:48:04.997608 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1589/2525] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:04 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:48:05.934659 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b9d2ce83-d3b4-495a-9aaf-cfd460ee4530 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:05.935316 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b9d2ce83-d3b4-495a-9aaf-cfd460ee4530 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:05.941686 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b9d2ce83-d3b4-495a-9aaf-cfd460ee4530 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:05.942163 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b9d2ce83-d3b4-495a-9aaf-cfd460ee4530 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:05.942936 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b9d2ce83-d3b4-495a-9aaf-cfd460ee4530 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:05.943370 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b9d2ce83-d3b4-495a-9aaf-cfd460ee4530 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:06.077436 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b9d2ce83-d3b4-495a-9aaf-cfd460ee4530 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:06.085234 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b9d2ce83-d3b4-495a-9aaf-cfd460ee4530 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:06.086788 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b9d2ce83-d3b4-495a-9aaf-cfd460ee4530 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:06.087948 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b9d2ce83-d3b4-495a-9aaf-cfd460ee4530 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1598 microversion: 2.20 time: 0.157255 Apr 08 11:48:06.088542 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1590/2526] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:48:05 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1598 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:48:06.092879 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-077d3697-ef53-4a5d-8235-c2b7cd7cdea8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:06.093496 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-077d3697-ef53-4a5d-8235-c2b7cd7cdea8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:06.099800 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-077d3697-ef53-4a5d-8235-c2b7cd7cdea8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:06.100459 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-077d3697-ef53-4a5d-8235-c2b7cd7cdea8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:06.101272 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-077d3697-ef53-4a5d-8235-c2b7cd7cdea8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:06.101705 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-077d3697-ef53-4a5d-8235-c2b7cd7cdea8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:06.162690 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-077d3697-ef53-4a5d-8235-c2b7cd7cdea8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:06.170339 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-077d3697-ef53-4a5d-8235-c2b7cd7cdea8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.080859 Apr 08 11:48:06.170911 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1591/2527] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:06 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:48:06.175441 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2f2a0cb0-ea43-4112-9e5b-387dacc8b3c5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:06.175923 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2f2a0cb0-ea43-4112-9e5b-387dacc8b3c5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:06.182055 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2f2a0cb0-ea43-4112-9e5b-387dacc8b3c5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:06.182499 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2f2a0cb0-ea43-4112-9e5b-387dacc8b3c5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:06.183251 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2f2a0cb0-ea43-4112-9e5b-387dacc8b3c5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:06.183685 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2f2a0cb0-ea43-4112-9e5b-387dacc8b3c5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:06.273087 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2f2a0cb0-ea43-4112-9e5b-387dacc8b3c5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.101060 Apr 08 11:48:06.275256 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1592/2528] 10.222.0.46 () {60 vars in 1315 bytes} [Fri Apr 8 11:48:06 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 11:48:07.192711 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-03efbc36-b35c-4631-b51b-daba7d9a2462 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:07.193784 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-03efbc36-b35c-4631-b51b-daba7d9a2462 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:07.201214 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-03efbc36-b35c-4631-b51b-daba7d9a2462 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:07.201665 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-03efbc36-b35c-4631-b51b-daba7d9a2462 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:07.202475 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-03efbc36-b35c-4631-b51b-daba7d9a2462 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:07.202916 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-03efbc36-b35c-4631-b51b-daba7d9a2462 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:07.265846 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-03efbc36-b35c-4631-b51b-daba7d9a2462 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:07.275943 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-03efbc36-b35c-4631-b51b-daba7d9a2462 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.091907 Apr 08 11:48:07.277056 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1593/2529] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:07 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:48:07.304086 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-49687f80-5a13-4709-83a5-648078499bb4 req-8b306400-c25c-41fa-8c87-8530d4eb28da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1da27a98-0639-4251-ae77-64f51d7f8f76", "tag": "d23a90b6-9e66-48bf-9f26-cdd76a4924a4"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:48:07.312389 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-49687f80-5a13-4709-83a5-648078499bb4 req-8b306400-c25c-41fa-8c87-8530d4eb28da service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:07.312809 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-49687f80-5a13-4709-83a5-648078499bb4 req-8b306400-c25c-41fa-8c87-8530d4eb28da service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:07.324107 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-49687f80-5a13-4709-83a5-648078499bb4 req-8b306400-c25c-41fa-8c87-8530d4eb28da service nova] Creating event network-changed:d23a90b6-9e66-48bf-9f26-cdd76a4924a4 for instance 1da27a98-0639-4251-ae77-64f51d7f8f76 on hv-cinder-83607 Apr 08 11:48:07.329223 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-49687f80-5a13-4709-83a5-648078499bb4 req-8b306400-c25c-41fa-8c87-8530d4eb28da service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029339 Apr 08 11:48:07.329843 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1594/2530] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:48:08.293809 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-299a398f-da56-434e-bf38-566b09d133f4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:08.294608 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-299a398f-da56-434e-bf38-566b09d133f4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:08.301379 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-299a398f-da56-434e-bf38-566b09d133f4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:08.301943 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-299a398f-da56-434e-bf38-566b09d133f4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:08.302802 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-299a398f-da56-434e-bf38-566b09d133f4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:08.303331 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-299a398f-da56-434e-bf38-566b09d133f4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:08.365877 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-299a398f-da56-434e-bf38-566b09d133f4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:08.372691 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-299a398f-da56-434e-bf38-566b09d133f4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.083718 Apr 08 11:48:08.373285 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1595/2531] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:08 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:09.390131 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d65add6f-67af-44b8-9a53-15757b1d9905 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:09.390822 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d65add6f-67af-44b8-9a53-15757b1d9905 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:09.397417 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d65add6f-67af-44b8-9a53-15757b1d9905 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:09.397882 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d65add6f-67af-44b8-9a53-15757b1d9905 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:09.398655 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d65add6f-67af-44b8-9a53-15757b1d9905 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:09.399077 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d65add6f-67af-44b8-9a53-15757b1d9905 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:09.458356 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d65add6f-67af-44b8-9a53-15757b1d9905 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:09.466339 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d65add6f-67af-44b8-9a53-15757b1d9905 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.080020 Apr 08 11:48:09.466919 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1596/2532] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:09 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:10.482991 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5d2bc497-b695-4538-9803-49ebe59b8af5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:10.483596 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5d2bc497-b695-4538-9803-49ebe59b8af5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:10.490629 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5d2bc497-b695-4538-9803-49ebe59b8af5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:10.491085 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5d2bc497-b695-4538-9803-49ebe59b8af5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:10.491858 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5d2bc497-b695-4538-9803-49ebe59b8af5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:10.492304 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5d2bc497-b695-4538-9803-49ebe59b8af5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:10.558565 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5d2bc497-b695-4538-9803-49ebe59b8af5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:10.567108 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5d2bc497-b695-4538-9803-49ebe59b8af5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.087932 Apr 08 11:48:10.567712 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1597/2533] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:10 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:11.588459 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-fcc149f5-6e0c-49fd-9023-8257648ce06f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:11.589155 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-fcc149f5-6e0c-49fd-9023-8257648ce06f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:11.595371 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fcc149f5-6e0c-49fd-9023-8257648ce06f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:11.595799 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fcc149f5-6e0c-49fd-9023-8257648ce06f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:11.596568 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fcc149f5-6e0c-49fd-9023-8257648ce06f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:11.597009 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fcc149f5-6e0c-49fd-9023-8257648ce06f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:11.659184 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-fcc149f5-6e0c-49fd-9023-8257648ce06f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:11.667247 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-fcc149f5-6e0c-49fd-9023-8257648ce06f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.082623 Apr 08 11:48:11.667824 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1598/2534] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:11 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:12.685104 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-694251b4-9989-4ea7-b79f-0a6b10faca00 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:12.685792 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-694251b4-9989-4ea7-b79f-0a6b10faca00 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:12.692294 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-694251b4-9989-4ea7-b79f-0a6b10faca00 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:12.692757 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-694251b4-9989-4ea7-b79f-0a6b10faca00 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:12.693543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-694251b4-9989-4ea7-b79f-0a6b10faca00 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:12.694041 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-694251b4-9989-4ea7-b79f-0a6b10faca00 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:12.757973 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-694251b4-9989-4ea7-b79f-0a6b10faca00 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:12.766015 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-694251b4-9989-4ea7-b79f-0a6b10faca00 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.084857 Apr 08 11:48:12.766599 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1599/2535] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:12 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:13.785457 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ae1f928f-d4ae-4114-a7b6-6e840b431bdb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:13.786511 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ae1f928f-d4ae-4114-a7b6-6e840b431bdb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:13.796551 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ae1f928f-d4ae-4114-a7b6-6e840b431bdb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:13.797006 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ae1f928f-d4ae-4114-a7b6-6e840b431bdb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:13.797812 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ae1f928f-d4ae-4114-a7b6-6e840b431bdb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:13.798261 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ae1f928f-d4ae-4114-a7b6-6e840b431bdb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:13.861803 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ae1f928f-d4ae-4114-a7b6-6e840b431bdb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:13.872061 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ae1f928f-d4ae-4114-a7b6-6e840b431bdb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.092721 Apr 08 11:48:13.872741 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1600/2536] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:13 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:14.891922 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9a64c8df-1a22-4ebc-af87-dfcda18e193f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:14.893066 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9a64c8df-1a22-4ebc-af87-dfcda18e193f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:14.903670 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9a64c8df-1a22-4ebc-af87-dfcda18e193f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:14.904370 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9a64c8df-1a22-4ebc-af87-dfcda18e193f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:14.905571 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9a64c8df-1a22-4ebc-af87-dfcda18e193f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:14.906288 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9a64c8df-1a22-4ebc-af87-dfcda18e193f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:14.968249 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9a64c8df-1a22-4ebc-af87-dfcda18e193f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:14.976210 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9a64c8df-1a22-4ebc-af87-dfcda18e193f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.088242 Apr 08 11:48:14.976780 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1601/2537] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:14 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:15.993049 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f540bb2e-8ce3-46a3-9e61-e53a7ac594be tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:15.993711 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f540bb2e-8ce3-46a3-9e61-e53a7ac594be tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:15.999988 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f540bb2e-8ce3-46a3-9e61-e53a7ac594be tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:16.000450 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f540bb2e-8ce3-46a3-9e61-e53a7ac594be tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:16.001225 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f540bb2e-8ce3-46a3-9e61-e53a7ac594be tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:16.001668 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f540bb2e-8ce3-46a3-9e61-e53a7ac594be tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:16.060628 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f540bb2e-8ce3-46a3-9e61-e53a7ac594be tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:16.069267 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f540bb2e-8ce3-46a3-9e61-e53a7ac594be tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.080668 Apr 08 11:48:16.069867 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1602/2538] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:15 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:17.086429 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-19bc407b-3a23-4f9a-b2ba-601d4b04e00b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:17.087071 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-19bc407b-3a23-4f9a-b2ba-601d4b04e00b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:17.093690 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-19bc407b-3a23-4f9a-b2ba-601d4b04e00b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:17.094176 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-19bc407b-3a23-4f9a-b2ba-601d4b04e00b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:17.094963 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-19bc407b-3a23-4f9a-b2ba-601d4b04e00b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:17.095408 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-19bc407b-3a23-4f9a-b2ba-601d4b04e00b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:17.155579 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-19bc407b-3a23-4f9a-b2ba-601d4b04e00b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:17.163351 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-19bc407b-3a23-4f9a-b2ba-601d4b04e00b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.081351 Apr 08 11:48:17.163928 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1603/2539] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:17 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:18.179952 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7d35309b-66a5-4e7c-9792-63b6698f78b8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:18.180650 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7d35309b-66a5-4e7c-9792-63b6698f78b8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:18.187034 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d35309b-66a5-4e7c-9792-63b6698f78b8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:18.187488 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d35309b-66a5-4e7c-9792-63b6698f78b8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:18.188267 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d35309b-66a5-4e7c-9792-63b6698f78b8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:18.188742 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d35309b-66a5-4e7c-9792-63b6698f78b8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:18.248294 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7d35309b-66a5-4e7c-9792-63b6698f78b8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:18.256271 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7d35309b-66a5-4e7c-9792-63b6698f78b8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.080699 Apr 08 11:48:18.256858 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1604/2540] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:18 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:19.273262 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8d5815c7-c376-46b8-84e5-6aa7b44d44aa tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:19.273984 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8d5815c7-c376-46b8-84e5-6aa7b44d44aa tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:19.280437 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8d5815c7-c376-46b8-84e5-6aa7b44d44aa tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:19.280877 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8d5815c7-c376-46b8-84e5-6aa7b44d44aa tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:19.281635 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8d5815c7-c376-46b8-84e5-6aa7b44d44aa tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:19.282105 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8d5815c7-c376-46b8-84e5-6aa7b44d44aa tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:19.344333 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8d5815c7-c376-46b8-84e5-6aa7b44d44aa tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:19.352097 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8d5815c7-c376-46b8-84e5-6aa7b44d44aa tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.082689 Apr 08 11:48:19.352659 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1605/2541] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:19 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:20.368710 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-77eaf248-0f97-436a-9498-8b151dc232f2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:20.369417 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-77eaf248-0f97-436a-9498-8b151dc232f2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:20.375581 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-77eaf248-0f97-436a-9498-8b151dc232f2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:20.376026 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-77eaf248-0f97-436a-9498-8b151dc232f2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:20.376800 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-77eaf248-0f97-436a-9498-8b151dc232f2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:20.377229 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-77eaf248-0f97-436a-9498-8b151dc232f2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:20.435731 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-77eaf248-0f97-436a-9498-8b151dc232f2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:20.443904 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-77eaf248-0f97-436a-9498-8b151dc232f2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.079055 Apr 08 11:48:20.444506 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1606/2542] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:20 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:21.461013 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-50965c84-24b1-4831-b51a-1f84fe341c77 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:21.461678 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-50965c84-24b1-4831-b51a-1f84fe341c77 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:21.468058 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-50965c84-24b1-4831-b51a-1f84fe341c77 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:21.468518 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-50965c84-24b1-4831-b51a-1f84fe341c77 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:21.469294 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-50965c84-24b1-4831-b51a-1f84fe341c77 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:21.469741 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-50965c84-24b1-4831-b51a-1f84fe341c77 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:21.528875 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-50965c84-24b1-4831-b51a-1f84fe341c77 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:21.537710 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-50965c84-24b1-4831-b51a-1f84fe341c77 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.081037 Apr 08 11:48:21.538318 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1607/2543] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:21 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:22.555184 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ceecf9b0-f6be-411b-a4e7-cbf673855d4e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:22.555877 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ceecf9b0-f6be-411b-a4e7-cbf673855d4e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:22.562103 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ceecf9b0-f6be-411b-a4e7-cbf673855d4e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:22.562564 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ceecf9b0-f6be-411b-a4e7-cbf673855d4e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:22.563368 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ceecf9b0-f6be-411b-a4e7-cbf673855d4e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:22.563818 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ceecf9b0-f6be-411b-a4e7-cbf673855d4e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:22.622779 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ceecf9b0-f6be-411b-a4e7-cbf673855d4e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:22.631030 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ceecf9b0-f6be-411b-a4e7-cbf673855d4e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.080328 Apr 08 11:48:22.631649 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1608/2544] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:22 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:23.647756 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1506f857-35b3-4e0e-be0b-86d6d7f718e1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:23.648372 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1506f857-35b3-4e0e-be0b-86d6d7f718e1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:23.654966 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1506f857-35b3-4e0e-be0b-86d6d7f718e1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:23.655423 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1506f857-35b3-4e0e-be0b-86d6d7f718e1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:23.656189 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1506f857-35b3-4e0e-be0b-86d6d7f718e1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:23.656627 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1506f857-35b3-4e0e-be0b-86d6d7f718e1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:23.715694 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1506f857-35b3-4e0e-be0b-86d6d7f718e1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:23.723490 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1506f857-35b3-4e0e-be0b-86d6d7f718e1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.079590 Apr 08 11:48:23.724076 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1609/2545] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:23 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:24.741345 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d55eb864-261e-47fd-aa72-865cc1066f9c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:24.742076 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d55eb864-261e-47fd-aa72-865cc1066f9c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:24.748532 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d55eb864-261e-47fd-aa72-865cc1066f9c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:24.748980 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d55eb864-261e-47fd-aa72-865cc1066f9c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:24.749749 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d55eb864-261e-47fd-aa72-865cc1066f9c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:24.750287 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d55eb864-261e-47fd-aa72-865cc1066f9c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:24.810917 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d55eb864-261e-47fd-aa72-865cc1066f9c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:24.822915 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d55eb864-261e-47fd-aa72-865cc1066f9c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.086128 Apr 08 11:48:24.823500 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1610/2546] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:24 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:25.839659 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7d2dfca3-0c1b-48e0-9e66-87523427d06c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:25.840344 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7d2dfca3-0c1b-48e0-9e66-87523427d06c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:25.846812 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d2dfca3-0c1b-48e0-9e66-87523427d06c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:25.847265 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d2dfca3-0c1b-48e0-9e66-87523427d06c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:25.848690 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d2dfca3-0c1b-48e0-9e66-87523427d06c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:25.849135 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d2dfca3-0c1b-48e0-9e66-87523427d06c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:25.916887 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7d2dfca3-0c1b-48e0-9e66-87523427d06c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:25.926253 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7d2dfca3-0c1b-48e0-9e66-87523427d06c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.090401 Apr 08 11:48:25.926836 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1611/2547] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:25 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:26.945039 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-297d5885-27f4-41c0-bb28-c3bf3000739e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:26.945674 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-297d5885-27f4-41c0-bb28-c3bf3000739e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:26.951577 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-297d5885-27f4-41c0-bb28-c3bf3000739e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:26.952023 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-297d5885-27f4-41c0-bb28-c3bf3000739e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:26.952778 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-297d5885-27f4-41c0-bb28-c3bf3000739e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:26.953209 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-297d5885-27f4-41c0-bb28-c3bf3000739e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:27.010813 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-297d5885-27f4-41c0-bb28-c3bf3000739e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:27.018535 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-297d5885-27f4-41c0-bb28-c3bf3000739e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.077879 Apr 08 11:48:27.019093 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1612/2548] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:26 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:28.036694 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-121b26fd-4109-45ae-9555-288a293c4bf4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:28.037382 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-121b26fd-4109-45ae-9555-288a293c4bf4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:28.043678 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-121b26fd-4109-45ae-9555-288a293c4bf4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:28.044132 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-121b26fd-4109-45ae-9555-288a293c4bf4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:28.044904 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-121b26fd-4109-45ae-9555-288a293c4bf4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:28.045347 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-121b26fd-4109-45ae-9555-288a293c4bf4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:28.103944 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-121b26fd-4109-45ae-9555-288a293c4bf4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:28.111856 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-121b26fd-4109-45ae-9555-288a293c4bf4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.079647 Apr 08 11:48:28.112434 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1613/2549] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:28 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:29.128501 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d10084fb-cc09-450f-8095-7dc170836172 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:29.129317 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d10084fb-cc09-450f-8095-7dc170836172 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:29.135513 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d10084fb-cc09-450f-8095-7dc170836172 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:29.135969 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d10084fb-cc09-450f-8095-7dc170836172 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:29.136743 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d10084fb-cc09-450f-8095-7dc170836172 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:29.137194 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d10084fb-cc09-450f-8095-7dc170836172 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:29.196800 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d10084fb-cc09-450f-8095-7dc170836172 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:29.204798 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d10084fb-cc09-450f-8095-7dc170836172 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.080181 Apr 08 11:48:29.205408 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1614/2550] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:29 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:30.222005 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-fd43f5b5-801b-480e-8a77-1c8e2d00b4e4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:30.222701 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-fd43f5b5-801b-480e-8a77-1c8e2d00b4e4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:30.229459 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fd43f5b5-801b-480e-8a77-1c8e2d00b4e4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:30.229959 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fd43f5b5-801b-480e-8a77-1c8e2d00b4e4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:30.230734 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fd43f5b5-801b-480e-8a77-1c8e2d00b4e4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:30.231205 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fd43f5b5-801b-480e-8a77-1c8e2d00b4e4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:30.292299 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-fd43f5b5-801b-480e-8a77-1c8e2d00b4e4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:30.300215 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-fd43f5b5-801b-480e-8a77-1c8e2d00b4e4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.082083 Apr 08 11:48:30.300786 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1615/2551] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:30 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:31.316830 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a602b4ed-6698-4acd-bdc3-2155a21bf2bc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:31.318150 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a602b4ed-6698-4acd-bdc3-2155a21bf2bc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:31.324562 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a602b4ed-6698-4acd-bdc3-2155a21bf2bc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:31.325009 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a602b4ed-6698-4acd-bdc3-2155a21bf2bc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:31.325781 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a602b4ed-6698-4acd-bdc3-2155a21bf2bc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:31.326229 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a602b4ed-6698-4acd-bdc3-2155a21bf2bc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:31.384770 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a602b4ed-6698-4acd-bdc3-2155a21bf2bc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:31.392533 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a602b4ed-6698-4acd-bdc3-2155a21bf2bc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.079533 Apr 08 11:48:31.393101 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1616/2552] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:31 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:32.408973 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bcf89cf2-98b0-4d3e-a704-9b7b89377dba tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:32.409659 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-bcf89cf2-98b0-4d3e-a704-9b7b89377dba tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:32.415944 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bcf89cf2-98b0-4d3e-a704-9b7b89377dba tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:32.416396 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bcf89cf2-98b0-4d3e-a704-9b7b89377dba tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:32.417164 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bcf89cf2-98b0-4d3e-a704-9b7b89377dba tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:32.417605 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bcf89cf2-98b0-4d3e-a704-9b7b89377dba tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:32.478511 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-bcf89cf2-98b0-4d3e-a704-9b7b89377dba tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:32.486369 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-bcf89cf2-98b0-4d3e-a704-9b7b89377dba tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.081245 Apr 08 11:48:32.486950 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1617/2553] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:32 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:33.503613 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-334e2cb5-57a4-46a8-a570-7446fe61d831 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:33.504285 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-334e2cb5-57a4-46a8-a570-7446fe61d831 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:33.510700 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-334e2cb5-57a4-46a8-a570-7446fe61d831 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:33.511154 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-334e2cb5-57a4-46a8-a570-7446fe61d831 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:33.511932 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-334e2cb5-57a4-46a8-a570-7446fe61d831 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:33.512377 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-334e2cb5-57a4-46a8-a570-7446fe61d831 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:33.572902 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-334e2cb5-57a4-46a8-a570-7446fe61d831 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:33.580782 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-334e2cb5-57a4-46a8-a570-7446fe61d831 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.081005 Apr 08 11:48:33.581353 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1618/2554] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:33 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:34.597628 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1f500efc-3745-42e8-9719-6392255196d7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:34.598347 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1f500efc-3745-42e8-9719-6392255196d7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:34.605087 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1f500efc-3745-42e8-9719-6392255196d7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:34.605546 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1f500efc-3745-42e8-9719-6392255196d7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:34.606350 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1f500efc-3745-42e8-9719-6392255196d7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:34.606796 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1f500efc-3745-42e8-9719-6392255196d7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:34.666746 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1f500efc-3745-42e8-9719-6392255196d7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:34.674645 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1f500efc-3745-42e8-9719-6392255196d7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.080879 Apr 08 11:48:34.675218 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1619/2555] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:34 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:35.691899 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3a15a0a3-2eac-47e6-a216-637dca7ab619 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:35.692526 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3a15a0a3-2eac-47e6-a216-637dca7ab619 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:35.699540 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3a15a0a3-2eac-47e6-a216-637dca7ab619 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:35.699990 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3a15a0a3-2eac-47e6-a216-637dca7ab619 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:35.700766 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3a15a0a3-2eac-47e6-a216-637dca7ab619 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:35.701203 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3a15a0a3-2eac-47e6-a216-637dca7ab619 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:35.760294 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3a15a0a3-2eac-47e6-a216-637dca7ab619 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:35.768186 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3a15a0a3-2eac-47e6-a216-637dca7ab619 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.080130 Apr 08 11:48:35.768754 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1620/2556] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:35 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:36.784996 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5ce6ae68-f5e1-468d-9e0f-58c694e2d8fd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:36.785687 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5ce6ae68-f5e1-468d-9e0f-58c694e2d8fd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:36.791981 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5ce6ae68-f5e1-468d-9e0f-58c694e2d8fd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:36.792441 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5ce6ae68-f5e1-468d-9e0f-58c694e2d8fd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:36.793210 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5ce6ae68-f5e1-468d-9e0f-58c694e2d8fd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:36.793657 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5ce6ae68-f5e1-468d-9e0f-58c694e2d8fd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:36.855765 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5ce6ae68-f5e1-468d-9e0f-58c694e2d8fd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:36.863891 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5ce6ae68-f5e1-468d-9e0f-58c694e2d8fd tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.082726 Apr 08 11:48:36.864508 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1621/2557] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:36 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:37.883357 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-fa6db072-47ae-42d4-8ec9-41f18eac9633 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:37.884034 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-fa6db072-47ae-42d4-8ec9-41f18eac9633 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:37.890261 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fa6db072-47ae-42d4-8ec9-41f18eac9633 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:37.890714 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fa6db072-47ae-42d4-8ec9-41f18eac9633 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:37.891485 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fa6db072-47ae-42d4-8ec9-41f18eac9633 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:37.891922 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fa6db072-47ae-42d4-8ec9-41f18eac9633 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:37.950849 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-fa6db072-47ae-42d4-8ec9-41f18eac9633 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:37.958602 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-fa6db072-47ae-42d4-8ec9-41f18eac9633 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.079777 Apr 08 11:48:37.959169 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1622/2558] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:37 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:38.975121 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3ccadae9-2c74-47fe-83f6-666dce7c087b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:38.975749 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3ccadae9-2c74-47fe-83f6-666dce7c087b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:38.982083 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3ccadae9-2c74-47fe-83f6-666dce7c087b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:38.982544 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3ccadae9-2c74-47fe-83f6-666dce7c087b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:38.983322 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3ccadae9-2c74-47fe-83f6-666dce7c087b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:38.983771 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3ccadae9-2c74-47fe-83f6-666dce7c087b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:39.045895 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3ccadae9-2c74-47fe-83f6-666dce7c087b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:39.053718 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3ccadae9-2c74-47fe-83f6-666dce7c087b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.082564 Apr 08 11:48:39.054314 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1623/2559] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:38 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:40.071019 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9b62fa05-97e1-4624-ada0-edcf4e298313 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:40.071710 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9b62fa05-97e1-4624-ada0-edcf4e298313 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:40.078087 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9b62fa05-97e1-4624-ada0-edcf4e298313 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:40.078545 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9b62fa05-97e1-4624-ada0-edcf4e298313 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:40.079317 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9b62fa05-97e1-4624-ada0-edcf4e298313 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:40.079761 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9b62fa05-97e1-4624-ada0-edcf4e298313 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:40.140246 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9b62fa05-97e1-4624-ada0-edcf4e298313 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:40.148474 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9b62fa05-97e1-4624-ada0-edcf4e298313 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.081959 Apr 08 11:48:40.149056 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1624/2560] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:40 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:41.165185 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-035e61ca-72fd-4760-8ce2-3dd9c9c50806 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:41.165869 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-035e61ca-72fd-4760-8ce2-3dd9c9c50806 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:41.172135 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-035e61ca-72fd-4760-8ce2-3dd9c9c50806 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:41.172597 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-035e61ca-72fd-4760-8ce2-3dd9c9c50806 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:41.173372 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-035e61ca-72fd-4760-8ce2-3dd9c9c50806 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:41.173839 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-035e61ca-72fd-4760-8ce2-3dd9c9c50806 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:41.234060 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-035e61ca-72fd-4760-8ce2-3dd9c9c50806 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:41.242877 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-035e61ca-72fd-4760-8ce2-3dd9c9c50806 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.082272 Apr 08 11:48:41.243476 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1625/2561] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:41 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:42.260487 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e98d756f-8284-4f76-8480-8badb5391b84 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:42.261505 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e98d756f-8284-4f76-8480-8badb5391b84 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:42.267735 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e98d756f-8284-4f76-8480-8badb5391b84 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:42.268182 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e98d756f-8284-4f76-8480-8badb5391b84 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:42.268962 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e98d756f-8284-4f76-8480-8badb5391b84 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:42.269400 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e98d756f-8284-4f76-8480-8badb5391b84 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:42.330556 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e98d756f-8284-4f76-8480-8badb5391b84 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:42.338583 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e98d756f-8284-4f76-8480-8badb5391b84 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.082009 Apr 08 11:48:42.339163 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1626/2562] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:42 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:43.355785 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-83e7407a-d259-4c55-be7d-fde0184f1a38 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:43.356480 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-83e7407a-d259-4c55-be7d-fde0184f1a38 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:43.362768 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-83e7407a-d259-4c55-be7d-fde0184f1a38 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:43.363225 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-83e7407a-d259-4c55-be7d-fde0184f1a38 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:43.363996 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-83e7407a-d259-4c55-be7d-fde0184f1a38 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:43.364441 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-83e7407a-d259-4c55-be7d-fde0184f1a38 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:43.423616 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-83e7407a-d259-4c55-be7d-fde0184f1a38 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:43.431429 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-83e7407a-d259-4c55-be7d-fde0184f1a38 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.079551 Apr 08 11:48:43.432006 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1627/2563] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:43 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:44.448457 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-35497708-b6a3-4e8e-998f-5e2498508bb7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:44.449151 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-35497708-b6a3-4e8e-998f-5e2498508bb7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:44.455421 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-35497708-b6a3-4e8e-998f-5e2498508bb7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:44.455875 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-35497708-b6a3-4e8e-998f-5e2498508bb7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:44.456648 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-35497708-b6a3-4e8e-998f-5e2498508bb7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:44.457090 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-35497708-b6a3-4e8e-998f-5e2498508bb7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:44.515625 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-35497708-b6a3-4e8e-998f-5e2498508bb7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:44.523838 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-35497708-b6a3-4e8e-998f-5e2498508bb7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.079374 Apr 08 11:48:44.524402 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1628/2564] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:44 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:45.540859 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c0f09f57-7e78-4109-a1d5-4146463ad00e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:45.541539 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c0f09f57-7e78-4109-a1d5-4146463ad00e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:45.547758 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c0f09f57-7e78-4109-a1d5-4146463ad00e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:45.548215 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c0f09f57-7e78-4109-a1d5-4146463ad00e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:45.548984 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c0f09f57-7e78-4109-a1d5-4146463ad00e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:45.549424 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c0f09f57-7e78-4109-a1d5-4146463ad00e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:45.630522 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c0f09f57-7e78-4109-a1d5-4146463ad00e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:45.638523 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c0f09f57-7e78-4109-a1d5-4146463ad00e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.101499 Apr 08 11:48:45.639112 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1629/2565] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:45 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:46.655346 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5351f605-e879-43f4-945c-0384466293c2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:46.655966 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5351f605-e879-43f4-945c-0384466293c2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:46.662857 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5351f605-e879-43f4-945c-0384466293c2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:46.663313 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5351f605-e879-43f4-945c-0384466293c2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:46.664082 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5351f605-e879-43f4-945c-0384466293c2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:46.664522 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5351f605-e879-43f4-945c-0384466293c2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:46.723200 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5351f605-e879-43f4-945c-0384466293c2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:46.731583 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5351f605-e879-43f4-945c-0384466293c2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.080471 Apr 08 11:48:46.732157 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1630/2566] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:46 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:47.748482 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0b9969eb-e978-4686-8dc8-e4117f831e4e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:47.749232 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0b9969eb-e978-4686-8dc8-e4117f831e4e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:47.755836 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0b9969eb-e978-4686-8dc8-e4117f831e4e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:47.756295 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0b9969eb-e978-4686-8dc8-e4117f831e4e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:47.757067 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0b9969eb-e978-4686-8dc8-e4117f831e4e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:47.757502 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0b9969eb-e978-4686-8dc8-e4117f831e4e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:47.821007 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0b9969eb-e978-4686-8dc8-e4117f831e4e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:47.829119 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0b9969eb-e978-4686-8dc8-e4117f831e4e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.084665 Apr 08 11:48:47.829790 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1631/2567] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:47 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:48.846918 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f1aa9f9e-b4c2-4dc2-85a8-fdc9cc0febd0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:48.847607 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f1aa9f9e-b4c2-4dc2-85a8-fdc9cc0febd0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:48.853849 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f1aa9f9e-b4c2-4dc2-85a8-fdc9cc0febd0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:48.854310 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f1aa9f9e-b4c2-4dc2-85a8-fdc9cc0febd0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:48.855087 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f1aa9f9e-b4c2-4dc2-85a8-fdc9cc0febd0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:48.855531 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f1aa9f9e-b4c2-4dc2-85a8-fdc9cc0febd0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:48.915205 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f1aa9f9e-b4c2-4dc2-85a8-fdc9cc0febd0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:48.923252 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f1aa9f9e-b4c2-4dc2-85a8-fdc9cc0febd0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.080150 Apr 08 11:48:48.924095 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1632/2568] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:48 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:49.940521 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b5183723-eddc-4400-92af-0f773212d477 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:49.941170 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b5183723-eddc-4400-92af-0f773212d477 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:49.947345 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b5183723-eddc-4400-92af-0f773212d477 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:49.947799 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b5183723-eddc-4400-92af-0f773212d477 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:49.948599 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b5183723-eddc-4400-92af-0f773212d477 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:49.949074 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b5183723-eddc-4400-92af-0f773212d477 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:50.008170 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b5183723-eddc-4400-92af-0f773212d477 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:50.016110 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b5183723-eddc-4400-92af-0f773212d477 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.079594 Apr 08 11:48:50.016686 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1633/2569] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:49 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:51.033670 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9c259a9b-b4d4-4f39-85d6-0702e22ef83c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:51.034354 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9c259a9b-b4d4-4f39-85d6-0702e22ef83c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:51.041210 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9c259a9b-b4d4-4f39-85d6-0702e22ef83c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:51.041685 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9c259a9b-b4d4-4f39-85d6-0702e22ef83c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:51.042467 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9c259a9b-b4d4-4f39-85d6-0702e22ef83c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:51.042911 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9c259a9b-b4d4-4f39-85d6-0702e22ef83c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:51.102054 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9c259a9b-b4d4-4f39-85d6-0702e22ef83c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:51.110008 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9c259a9b-b4d4-4f39-85d6-0702e22ef83c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.080155 Apr 08 11:48:51.110582 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1634/2570] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:51 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:52.128307 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bccedc78-50ed-41e5-ad12-e764b50d05e3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:52.129023 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-bccedc78-50ed-41e5-ad12-e764b50d05e3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:52.136023 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bccedc78-50ed-41e5-ad12-e764b50d05e3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:52.136472 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bccedc78-50ed-41e5-ad12-e764b50d05e3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:52.137243 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bccedc78-50ed-41e5-ad12-e764b50d05e3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:52.137685 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bccedc78-50ed-41e5-ad12-e764b50d05e3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:52.200048 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-bccedc78-50ed-41e5-ad12-e764b50d05e3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:52.207786 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-bccedc78-50ed-41e5-ad12-e764b50d05e3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.083337 Apr 08 11:48:52.208354 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1635/2571] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:52 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:53.224999 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1fb7ee3c-a774-4ee8-a367-5c331a9c8071 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:53.225704 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1fb7ee3c-a774-4ee8-a367-5c331a9c8071 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:53.232233 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1fb7ee3c-a774-4ee8-a367-5c331a9c8071 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:53.232687 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1fb7ee3c-a774-4ee8-a367-5c331a9c8071 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:53.233474 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1fb7ee3c-a774-4ee8-a367-5c331a9c8071 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:53.233958 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1fb7ee3c-a774-4ee8-a367-5c331a9c8071 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:53.295671 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1fb7ee3c-a774-4ee8-a367-5c331a9c8071 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:53.304394 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1fb7ee3c-a774-4ee8-a367-5c331a9c8071 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.083896 Apr 08 11:48:53.304969 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1636/2572] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:53 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:54.320927 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d62c2b5e-dcee-478d-bcbc-88ae3c5a742c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:54.321636 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d62c2b5e-dcee-478d-bcbc-88ae3c5a742c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:54.328310 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d62c2b5e-dcee-478d-bcbc-88ae3c5a742c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:54.328780 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d62c2b5e-dcee-478d-bcbc-88ae3c5a742c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:54.329572 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d62c2b5e-dcee-478d-bcbc-88ae3c5a742c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:54.330061 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d62c2b5e-dcee-478d-bcbc-88ae3c5a742c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:54.395149 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d62c2b5e-dcee-478d-bcbc-88ae3c5a742c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:54.399599 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d62c2b5e-dcee-478d-bcbc-88ae3c5a742c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.083155 Apr 08 11:48:54.400192 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1637/2573] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:54 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:55.416448 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9b1c5cd7-2ced-4a17-af5c-4ed33171f3c8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:55.417171 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9b1c5cd7-2ced-4a17-af5c-4ed33171f3c8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:55.423489 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9b1c5cd7-2ced-4a17-af5c-4ed33171f3c8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:55.423941 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9b1c5cd7-2ced-4a17-af5c-4ed33171f3c8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:55.424716 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9b1c5cd7-2ced-4a17-af5c-4ed33171f3c8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:55.425149 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9b1c5cd7-2ced-4a17-af5c-4ed33171f3c8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:55.485495 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9b1c5cd7-2ced-4a17-af5c-4ed33171f3c8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:55.495439 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9b1c5cd7-2ced-4a17-af5c-4ed33171f3c8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.082670 Apr 08 11:48:55.496066 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1638/2574] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:55 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:56.512601 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bef35cba-2729-4935-a213-0f116e441c7b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:56.513287 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-bef35cba-2729-4935-a213-0f116e441c7b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:56.519330 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bef35cba-2729-4935-a213-0f116e441c7b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:56.519784 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bef35cba-2729-4935-a213-0f116e441c7b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:56.520559 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bef35cba-2729-4935-a213-0f116e441c7b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:56.520999 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bef35cba-2729-4935-a213-0f116e441c7b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:56.580681 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-bef35cba-2729-4935-a213-0f116e441c7b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:56.588548 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-bef35cba-2729-4935-a213-0f116e441c7b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.079961 Apr 08 11:48:56.589133 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1639/2575] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:56 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:57.604948 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e14a2244-fb70-441d-8984-4b699fa536c4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:57.605638 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e14a2244-fb70-441d-8984-4b699fa536c4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:57.611972 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e14a2244-fb70-441d-8984-4b699fa536c4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:57.612457 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e14a2244-fb70-441d-8984-4b699fa536c4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:57.613230 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e14a2244-fb70-441d-8984-4b699fa536c4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:57.613671 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e14a2244-fb70-441d-8984-4b699fa536c4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:57.678793 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e14a2244-fb70-441d-8984-4b699fa536c4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:57.686930 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e14a2244-fb70-441d-8984-4b699fa536c4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.085776 Apr 08 11:48:57.687498 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1640/2576] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:57 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:58.703559 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-28dbe359-884d-46c3-87d0-6605b39d7443 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:58.704216 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-28dbe359-884d-46c3-87d0-6605b39d7443 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:58.711512 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-28dbe359-884d-46c3-87d0-6605b39d7443 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:58.711994 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-28dbe359-884d-46c3-87d0-6605b39d7443 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:58.712772 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-28dbe359-884d-46c3-87d0-6605b39d7443 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:58.713241 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-28dbe359-884d-46c3-87d0-6605b39d7443 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:58.775293 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-28dbe359-884d-46c3-87d0-6605b39d7443 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:58.783434 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-28dbe359-884d-46c3-87d0-6605b39d7443 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.083751 Apr 08 11:48:58.784009 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1641/2577] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:58 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:48:59.800149 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c42bd40b-92ed-4e77-b62d-78161375401c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:48:59.801024 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c42bd40b-92ed-4e77-b62d-78161375401c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:48:59.807087 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c42bd40b-92ed-4e77-b62d-78161375401c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:59.807523 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c42bd40b-92ed-4e77-b62d-78161375401c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:59.808286 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c42bd40b-92ed-4e77-b62d-78161375401c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:48:59.808729 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c42bd40b-92ed-4e77-b62d-78161375401c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:48:59.869750 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c42bd40b-92ed-4e77-b62d-78161375401c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:48:59.876093 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c42bd40b-92ed-4e77-b62d-78161375401c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.079804 Apr 08 11:48:59.876738 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1642/2578] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:48:59 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:00.893559 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ed635aed-621a-4f57-af40-cbd33dbc6b43 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:00.894276 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ed635aed-621a-4f57-af40-cbd33dbc6b43 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:00.900679 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ed635aed-621a-4f57-af40-cbd33dbc6b43 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:00.901071 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ed635aed-621a-4f57-af40-cbd33dbc6b43 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:00.901882 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ed635aed-621a-4f57-af40-cbd33dbc6b43 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:00.902328 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ed635aed-621a-4f57-af40-cbd33dbc6b43 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:00.968829 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ed635aed-621a-4f57-af40-cbd33dbc6b43 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:00.979917 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ed635aed-621a-4f57-af40-cbd33dbc6b43 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.089489 Apr 08 11:49:00.980498 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1643/2579] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:00 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:01.997311 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-235414c3-9b2a-4400-84fc-4cf291364189 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:01.997992 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-235414c3-9b2a-4400-84fc-4cf291364189 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:02.004142 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-235414c3-9b2a-4400-84fc-4cf291364189 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:02.004588 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-235414c3-9b2a-4400-84fc-4cf291364189 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:02.005346 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-235414c3-9b2a-4400-84fc-4cf291364189 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:02.005795 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-235414c3-9b2a-4400-84fc-4cf291364189 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:02.066928 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-235414c3-9b2a-4400-84fc-4cf291364189 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:02.074819 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-235414c3-9b2a-4400-84fc-4cf291364189 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.081417 Apr 08 11:49:02.075401 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1644/2580] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:01 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:03.092243 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a4ae245f-34dd-4770-84c0-05bef0d50a32 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:03.092920 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a4ae245f-34dd-4770-84c0-05bef0d50a32 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:03.099488 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a4ae245f-34dd-4770-84c0-05bef0d50a32 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:03.099939 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a4ae245f-34dd-4770-84c0-05bef0d50a32 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:03.100697 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a4ae245f-34dd-4770-84c0-05bef0d50a32 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:03.101133 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a4ae245f-34dd-4770-84c0-05bef0d50a32 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:03.160239 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a4ae245f-34dd-4770-84c0-05bef0d50a32 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:03.168194 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a4ae245f-34dd-4770-84c0-05bef0d50a32 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.079912 Apr 08 11:49:03.168716 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1645/2581] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:03 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:04.184974 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-00497fe1-7a40-4d3b-82fd-36108e7f88f0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:04.185676 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-00497fe1-7a40-4d3b-82fd-36108e7f88f0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:04.192099 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-00497fe1-7a40-4d3b-82fd-36108e7f88f0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:04.192556 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-00497fe1-7a40-4d3b-82fd-36108e7f88f0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:04.193354 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-00497fe1-7a40-4d3b-82fd-36108e7f88f0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:04.193829 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-00497fe1-7a40-4d3b-82fd-36108e7f88f0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:04.255624 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-00497fe1-7a40-4d3b-82fd-36108e7f88f0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:04.263694 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-00497fe1-7a40-4d3b-82fd-36108e7f88f0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.082562 Apr 08 11:49:04.264277 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1646/2582] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:04 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:05.280399 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-faf7ef49-b733-4197-aca6-2dc627ab6c78 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:05.281085 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-faf7ef49-b733-4197-aca6-2dc627ab6c78 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:05.287405 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-faf7ef49-b733-4197-aca6-2dc627ab6c78 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:05.287860 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-faf7ef49-b733-4197-aca6-2dc627ab6c78 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:05.289135 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-faf7ef49-b733-4197-aca6-2dc627ab6c78 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:05.289576 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-faf7ef49-b733-4197-aca6-2dc627ab6c78 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:05.348313 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-faf7ef49-b733-4197-aca6-2dc627ab6c78 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:05.356591 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-faf7ef49-b733-4197-aca6-2dc627ab6c78 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.080334 Apr 08 11:49:05.357169 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1647/2583] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:05 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:06.373692 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-02b143e3-c006-4e62-8ece-57aca708dbc6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:06.374400 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-02b143e3-c006-4e62-8ece-57aca708dbc6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:06.380665 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-02b143e3-c006-4e62-8ece-57aca708dbc6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:06.381122 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-02b143e3-c006-4e62-8ece-57aca708dbc6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:06.382017 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-02b143e3-c006-4e62-8ece-57aca708dbc6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:06.383150 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-02b143e3-c006-4e62-8ece-57aca708dbc6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:06.441850 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-02b143e3-c006-4e62-8ece-57aca708dbc6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:06.450649 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-02b143e3-c006-4e62-8ece-57aca708dbc6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.080826 Apr 08 11:49:06.451226 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1648/2584] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:06 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:07.467743 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-aec247dc-6716-4b84-af45-2f55428f89eb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:07.468432 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-aec247dc-6716-4b84-af45-2f55428f89eb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:07.474620 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aec247dc-6716-4b84-af45-2f55428f89eb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:07.475082 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aec247dc-6716-4b84-af45-2f55428f89eb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:07.475845 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aec247dc-6716-4b84-af45-2f55428f89eb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:07.476300 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aec247dc-6716-4b84-af45-2f55428f89eb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:07.534966 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-aec247dc-6716-4b84-af45-2f55428f89eb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:07.542574 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-aec247dc-6716-4b84-af45-2f55428f89eb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.078676 Apr 08 11:49:07.543144 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1649/2585] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:07 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:08.559139 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7a2bbafd-7836-458e-9435-e485ac195eb1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:08.559841 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7a2bbafd-7836-458e-9435-e485ac195eb1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:08.565987 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7a2bbafd-7836-458e-9435-e485ac195eb1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:08.566435 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7a2bbafd-7836-458e-9435-e485ac195eb1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:08.567193 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7a2bbafd-7836-458e-9435-e485ac195eb1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:08.567625 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7a2bbafd-7836-458e-9435-e485ac195eb1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:08.625933 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7a2bbafd-7836-458e-9435-e485ac195eb1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:08.633836 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7a2bbafd-7836-458e-9435-e485ac195eb1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.078560 Apr 08 11:49:08.634412 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1650/2586] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:08 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:09.650492 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9d0d0d6f-b708-4c75-a1bb-781c6554f07a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:09.651133 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9d0d0d6f-b708-4c75-a1bb-781c6554f07a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:09.657757 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9d0d0d6f-b708-4c75-a1bb-781c6554f07a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:09.658883 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9d0d0d6f-b708-4c75-a1bb-781c6554f07a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:09.659051 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9d0d0d6f-b708-4c75-a1bb-781c6554f07a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:09.659471 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9d0d0d6f-b708-4c75-a1bb-781c6554f07a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:09.720023 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9d0d0d6f-b708-4c75-a1bb-781c6554f07a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:09.728696 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9d0d0d6f-b708-4c75-a1bb-781c6554f07a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.082120 Apr 08 11:49:09.729280 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1651/2587] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:09 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:10.744404 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-978942e5-edc7-4c81-ad98-4beaaef9806b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:10.745071 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-978942e5-edc7-4c81-ad98-4beaaef9806b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:10.751313 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-978942e5-edc7-4c81-ad98-4beaaef9806b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:10.751767 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-978942e5-edc7-4c81-ad98-4beaaef9806b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:10.752540 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-978942e5-edc7-4c81-ad98-4beaaef9806b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:10.752985 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-978942e5-edc7-4c81-ad98-4beaaef9806b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:10.815748 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-978942e5-edc7-4c81-ad98-4beaaef9806b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:10.823786 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-978942e5-edc7-4c81-ad98-4beaaef9806b tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.083266 Apr 08 11:49:10.824405 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1652/2588] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:10 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:11.840444 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e9c70b7f-c555-4a78-89cd-96d91e1f3452 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:11.841120 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e9c70b7f-c555-4a78-89cd-96d91e1f3452 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:11.847373 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e9c70b7f-c555-4a78-89cd-96d91e1f3452 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:11.847860 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e9c70b7f-c555-4a78-89cd-96d91e1f3452 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:11.848633 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e9c70b7f-c555-4a78-89cd-96d91e1f3452 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:11.849078 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e9c70b7f-c555-4a78-89cd-96d91e1f3452 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:11.908259 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e9c70b7f-c555-4a78-89cd-96d91e1f3452 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:11.916622 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e9c70b7f-c555-4a78-89cd-96d91e1f3452 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.080013 Apr 08 11:49:11.917198 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1653/2589] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:11 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:12.933284 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d0aeb2bb-c67a-4101-9de3-edc841c14bf6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:12.933951 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d0aeb2bb-c67a-4101-9de3-edc841c14bf6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:12.940211 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d0aeb2bb-c67a-4101-9de3-edc841c14bf6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:12.940656 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d0aeb2bb-c67a-4101-9de3-edc841c14bf6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:12.941413 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d0aeb2bb-c67a-4101-9de3-edc841c14bf6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:12.941878 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d0aeb2bb-c67a-4101-9de3-edc841c14bf6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:13.003627 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d0aeb2bb-c67a-4101-9de3-edc841c14bf6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:13.011744 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d0aeb2bb-c67a-4101-9de3-edc841c14bf6 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.082321 Apr 08 11:49:13.012331 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1654/2590] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:12 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:14.029228 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c892d7e3-50e9-4369-8397-3b715e15d580 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:14.029924 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c892d7e3-50e9-4369-8397-3b715e15d580 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:14.036207 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c892d7e3-50e9-4369-8397-3b715e15d580 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:14.036663 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c892d7e3-50e9-4369-8397-3b715e15d580 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:14.037437 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c892d7e3-50e9-4369-8397-3b715e15d580 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:14.037913 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c892d7e3-50e9-4369-8397-3b715e15d580 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:14.097441 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c892d7e3-50e9-4369-8397-3b715e15d580 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:14.105152 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c892d7e3-50e9-4369-8397-3b715e15d580 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.080064 Apr 08 11:49:14.105711 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1655/2591] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:14 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:15.122088 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d0f150a2-1ae0-46d7-8dfd-3b2262c24ab1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:15.122781 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d0f150a2-1ae0-46d7-8dfd-3b2262c24ab1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:15.129207 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d0f150a2-1ae0-46d7-8dfd-3b2262c24ab1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:15.129662 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d0f150a2-1ae0-46d7-8dfd-3b2262c24ab1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:15.130474 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d0f150a2-1ae0-46d7-8dfd-3b2262c24ab1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:15.130923 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d0f150a2-1ae0-46d7-8dfd-3b2262c24ab1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:15.190323 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d0f150a2-1ae0-46d7-8dfd-3b2262c24ab1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:15.198255 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d0f150a2-1ae0-46d7-8dfd-3b2262c24ab1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.079973 Apr 08 11:49:15.198831 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1656/2592] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:15 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:16.214612 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-24572106-3897-4e73-9fae-d1b2e0a1788c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:16.215320 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-24572106-3897-4e73-9fae-d1b2e0a1788c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:16.221557 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-24572106-3897-4e73-9fae-d1b2e0a1788c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:16.222111 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-24572106-3897-4e73-9fae-d1b2e0a1788c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:16.222884 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-24572106-3897-4e73-9fae-d1b2e0a1788c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:16.223328 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-24572106-3897-4e73-9fae-d1b2e0a1788c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:16.292709 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-24572106-3897-4e73-9fae-d1b2e0a1788c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:16.300589 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-24572106-3897-4e73-9fae-d1b2e0a1788c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.089833 Apr 08 11:49:16.301176 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1657/2593] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:16 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:17.318099 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4e8f9cbe-4ce1-4be3-a91a-3e65a9163a08 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:17.318776 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4e8f9cbe-4ce1-4be3-a91a-3e65a9163a08 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:17.325844 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4e8f9cbe-4ce1-4be3-a91a-3e65a9163a08 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:17.326306 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4e8f9cbe-4ce1-4be3-a91a-3e65a9163a08 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:17.327078 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4e8f9cbe-4ce1-4be3-a91a-3e65a9163a08 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:17.327518 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4e8f9cbe-4ce1-4be3-a91a-3e65a9163a08 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:17.389353 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4e8f9cbe-4ce1-4be3-a91a-3e65a9163a08 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:17.397447 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4e8f9cbe-4ce1-4be3-a91a-3e65a9163a08 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.083167 Apr 08 11:49:17.398724 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1658/2594] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:17 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:18.415602 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b90a05d3-0d97-4cc2-b49b-891c4841f865 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:18.416304 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b90a05d3-0d97-4cc2-b49b-891c4841f865 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:18.422559 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b90a05d3-0d97-4cc2-b49b-891c4841f865 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:18.423034 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b90a05d3-0d97-4cc2-b49b-891c4841f865 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:18.423827 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b90a05d3-0d97-4cc2-b49b-891c4841f865 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:18.424266 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b90a05d3-0d97-4cc2-b49b-891c4841f865 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:18.482543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b90a05d3-0d97-4cc2-b49b-891c4841f865 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:18.490276 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b90a05d3-0d97-4cc2-b49b-891c4841f865 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.079119 Apr 08 11:49:18.490856 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1659/2595] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:18 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:19.506647 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d9d8bb76-49d6-4582-a72b-7dbf33b6c777 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:19.507840 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d9d8bb76-49d6-4582-a72b-7dbf33b6c777 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:19.514118 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d9d8bb76-49d6-4582-a72b-7dbf33b6c777 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:19.514572 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d9d8bb76-49d6-4582-a72b-7dbf33b6c777 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:19.515459 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d9d8bb76-49d6-4582-a72b-7dbf33b6c777 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:19.515909 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d9d8bb76-49d6-4582-a72b-7dbf33b6c777 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:19.575475 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d9d8bb76-49d6-4582-a72b-7dbf33b6c777 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:19.583458 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d9d8bb76-49d6-4582-a72b-7dbf33b6c777 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.080653 Apr 08 11:49:19.584032 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1660/2596] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:19 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:20.600749 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ccd4ce62-7c0f-4e58-80ab-7a656e81d4ee tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:20.601478 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ccd4ce62-7c0f-4e58-80ab-7a656e81d4ee tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:20.607678 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ccd4ce62-7c0f-4e58-80ab-7a656e81d4ee tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:20.608122 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ccd4ce62-7c0f-4e58-80ab-7a656e81d4ee tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:20.608895 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ccd4ce62-7c0f-4e58-80ab-7a656e81d4ee tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:20.609342 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ccd4ce62-7c0f-4e58-80ab-7a656e81d4ee tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:20.669697 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ccd4ce62-7c0f-4e58-80ab-7a656e81d4ee tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:20.677807 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ccd4ce62-7c0f-4e58-80ab-7a656e81d4ee tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.080920 Apr 08 11:49:20.678374 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1661/2597] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:20 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:21.695637 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9b60616c-6f3b-4c8b-bc2c-610989910525 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:21.696292 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9b60616c-6f3b-4c8b-bc2c-610989910525 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:21.702638 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9b60616c-6f3b-4c8b-bc2c-610989910525 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:21.703088 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9b60616c-6f3b-4c8b-bc2c-610989910525 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:21.703864 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9b60616c-6f3b-4c8b-bc2c-610989910525 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:21.704299 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9b60616c-6f3b-4c8b-bc2c-610989910525 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:21.763251 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9b60616c-6f3b-4c8b-bc2c-610989910525 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:21.771021 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9b60616c-6f3b-4c8b-bc2c-610989910525 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.079814 Apr 08 11:49:21.771592 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1662/2598] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:21 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:22.789118 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-57cc5e26-3610-460c-8187-07d9dde215ce tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:22.789805 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-57cc5e26-3610-460c-8187-07d9dde215ce tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:22.796118 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-57cc5e26-3610-460c-8187-07d9dde215ce tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:22.796570 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-57cc5e26-3610-460c-8187-07d9dde215ce tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:22.797340 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-57cc5e26-3610-460c-8187-07d9dde215ce tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:22.797790 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-57cc5e26-3610-460c-8187-07d9dde215ce tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:22.856627 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-57cc5e26-3610-460c-8187-07d9dde215ce tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:22.864452 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-57cc5e26-3610-460c-8187-07d9dde215ce tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.079822 Apr 08 11:49:22.865082 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1663/2599] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:22 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:22.981470 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5cc20974-bc9b-4676-a420-ea44545a58a1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:22.982011 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5cc20974-bc9b-4676-a420-ea44545a58a1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:22.987992 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5cc20974-bc9b-4676-a420-ea44545a58a1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:22.988438 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5cc20974-bc9b-4676-a420-ea44545a58a1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:22.989389 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5cc20974-bc9b-4676-a420-ea44545a58a1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:22.989857 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5cc20974-bc9b-4676-a420-ea44545a58a1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:23.013965 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5cc20974-bc9b-4676-a420-ea44545a58a1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76/ips" status: 200 len: 152 microversion: 2.20 time: 0.147880 Apr 08 11:49:23.014597 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1664/2600] 10.222.0.46 () {60 vars in 1288 bytes} [Fri Apr 8 11:49:22 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76/ips => generated 152 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 11:49:23.880394 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-445553e5-077c-48cf-8843-0ad15704f8aa tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:23.881031 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-445553e5-077c-48cf-8843-0ad15704f8aa tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:23.887292 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-445553e5-077c-48cf-8843-0ad15704f8aa tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:23.887759 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-445553e5-077c-48cf-8843-0ad15704f8aa tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:23.888531 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-445553e5-077c-48cf-8843-0ad15704f8aa tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:23.888977 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-445553e5-077c-48cf-8843-0ad15704f8aa tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:23.950852 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-445553e5-077c-48cf-8843-0ad15704f8aa tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:23.958573 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-445553e5-077c-48cf-8843-0ad15704f8aa tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.082079 Apr 08 11:49:23.959143 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1665/2601] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:23 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:24.975166 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7471c485-2f9e-409d-b37f-4f1f114d34ce tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:24.975822 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7471c485-2f9e-409d-b37f-4f1f114d34ce tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:24.982135 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7471c485-2f9e-409d-b37f-4f1f114d34ce tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:24.982592 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7471c485-2f9e-409d-b37f-4f1f114d34ce tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:24.983361 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7471c485-2f9e-409d-b37f-4f1f114d34ce tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:24.983805 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7471c485-2f9e-409d-b37f-4f1f114d34ce tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:25.043990 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7471c485-2f9e-409d-b37f-4f1f114d34ce tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:25.050717 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7471c485-2f9e-409d-b37f-4f1f114d34ce tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.079399 Apr 08 11:49:25.051295 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1666/2602] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:24 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:26.067619 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-524b3a3a-9dd0-4963-82f8-803269725a52 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:26.068348 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-524b3a3a-9dd0-4963-82f8-803269725a52 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:26.075120 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-524b3a3a-9dd0-4963-82f8-803269725a52 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:26.075577 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-524b3a3a-9dd0-4963-82f8-803269725a52 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:26.076352 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-524b3a3a-9dd0-4963-82f8-803269725a52 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:26.076798 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-524b3a3a-9dd0-4963-82f8-803269725a52 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:26.135667 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-524b3a3a-9dd0-4963-82f8-803269725a52 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:26.143391 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-524b3a3a-9dd0-4963-82f8-803269725a52 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.079603 Apr 08 11:49:26.143969 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1667/2603] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:26 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:27.161168 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-20723efa-bb35-40a1-af55-ac60ba3c0c3d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:27.161843 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-20723efa-bb35-40a1-af55-ac60ba3c0c3d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:27.168347 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-20723efa-bb35-40a1-af55-ac60ba3c0c3d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:27.168801 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-20723efa-bb35-40a1-af55-ac60ba3c0c3d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:27.169571 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-20723efa-bb35-40a1-af55-ac60ba3c0c3d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:27.170113 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-20723efa-bb35-40a1-af55-ac60ba3c0c3d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:27.228631 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-20723efa-bb35-40a1-af55-ac60ba3c0c3d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:27.236581 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-20723efa-bb35-40a1-af55-ac60ba3c0c3d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.079344 Apr 08 11:49:27.237156 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1668/2604] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:27 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:28.252375 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-13f1613f-f643-414e-b02f-7d3ee8b4f1a9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:28.253082 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-13f1613f-f643-414e-b02f-7d3ee8b4f1a9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:28.260159 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-13f1613f-f643-414e-b02f-7d3ee8b4f1a9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:28.260617 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-13f1613f-f643-414e-b02f-7d3ee8b4f1a9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:28.261402 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-13f1613f-f643-414e-b02f-7d3ee8b4f1a9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:28.264115 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-13f1613f-f643-414e-b02f-7d3ee8b4f1a9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:28.322233 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-13f1613f-f643-414e-b02f-7d3ee8b4f1a9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:28.330259 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-13f1613f-f643-414e-b02f-7d3ee8b4f1a9 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.081653 Apr 08 11:49:28.330835 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1669/2605] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:28 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:29.347057 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0745b98f-63e7-4a5f-9034-20dd5677b3da tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:29.347749 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0745b98f-63e7-4a5f-9034-20dd5677b3da tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:29.353964 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0745b98f-63e7-4a5f-9034-20dd5677b3da tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:29.354418 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0745b98f-63e7-4a5f-9034-20dd5677b3da tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:29.355175 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0745b98f-63e7-4a5f-9034-20dd5677b3da tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:29.355612 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0745b98f-63e7-4a5f-9034-20dd5677b3da tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:29.416436 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0745b98f-63e7-4a5f-9034-20dd5677b3da tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:29.424226 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0745b98f-63e7-4a5f-9034-20dd5677b3da tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.081081 Apr 08 11:49:29.424799 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1670/2606] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:29 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:30.441579 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3e02c580-8bed-4735-bce2-67b6df08904a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:30.442298 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3e02c580-8bed-4735-bce2-67b6df08904a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:30.448548 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3e02c580-8bed-4735-bce2-67b6df08904a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:30.449001 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3e02c580-8bed-4735-bce2-67b6df08904a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:30.449798 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3e02c580-8bed-4735-bce2-67b6df08904a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:30.450240 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3e02c580-8bed-4735-bce2-67b6df08904a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:30.509710 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3e02c580-8bed-4735-bce2-67b6df08904a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:30.517547 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3e02c580-8bed-4735-bce2-67b6df08904a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.079883 Apr 08 11:49:30.518151 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1671/2607] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:30 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:31.537501 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-496b76b8-c432-45de-ab04-891963805449 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:31.538920 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-496b76b8-c432-45de-ab04-891963805449 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:31.549715 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-496b76b8-c432-45de-ab04-891963805449 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:31.549715 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-496b76b8-c432-45de-ab04-891963805449 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:31.549715 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-496b76b8-c432-45de-ab04-891963805449 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:31.549715 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-496b76b8-c432-45de-ab04-891963805449 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:31.614714 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-496b76b8-c432-45de-ab04-891963805449 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:31.623062 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-496b76b8-c432-45de-ab04-891963805449 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.091454 Apr 08 11:49:31.623640 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1672/2608] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:31 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:49:32.639992 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ed349e07-643c-457d-9383-6ebb491bcc25 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:32.640662 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ed349e07-643c-457d-9383-6ebb491bcc25 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:32.649334 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ed349e07-643c-457d-9383-6ebb491bcc25 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:32.649836 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ed349e07-643c-457d-9383-6ebb491bcc25 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:32.650610 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ed349e07-643c-457d-9383-6ebb491bcc25 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:32.651055 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ed349e07-643c-457d-9383-6ebb491bcc25 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:32.712140 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ed349e07-643c-457d-9383-6ebb491bcc25 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:32.720849 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ed349e07-643c-457d-9383-6ebb491bcc25 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.084663 Apr 08 11:49:32.721443 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1673/2609] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:32 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:33.737550 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0b74a1c4-da89-42e4-8e8f-3ca90a4e1362 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:33.738216 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0b74a1c4-da89-42e4-8e8f-3ca90a4e1362 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:33.744501 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0b74a1c4-da89-42e4-8e8f-3ca90a4e1362 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:33.744985 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0b74a1c4-da89-42e4-8e8f-3ca90a4e1362 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:33.745749 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0b74a1c4-da89-42e4-8e8f-3ca90a4e1362 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:33.746209 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0b74a1c4-da89-42e4-8e8f-3ca90a4e1362 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:33.804883 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0b74a1c4-da89-42e4-8e8f-3ca90a4e1362 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:33.812867 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0b74a1c4-da89-42e4-8e8f-3ca90a4e1362 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.079288 Apr 08 11:49:33.813440 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1674/2610] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:33 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:34.830069 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2efdfcee-d6e2-4ca0-aae2-73a3cd40bf25 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:34.830712 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2efdfcee-d6e2-4ca0-aae2-73a3cd40bf25 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:34.837462 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2efdfcee-d6e2-4ca0-aae2-73a3cd40bf25 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:34.837943 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2efdfcee-d6e2-4ca0-aae2-73a3cd40bf25 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:34.839273 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2efdfcee-d6e2-4ca0-aae2-73a3cd40bf25 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:34.839726 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2efdfcee-d6e2-4ca0-aae2-73a3cd40bf25 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:34.897431 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2efdfcee-d6e2-4ca0-aae2-73a3cd40bf25 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:34.906186 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2efdfcee-d6e2-4ca0-aae2-73a3cd40bf25 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.079971 Apr 08 11:49:34.906765 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1675/2611] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:34 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:35.923907 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-193f1f68-5c10-439a-b6d9-3715da6346fc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:35.924556 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-193f1f68-5c10-439a-b6d9-3715da6346fc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:35.931318 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-193f1f68-5c10-439a-b6d9-3715da6346fc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:35.931825 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-193f1f68-5c10-439a-b6d9-3715da6346fc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:35.932583 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-193f1f68-5c10-439a-b6d9-3715da6346fc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:35.933023 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-193f1f68-5c10-439a-b6d9-3715da6346fc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:35.994278 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-193f1f68-5c10-439a-b6d9-3715da6346fc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:36.002825 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-193f1f68-5c10-439a-b6d9-3715da6346fc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.082900 Apr 08 11:49:36.003410 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1676/2612] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:35 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:37.019410 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1b638385-c66d-41c6-a692-81db7ad54264 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:37.020082 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1b638385-c66d-41c6-a692-81db7ad54264 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:37.026215 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1b638385-c66d-41c6-a692-81db7ad54264 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:37.026659 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1b638385-c66d-41c6-a692-81db7ad54264 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:37.027416 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1b638385-c66d-41c6-a692-81db7ad54264 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:37.027857 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1b638385-c66d-41c6-a692-81db7ad54264 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:37.095334 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1b638385-c66d-41c6-a692-81db7ad54264 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:37.100455 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1b638385-c66d-41c6-a692-81db7ad54264 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.084760 Apr 08 11:49:37.101025 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1677/2613] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:37 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:38.117201 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-05784358-547c-463f-a7ff-4e48469c35ad tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:38.117922 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-05784358-547c-463f-a7ff-4e48469c35ad tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:38.124207 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-05784358-547c-463f-a7ff-4e48469c35ad tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:38.124663 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-05784358-547c-463f-a7ff-4e48469c35ad tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:38.125436 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-05784358-547c-463f-a7ff-4e48469c35ad tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:38.125917 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-05784358-547c-463f-a7ff-4e48469c35ad tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:38.187374 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-05784358-547c-463f-a7ff-4e48469c35ad tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:38.195223 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-05784358-547c-463f-a7ff-4e48469c35ad tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.081860 Apr 08 11:49:38.196398 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1678/2614] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:38 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:39.212944 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b8a192ef-1ba1-467a-b341-e380471ec4f2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:39.213615 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b8a192ef-1ba1-467a-b341-e380471ec4f2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:39.219867 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b8a192ef-1ba1-467a-b341-e380471ec4f2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:39.220323 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b8a192ef-1ba1-467a-b341-e380471ec4f2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:39.221092 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b8a192ef-1ba1-467a-b341-e380471ec4f2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:39.221535 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b8a192ef-1ba1-467a-b341-e380471ec4f2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:39.280929 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b8a192ef-1ba1-467a-b341-e380471ec4f2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:39.288834 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b8a192ef-1ba1-467a-b341-e380471ec4f2 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.080224 Apr 08 11:49:39.290008 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1679/2615] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:39 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:40.305278 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-39200390-5cce-4f78-8261-df67945e855d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:40.305994 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-39200390-5cce-4f78-8261-df67945e855d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:40.312402 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-39200390-5cce-4f78-8261-df67945e855d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:40.312849 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-39200390-5cce-4f78-8261-df67945e855d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:40.313609 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-39200390-5cce-4f78-8261-df67945e855d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:40.314079 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-39200390-5cce-4f78-8261-df67945e855d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:40.373282 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-39200390-5cce-4f78-8261-df67945e855d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:40.381034 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-39200390-5cce-4f78-8261-df67945e855d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.079652 Apr 08 11:49:40.381611 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1680/2616] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:40 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:41.399171 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1667e7c7-fef9-4d61-b121-8e47a5cf6f74 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:41.399827 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1667e7c7-fef9-4d61-b121-8e47a5cf6f74 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:41.406360 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1667e7c7-fef9-4d61-b121-8e47a5cf6f74 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:41.406821 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1667e7c7-fef9-4d61-b121-8e47a5cf6f74 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:41.407611 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1667e7c7-fef9-4d61-b121-8e47a5cf6f74 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:41.408057 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1667e7c7-fef9-4d61-b121-8e47a5cf6f74 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:41.470504 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1667e7c7-fef9-4d61-b121-8e47a5cf6f74 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:41.479133 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1667e7c7-fef9-4d61-b121-8e47a5cf6f74 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.084458 Apr 08 11:49:41.479725 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1681/2617] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:41 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:42.496509 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9f9acb6b-9349-4924-9247-690930cb4302 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:42.497209 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9f9acb6b-9349-4924-9247-690930cb4302 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:42.503576 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9f9acb6b-9349-4924-9247-690930cb4302 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:42.504034 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9f9acb6b-9349-4924-9247-690930cb4302 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:42.504815 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9f9acb6b-9349-4924-9247-690930cb4302 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:42.505258 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9f9acb6b-9349-4924-9247-690930cb4302 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:42.568993 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9f9acb6b-9349-4924-9247-690930cb4302 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:42.580300 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9f9acb6b-9349-4924-9247-690930cb4302 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.088054 Apr 08 11:49:42.580907 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1682/2618] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:42 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:43.596370 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-892351ac-daab-438a-b024-a49f04b8bd26 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:43.597088 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-892351ac-daab-438a-b024-a49f04b8bd26 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:43.603240 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-892351ac-daab-438a-b024-a49f04b8bd26 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:43.603684 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-892351ac-daab-438a-b024-a49f04b8bd26 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:43.604440 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-892351ac-daab-438a-b024-a49f04b8bd26 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:43.604874 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-892351ac-daab-438a-b024-a49f04b8bd26 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:43.663726 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-892351ac-daab-438a-b024-a49f04b8bd26 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:43.671519 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-892351ac-daab-438a-b024-a49f04b8bd26 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.079009 Apr 08 11:49:43.672081 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1683/2619] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:43 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:44.689568 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2f88364a-ed96-4149-b2ce-d63bfc3244fc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:44.690276 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2f88364a-ed96-4149-b2ce-d63bfc3244fc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:44.697328 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2f88364a-ed96-4149-b2ce-d63bfc3244fc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:44.697819 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2f88364a-ed96-4149-b2ce-d63bfc3244fc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:44.698607 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2f88364a-ed96-4149-b2ce-d63bfc3244fc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:44.699054 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2f88364a-ed96-4149-b2ce-d63bfc3244fc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:44.759162 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2f88364a-ed96-4149-b2ce-d63bfc3244fc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:44.766946 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2f88364a-ed96-4149-b2ce-d63bfc3244fc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.081236 Apr 08 11:49:44.767524 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1684/2620] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:44 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:45.784014 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9eddfa02-6c95-45e3-b6ef-528c92b3ed2c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:45.784739 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9eddfa02-6c95-45e3-b6ef-528c92b3ed2c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:45.791092 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9eddfa02-6c95-45e3-b6ef-528c92b3ed2c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:45.791540 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9eddfa02-6c95-45e3-b6ef-528c92b3ed2c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:45.792306 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9eddfa02-6c95-45e3-b6ef-528c92b3ed2c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:45.792742 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9eddfa02-6c95-45e3-b6ef-528c92b3ed2c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:45.851701 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9eddfa02-6c95-45e3-b6ef-528c92b3ed2c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:45.859427 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9eddfa02-6c95-45e3-b6ef-528c92b3ed2c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.079486 Apr 08 11:49:45.859992 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1685/2621] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:45 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:46.876499 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-cc2f4051-6c77-401c-a784-dae426aa0708 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:46.877212 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-cc2f4051-6c77-401c-a784-dae426aa0708 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:46.883528 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cc2f4051-6c77-401c-a784-dae426aa0708 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:46.883984 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cc2f4051-6c77-401c-a784-dae426aa0708 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:46.884772 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cc2f4051-6c77-401c-a784-dae426aa0708 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:46.885214 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cc2f4051-6c77-401c-a784-dae426aa0708 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:46.945152 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-cc2f4051-6c77-401c-a784-dae426aa0708 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:46.952986 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-cc2f4051-6c77-401c-a784-dae426aa0708 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.080292 Apr 08 11:49:46.953567 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1686/2622] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:46 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:47.970870 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e53782cd-7ac2-4f1b-a076-115b6f172000 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:47.971529 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e53782cd-7ac2-4f1b-a076-115b6f172000 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:47.978494 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e53782cd-7ac2-4f1b-a076-115b6f172000 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:47.978951 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e53782cd-7ac2-4f1b-a076-115b6f172000 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:47.981981 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e53782cd-7ac2-4f1b-a076-115b6f172000 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:47.981981 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e53782cd-7ac2-4f1b-a076-115b6f172000 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:48.041594 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e53782cd-7ac2-4f1b-a076-115b6f172000 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:48.049409 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e53782cd-7ac2-4f1b-a076-115b6f172000 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.082558 Apr 08 11:49:48.050025 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1687/2623] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:47 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:49.066715 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-02f2f6c0-c1f2-4685-8242-ddb80808257a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:49.067324 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-02f2f6c0-c1f2-4685-8242-ddb80808257a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:49.073531 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-02f2f6c0-c1f2-4685-8242-ddb80808257a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:49.074149 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-02f2f6c0-c1f2-4685-8242-ddb80808257a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:49.074911 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-02f2f6c0-c1f2-4685-8242-ddb80808257a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:49.075347 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-02f2f6c0-c1f2-4685-8242-ddb80808257a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:49.410808 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-02f2f6c0-c1f2-4685-8242-ddb80808257a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:49.418685 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-02f2f6c0-c1f2-4685-8242-ddb80808257a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.355736 Apr 08 11:49:49.419252 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1688/2624] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:49 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:50.435380 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0a08ca42-56ef-46f7-80ac-28303b00eb5e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:50.436043 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0a08ca42-56ef-46f7-80ac-28303b00eb5e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:50.442234 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0a08ca42-56ef-46f7-80ac-28303b00eb5e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:50.442677 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0a08ca42-56ef-46f7-80ac-28303b00eb5e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:50.443432 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0a08ca42-56ef-46f7-80ac-28303b00eb5e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:50.443867 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0a08ca42-56ef-46f7-80ac-28303b00eb5e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:50.501736 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0a08ca42-56ef-46f7-80ac-28303b00eb5e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:50.509517 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0a08ca42-56ef-46f7-80ac-28303b00eb5e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.077990 Apr 08 11:49:50.510107 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1689/2625] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:50 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:51.525400 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d9dbbc49-3c11-408b-b94e-ab8f3ea5c4d7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:51.526118 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d9dbbc49-3c11-408b-b94e-ab8f3ea5c4d7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:51.532634 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d9dbbc49-3c11-408b-b94e-ab8f3ea5c4d7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:51.533086 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d9dbbc49-3c11-408b-b94e-ab8f3ea5c4d7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:51.533889 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d9dbbc49-3c11-408b-b94e-ab8f3ea5c4d7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:51.534360 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d9dbbc49-3c11-408b-b94e-ab8f3ea5c4d7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:51.594863 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d9dbbc49-3c11-408b-b94e-ab8f3ea5c4d7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:51.607271 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d9dbbc49-3c11-408b-b94e-ab8f3ea5c4d7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.085730 Apr 08 11:49:51.607865 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1690/2626] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:51 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:52.624543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8c2e47d6-428a-4331-b39d-e417b098068a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:52.625197 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8c2e47d6-428a-4331-b39d-e417b098068a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:52.631420 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8c2e47d6-428a-4331-b39d-e417b098068a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:52.631873 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8c2e47d6-428a-4331-b39d-e417b098068a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:52.632635 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8c2e47d6-428a-4331-b39d-e417b098068a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:52.633080 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8c2e47d6-428a-4331-b39d-e417b098068a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:52.692656 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8c2e47d6-428a-4331-b39d-e417b098068a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:52.701176 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8c2e47d6-428a-4331-b39d-e417b098068a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.080498 Apr 08 11:49:52.701751 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1691/2627] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:52 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:53.718112 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b7e9af9a-91f9-4cb3-8378-21bc64699315 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:53.718780 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b7e9af9a-91f9-4cb3-8378-21bc64699315 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:53.724985 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b7e9af9a-91f9-4cb3-8378-21bc64699315 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:53.725443 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b7e9af9a-91f9-4cb3-8378-21bc64699315 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:53.726305 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b7e9af9a-91f9-4cb3-8378-21bc64699315 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:53.726744 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b7e9af9a-91f9-4cb3-8378-21bc64699315 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:53.789571 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b7e9af9a-91f9-4cb3-8378-21bc64699315 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:53.797965 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b7e9af9a-91f9-4cb3-8378-21bc64699315 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.083662 Apr 08 11:49:53.803161 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1692/2628] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:53 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:54.815392 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-569bb084-8b46-40e8-886c-5876dc9c2a06 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:54.816060 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-569bb084-8b46-40e8-886c-5876dc9c2a06 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:54.823033 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-569bb084-8b46-40e8-886c-5876dc9c2a06 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:54.823480 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-569bb084-8b46-40e8-886c-5876dc9c2a06 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:54.824242 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-569bb084-8b46-40e8-886c-5876dc9c2a06 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:54.824677 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-569bb084-8b46-40e8-886c-5876dc9c2a06 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:54.885313 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-569bb084-8b46-40e8-886c-5876dc9c2a06 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:54.897732 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-569bb084-8b46-40e8-886c-5876dc9c2a06 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.086092 Apr 08 11:49:54.898283 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1693/2629] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:54 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:55.915493 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-00ea36d6-3d1c-4890-9b7d-5c0fd571c501 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:55.916162 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-00ea36d6-3d1c-4890-9b7d-5c0fd571c501 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:55.922376 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-00ea36d6-3d1c-4890-9b7d-5c0fd571c501 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:55.922826 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-00ea36d6-3d1c-4890-9b7d-5c0fd571c501 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:55.923600 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-00ea36d6-3d1c-4890-9b7d-5c0fd571c501 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:55.924035 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-00ea36d6-3d1c-4890-9b7d-5c0fd571c501 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:55.983922 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-00ea36d6-3d1c-4890-9b7d-5c0fd571c501 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:55.991698 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-00ea36d6-3d1c-4890-9b7d-5c0fd571c501 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.080202 Apr 08 11:49:55.992307 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1694/2630] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:55 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:57.008680 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0f822cb3-63fd-4ed0-9253-29592945ef0c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:57.009892 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0f822cb3-63fd-4ed0-9253-29592945ef0c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:57.015889 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0f822cb3-63fd-4ed0-9253-29592945ef0c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:57.016345 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0f822cb3-63fd-4ed0-9253-29592945ef0c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:57.017125 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0f822cb3-63fd-4ed0-9253-29592945ef0c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:57.017572 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0f822cb3-63fd-4ed0-9253-29592945ef0c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:57.075822 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0f822cb3-63fd-4ed0-9253-29592945ef0c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:57.083672 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0f822cb3-63fd-4ed0-9253-29592945ef0c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.078933 Apr 08 11:49:57.084235 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1695/2631] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:57 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:58.102843 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a6bd4617-fcb3-48d0-9be9-bf235ee0f15d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:58.104215 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a6bd4617-fcb3-48d0-9be9-bf235ee0f15d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:58.110984 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a6bd4617-fcb3-48d0-9be9-bf235ee0f15d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:58.111442 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a6bd4617-fcb3-48d0-9be9-bf235ee0f15d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:58.112283 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a6bd4617-fcb3-48d0-9be9-bf235ee0f15d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:58.112728 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a6bd4617-fcb3-48d0-9be9-bf235ee0f15d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:58.175887 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a6bd4617-fcb3-48d0-9be9-bf235ee0f15d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:58.183898 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a6bd4617-fcb3-48d0-9be9-bf235ee0f15d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.086021 Apr 08 11:49:58.184487 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1696/2632] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:58 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:49:59.201776 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c23a745d-4b37-47eb-9965-96d01773a336 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:49:59.202464 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c23a745d-4b37-47eb-9965-96d01773a336 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:49:59.208658 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c23a745d-4b37-47eb-9965-96d01773a336 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:59.209122 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c23a745d-4b37-47eb-9965-96d01773a336 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:59.209910 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c23a745d-4b37-47eb-9965-96d01773a336 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:49:59.210353 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c23a745d-4b37-47eb-9965-96d01773a336 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:49:59.271341 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c23a745d-4b37-47eb-9965-96d01773a336 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:49:59.279925 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c23a745d-4b37-47eb-9965-96d01773a336 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.082498 Apr 08 11:49:59.280494 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1697/2633] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:49:59 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:00.296301 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a61e5f9d-7da5-432a-863d-ab18e73729e4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:00.296992 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a61e5f9d-7da5-432a-863d-ab18e73729e4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:00.303264 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a61e5f9d-7da5-432a-863d-ab18e73729e4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:00.303724 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a61e5f9d-7da5-432a-863d-ab18e73729e4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:00.304493 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a61e5f9d-7da5-432a-863d-ab18e73729e4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:00.304941 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a61e5f9d-7da5-432a-863d-ab18e73729e4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:00.364176 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a61e5f9d-7da5-432a-863d-ab18e73729e4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:00.372194 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a61e5f9d-7da5-432a-863d-ab18e73729e4 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.079811 Apr 08 11:50:00.372773 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1698/2634] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:00 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:01.389543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-086f85aa-1415-487d-85fb-365474b15cf0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:01.390244 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-086f85aa-1415-487d-85fb-365474b15cf0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:01.396439 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-086f85aa-1415-487d-85fb-365474b15cf0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:01.396895 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-086f85aa-1415-487d-85fb-365474b15cf0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:01.397672 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-086f85aa-1415-487d-85fb-365474b15cf0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:01.398139 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-086f85aa-1415-487d-85fb-365474b15cf0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:01.457296 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-086f85aa-1415-487d-85fb-365474b15cf0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:01.465737 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-086f85aa-1415-487d-85fb-365474b15cf0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.080871 Apr 08 11:50:01.466329 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1699/2635] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:01 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:02.483620 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-18b01d44-2bd9-4dd9-b16e-dc552a139b95 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:02.484311 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-18b01d44-2bd9-4dd9-b16e-dc552a139b95 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:02.491803 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-18b01d44-2bd9-4dd9-b16e-dc552a139b95 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:02.492252 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-18b01d44-2bd9-4dd9-b16e-dc552a139b95 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:02.493030 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-18b01d44-2bd9-4dd9-b16e-dc552a139b95 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:02.493477 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-18b01d44-2bd9-4dd9-b16e-dc552a139b95 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:02.555845 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-18b01d44-2bd9-4dd9-b16e-dc552a139b95 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:02.564079 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-18b01d44-2bd9-4dd9-b16e-dc552a139b95 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.085237 Apr 08 11:50:02.564663 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1700/2636] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:02 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:03.582002 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1ba63673-1e93-49b0-b19e-7be55bdef11f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:03.582684 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1ba63673-1e93-49b0-b19e-7be55bdef11f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:03.589452 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ba63673-1e93-49b0-b19e-7be55bdef11f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:03.589935 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ba63673-1e93-49b0-b19e-7be55bdef11f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:03.590706 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ba63673-1e93-49b0-b19e-7be55bdef11f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:03.591152 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ba63673-1e93-49b0-b19e-7be55bdef11f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:03.652898 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1ba63673-1e93-49b0-b19e-7be55bdef11f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:03.660998 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1ba63673-1e93-49b0-b19e-7be55bdef11f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.082941 Apr 08 11:50:03.661571 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1701/2637] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:03 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:04.678393 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5db08457-74c0-494a-9d14-d16ae6a5af6f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:04.679042 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5db08457-74c0-494a-9d14-d16ae6a5af6f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:04.685761 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5db08457-74c0-494a-9d14-d16ae6a5af6f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:04.686245 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5db08457-74c0-494a-9d14-d16ae6a5af6f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:04.686997 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5db08457-74c0-494a-9d14-d16ae6a5af6f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:04.687432 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5db08457-74c0-494a-9d14-d16ae6a5af6f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:04.745881 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5db08457-74c0-494a-9d14-d16ae6a5af6f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:04.753623 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5db08457-74c0-494a-9d14-d16ae6a5af6f tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.079092 Apr 08 11:50:04.754218 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1702/2638] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:04 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:05.771043 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a4f44ceb-5694-43a1-8d0c-9be9d9a97671 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:05.771727 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a4f44ceb-5694-43a1-8d0c-9be9d9a97671 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:05.778719 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a4f44ceb-5694-43a1-8d0c-9be9d9a97671 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:05.779176 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a4f44ceb-5694-43a1-8d0c-9be9d9a97671 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:05.779981 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a4f44ceb-5694-43a1-8d0c-9be9d9a97671 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:05.780424 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a4f44ceb-5694-43a1-8d0c-9be9d9a97671 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:05.839569 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a4f44ceb-5694-43a1-8d0c-9be9d9a97671 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:05.847364 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a4f44ceb-5694-43a1-8d0c-9be9d9a97671 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.080194 Apr 08 11:50:05.847935 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1703/2639] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:05 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:06.864073 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-469baa88-2a3e-4682-bb02-33d2fcb88bc1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:06.864762 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-469baa88-2a3e-4682-bb02-33d2fcb88bc1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:06.871190 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-469baa88-2a3e-4682-bb02-33d2fcb88bc1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:06.871646 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-469baa88-2a3e-4682-bb02-33d2fcb88bc1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:06.872425 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-469baa88-2a3e-4682-bb02-33d2fcb88bc1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:06.872872 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-469baa88-2a3e-4682-bb02-33d2fcb88bc1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:06.937454 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-469baa88-2a3e-4682-bb02-33d2fcb88bc1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:06.945514 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-469baa88-2a3e-4682-bb02-33d2fcb88bc1 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.085301 Apr 08 11:50:06.946129 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1704/2640] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:06 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:07.962587 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e5d58905-3973-4289-8ac2-ef6663a19c02 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:07.963310 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e5d58905-3973-4289-8ac2-ef6663a19c02 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:07.969340 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e5d58905-3973-4289-8ac2-ef6663a19c02 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:07.969818 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e5d58905-3973-4289-8ac2-ef6663a19c02 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:07.970587 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e5d58905-3973-4289-8ac2-ef6663a19c02 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:07.971025 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e5d58905-3973-4289-8ac2-ef6663a19c02 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:08.030128 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e5d58905-3973-4289-8ac2-ef6663a19c02 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:08.038280 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e5d58905-3973-4289-8ac2-ef6663a19c02 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.079610 Apr 08 11:50:08.038857 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1705/2641] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:07 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:09.055594 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-184361ba-bbc8-45ff-a4bb-0c7cf75e8786 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:09.056227 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-184361ba-bbc8-45ff-a4bb-0c7cf75e8786 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:09.062598 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-184361ba-bbc8-45ff-a4bb-0c7cf75e8786 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:09.063054 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-184361ba-bbc8-45ff-a4bb-0c7cf75e8786 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:09.063838 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-184361ba-bbc8-45ff-a4bb-0c7cf75e8786 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:09.064279 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-184361ba-bbc8-45ff-a4bb-0c7cf75e8786 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:09.123292 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-184361ba-bbc8-45ff-a4bb-0c7cf75e8786 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:09.131103 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-184361ba-bbc8-45ff-a4bb-0c7cf75e8786 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.079476 Apr 08 11:50:09.131672 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1706/2642] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:09 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:10.148379 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8b7ce218-5b25-4e82-a31e-97d147348115 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:10.149070 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8b7ce218-5b25-4e82-a31e-97d147348115 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:10.155300 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8b7ce218-5b25-4e82-a31e-97d147348115 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:10.155759 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8b7ce218-5b25-4e82-a31e-97d147348115 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:10.156798 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8b7ce218-5b25-4e82-a31e-97d147348115 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:10.157244 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8b7ce218-5b25-4e82-a31e-97d147348115 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:10.216608 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8b7ce218-5b25-4e82-a31e-97d147348115 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:10.224313 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8b7ce218-5b25-4e82-a31e-97d147348115 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.079818 Apr 08 11:50:10.224890 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1707/2643] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:10 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:11.241534 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b547748f-1546-42a6-9e12-ef4f97ee141a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:11.242251 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b547748f-1546-42a6-9e12-ef4f97ee141a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:11.248495 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b547748f-1546-42a6-9e12-ef4f97ee141a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:11.248955 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b547748f-1546-42a6-9e12-ef4f97ee141a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:11.249737 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b547748f-1546-42a6-9e12-ef4f97ee141a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:11.250209 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b547748f-1546-42a6-9e12-ef4f97ee141a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:11.312455 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b547748f-1546-42a6-9e12-ef4f97ee141a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:11.320235 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b547748f-1546-42a6-9e12-ef4f97ee141a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.082589 Apr 08 11:50:11.320808 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1708/2644] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:11 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:12.337603 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a699d408-7e08-4d00-995c-d23e6bf2553a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:12.338803 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a699d408-7e08-4d00-995c-d23e6bf2553a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:12.345055 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a699d408-7e08-4d00-995c-d23e6bf2553a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:12.345512 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a699d408-7e08-4d00-995c-d23e6bf2553a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:12.346312 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a699d408-7e08-4d00-995c-d23e6bf2553a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:12.346758 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a699d408-7e08-4d00-995c-d23e6bf2553a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:12.405587 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a699d408-7e08-4d00-995c-d23e6bf2553a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:12.413586 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a699d408-7e08-4d00-995c-d23e6bf2553a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.079860 Apr 08 11:50:12.414198 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1709/2645] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:12 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:13.430767 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-10b82e82-72ba-426c-90b4-ac6c9e539f60 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:13.431459 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-10b82e82-72ba-426c-90b4-ac6c9e539f60 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:13.438122 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-10b82e82-72ba-426c-90b4-ac6c9e539f60 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:13.438746 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-10b82e82-72ba-426c-90b4-ac6c9e539f60 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:13.439618 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-10b82e82-72ba-426c-90b4-ac6c9e539f60 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:13.440071 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-10b82e82-72ba-426c-90b4-ac6c9e539f60 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:13.501602 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-10b82e82-72ba-426c-90b4-ac6c9e539f60 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:13.509467 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-10b82e82-72ba-426c-90b4-ac6c9e539f60 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.082695 Apr 08 11:50:13.510584 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1710/2646] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:13 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:14.527360 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-447b68e1-53b2-4424-82a2-3e160e3d3b0e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:14.528104 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-447b68e1-53b2-4424-82a2-3e160e3d3b0e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:14.534734 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-447b68e1-53b2-4424-82a2-3e160e3d3b0e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:14.535199 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-447b68e1-53b2-4424-82a2-3e160e3d3b0e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:14.535956 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-447b68e1-53b2-4424-82a2-3e160e3d3b0e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:14.536395 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-447b68e1-53b2-4424-82a2-3e160e3d3b0e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:14.595043 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-447b68e1-53b2-4424-82a2-3e160e3d3b0e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:14.602721 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-447b68e1-53b2-4424-82a2-3e160e3d3b0e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.079824 Apr 08 11:50:14.603296 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1711/2647] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:14 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:15.621274 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e60a93f8-6883-49fb-9552-c6be3b8f06dc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:15.621972 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e60a93f8-6883-49fb-9552-c6be3b8f06dc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:15.628218 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e60a93f8-6883-49fb-9552-c6be3b8f06dc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:15.628671 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e60a93f8-6883-49fb-9552-c6be3b8f06dc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:15.629444 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e60a93f8-6883-49fb-9552-c6be3b8f06dc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:15.629916 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e60a93f8-6883-49fb-9552-c6be3b8f06dc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:15.693304 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e60a93f8-6883-49fb-9552-c6be3b8f06dc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:15.701482 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e60a93f8-6883-49fb-9552-c6be3b8f06dc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.084661 Apr 08 11:50:15.702096 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1712/2648] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:15 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:16.719115 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-dc398228-c870-4a38-a2a2-6fa2e57786a7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:16.719775 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-dc398228-c870-4a38-a2a2-6fa2e57786a7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:16.726006 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dc398228-c870-4a38-a2a2-6fa2e57786a7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:16.726461 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dc398228-c870-4a38-a2a2-6fa2e57786a7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:16.727229 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dc398228-c870-4a38-a2a2-6fa2e57786a7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:16.727669 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dc398228-c870-4a38-a2a2-6fa2e57786a7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:16.787168 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-dc398228-c870-4a38-a2a2-6fa2e57786a7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:16.795680 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-dc398228-c870-4a38-a2a2-6fa2e57786a7 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.080475 Apr 08 11:50:16.796257 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1713/2649] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:16 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:17.812651 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-107c1530-14c2-4f3a-95e9-33c062af9a64 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:17.813488 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-107c1530-14c2-4f3a-95e9-33c062af9a64 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:17.820027 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-107c1530-14c2-4f3a-95e9-33c062af9a64 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:17.820466 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-107c1530-14c2-4f3a-95e9-33c062af9a64 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:17.821225 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-107c1530-14c2-4f3a-95e9-33c062af9a64 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:17.821662 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-107c1530-14c2-4f3a-95e9-33c062af9a64 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:17.884249 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-107c1530-14c2-4f3a-95e9-33c062af9a64 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:17.892864 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-107c1530-14c2-4f3a-95e9-33c062af9a64 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.083905 Apr 08 11:50:17.893520 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1714/2650] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:17 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:50:18.911932 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4ea19461-664b-4ab0-a2f3-1f599a896d68 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:18.912569 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4ea19461-664b-4ab0-a2f3-1f599a896d68 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:18.919519 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4ea19461-664b-4ab0-a2f3-1f599a896d68 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:18.919974 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4ea19461-664b-4ab0-a2f3-1f599a896d68 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:18.920748 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4ea19461-664b-4ab0-a2f3-1f599a896d68 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:18.921198 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4ea19461-664b-4ab0-a2f3-1f599a896d68 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:18.979869 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4ea19461-664b-4ab0-a2f3-1f599a896d68 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:18.987673 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4ea19461-664b-4ab0-a2f3-1f599a896d68 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.079829 Apr 08 11:50:18.988245 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1715/2651] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:18 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:20.004399 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4d048c76-9938-4d22-9e9a-541b45eb57cc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:20.005028 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4d048c76-9938-4d22-9e9a-541b45eb57cc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:20.011256 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4d048c76-9938-4d22-9e9a-541b45eb57cc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:20.011711 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4d048c76-9938-4d22-9e9a-541b45eb57cc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:20.012490 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4d048c76-9938-4d22-9e9a-541b45eb57cc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:20.012932 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4d048c76-9938-4d22-9e9a-541b45eb57cc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:20.077097 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4d048c76-9938-4d22-9e9a-541b45eb57cc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:20.085053 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4d048c76-9938-4d22-9e9a-541b45eb57cc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.084617 Apr 08 11:50:20.085619 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1716/2652] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:19 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:21.102080 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-917fe333-1577-43de-b45d-2f87fa65abeb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:21.102710 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-917fe333-1577-43de-b45d-2f87fa65abeb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:21.108969 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-917fe333-1577-43de-b45d-2f87fa65abeb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:21.109431 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-917fe333-1577-43de-b45d-2f87fa65abeb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:21.110233 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-917fe333-1577-43de-b45d-2f87fa65abeb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:21.110684 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-917fe333-1577-43de-b45d-2f87fa65abeb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:21.170976 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-917fe333-1577-43de-b45d-2f87fa65abeb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:21.178920 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-917fe333-1577-43de-b45d-2f87fa65abeb tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.080690 Apr 08 11:50:21.179503 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1717/2653] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:21 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:22.197048 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e7fa1910-b68f-4659-864d-8fbef86f88c5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:22.197749 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e7fa1910-b68f-4659-864d-8fbef86f88c5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:22.203988 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e7fa1910-b68f-4659-864d-8fbef86f88c5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:22.204428 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e7fa1910-b68f-4659-864d-8fbef86f88c5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:22.205184 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e7fa1910-b68f-4659-864d-8fbef86f88c5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:22.205615 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e7fa1910-b68f-4659-864d-8fbef86f88c5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:22.265446 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e7fa1910-b68f-4659-864d-8fbef86f88c5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:22.273809 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e7fa1910-b68f-4659-864d-8fbef86f88c5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.080574 Apr 08 11:50:22.274376 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1718/2654] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:22 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:23.350881 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6c08a679-ef68-4274-9583-960a9b9e8775 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:23.350881 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6c08a679-ef68-4274-9583-960a9b9e8775 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:23.350881 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6c08a679-ef68-4274-9583-960a9b9e8775 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:23.350881 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6c08a679-ef68-4274-9583-960a9b9e8775 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:23.351841 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6c08a679-ef68-4274-9583-960a9b9e8775 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:23.351841 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6c08a679-ef68-4274-9583-960a9b9e8775 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:23.359176 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6c08a679-ef68-4274-9583-960a9b9e8775 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:23.366997 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6c08a679-ef68-4274-9583-960a9b9e8775 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.079784 Apr 08 11:50:23.367566 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1719/2655] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:23 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:24.384506 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4c858fd7-2bff-41e3-afb7-2a4fee0235cc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:24.385203 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4c858fd7-2bff-41e3-afb7-2a4fee0235cc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:24.391346 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4c858fd7-2bff-41e3-afb7-2a4fee0235cc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:24.391792 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4c858fd7-2bff-41e3-afb7-2a4fee0235cc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:24.392551 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4c858fd7-2bff-41e3-afb7-2a4fee0235cc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:24.392984 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4c858fd7-2bff-41e3-afb7-2a4fee0235cc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:24.455456 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4c858fd7-2bff-41e3-afb7-2a4fee0235cc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:24.468377 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4c858fd7-2bff-41e3-afb7-2a4fee0235cc tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.087596 Apr 08 11:50:24.468966 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1720/2656] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:24 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:25.485523 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-810e34e0-bb4b-4e9c-b7fa-767c6af5ea4d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:25.486202 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-810e34e0-bb4b-4e9c-b7fa-767c6af5ea4d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:25.492401 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-810e34e0-bb4b-4e9c-b7fa-767c6af5ea4d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:25.492850 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-810e34e0-bb4b-4e9c-b7fa-767c6af5ea4d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:25.493618 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-810e34e0-bb4b-4e9c-b7fa-767c6af5ea4d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:25.494093 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-810e34e0-bb4b-4e9c-b7fa-767c6af5ea4d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:25.553217 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-810e34e0-bb4b-4e9c-b7fa-767c6af5ea4d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:25.561625 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-810e34e0-bb4b-4e9c-b7fa-767c6af5ea4d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.080009 Apr 08 11:50:25.562230 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1721/2657] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:25 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:26.578283 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-13987cd3-a155-4c39-bd41-4048fa677559 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:26.579013 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-13987cd3-a155-4c39-bd41-4048fa677559 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:26.584840 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-13987cd3-a155-4c39-bd41-4048fa677559 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:26.585291 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-13987cd3-a155-4c39-bd41-4048fa677559 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:26.586091 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-13987cd3-a155-4c39-bd41-4048fa677559 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:26.586537 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-13987cd3-a155-4c39-bd41-4048fa677559 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:26.645898 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-13987cd3-a155-4c39-bd41-4048fa677559 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:26.654015 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-13987cd3-a155-4c39-bd41-4048fa677559 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.080266 Apr 08 11:50:26.654596 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1722/2658] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:26 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:27.670860 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f0acc0fc-ff33-4f73-91df-4bf94e102a6c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:27.671726 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f0acc0fc-ff33-4f73-91df-4bf94e102a6c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:27.677752 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f0acc0fc-ff33-4f73-91df-4bf94e102a6c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:27.680272 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f0acc0fc-ff33-4f73-91df-4bf94e102a6c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:27.680272 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f0acc0fc-ff33-4f73-91df-4bf94e102a6c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:27.680272 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f0acc0fc-ff33-4f73-91df-4bf94e102a6c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:27.740898 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f0acc0fc-ff33-4f73-91df-4bf94e102a6c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:27.751210 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f0acc0fc-ff33-4f73-91df-4bf94e102a6c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.084270 Apr 08 11:50:27.751798 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1723/2659] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:27 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:28.768296 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-84c379e9-8171-4457-9324-e4cca7fd66e0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:28.769024 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-84c379e9-8171-4457-9324-e4cca7fd66e0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:28.776845 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-84c379e9-8171-4457-9324-e4cca7fd66e0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:28.777296 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-84c379e9-8171-4457-9324-e4cca7fd66e0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:28.778109 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-84c379e9-8171-4457-9324-e4cca7fd66e0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:28.778548 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-84c379e9-8171-4457-9324-e4cca7fd66e0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:28.850659 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-84c379e9-8171-4457-9324-e4cca7fd66e0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:28.853237 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-84c379e9-8171-4457-9324-e4cca7fd66e0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.088764 Apr 08 11:50:28.853945 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1724/2660] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:28 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:29.870273 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c690a8d3-af8b-4915-ba85-00865828bf99 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:29.870933 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c690a8d3-af8b-4915-ba85-00865828bf99 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:29.877663 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c690a8d3-af8b-4915-ba85-00865828bf99 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:29.878169 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c690a8d3-af8b-4915-ba85-00865828bf99 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:29.878943 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c690a8d3-af8b-4915-ba85-00865828bf99 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:29.879391 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c690a8d3-af8b-4915-ba85-00865828bf99 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:29.939488 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c690a8d3-af8b-4915-ba85-00865828bf99 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:29.947675 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c690a8d3-af8b-4915-ba85-00865828bf99 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.081413 Apr 08 11:50:29.948256 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1725/2661] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:29 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:30.965016 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-06d32d24-e3eb-48ee-aa14-46f3c7e29c93 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:30.966327 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-06d32d24-e3eb-48ee-aa14-46f3c7e29c93 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:30.972676 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-06d32d24-e3eb-48ee-aa14-46f3c7e29c93 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:30.973134 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-06d32d24-e3eb-48ee-aa14-46f3c7e29c93 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:30.973944 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-06d32d24-e3eb-48ee-aa14-46f3c7e29c93 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:30.974410 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-06d32d24-e3eb-48ee-aa14-46f3c7e29c93 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:31.033434 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-06d32d24-e3eb-48ee-aa14-46f3c7e29c93 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:31.041199 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-06d32d24-e3eb-48ee-aa14-46f3c7e29c93 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.080096 Apr 08 11:50:31.041788 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1726/2662] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:30 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:32.059097 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d62d8f7e-aace-4be4-ae0e-e80c3fc3b316 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:32.059812 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d62d8f7e-aace-4be4-ae0e-e80c3fc3b316 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:32.066049 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d62d8f7e-aace-4be4-ae0e-e80c3fc3b316 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:32.066508 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d62d8f7e-aace-4be4-ae0e-e80c3fc3b316 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:32.067277 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d62d8f7e-aace-4be4-ae0e-e80c3fc3b316 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:32.067716 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d62d8f7e-aace-4be4-ae0e-e80c3fc3b316 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:32.140523 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d62d8f7e-aace-4be4-ae0e-e80c3fc3b316 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:32.148831 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d62d8f7e-aace-4be4-ae0e-e80c3fc3b316 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.093605 Apr 08 11:50:32.149419 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1727/2663] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:32 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:33.167187 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-dcf6c734-76d4-4d34-896b-1aabed70bfda tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:33.167897 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-dcf6c734-76d4-4d34-896b-1aabed70bfda tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:33.175113 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dcf6c734-76d4-4d34-896b-1aabed70bfda tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:33.175569 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dcf6c734-76d4-4d34-896b-1aabed70bfda tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:33.176412 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dcf6c734-76d4-4d34-896b-1aabed70bfda tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:33.176858 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dcf6c734-76d4-4d34-896b-1aabed70bfda tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:33.246157 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-dcf6c734-76d4-4d34-896b-1aabed70bfda tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:33.255892 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-dcf6c734-76d4-4d34-896b-1aabed70bfda tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.092676 Apr 08 11:50:33.256484 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1728/2664] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:33 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:50:34.273098 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7baf8c01-0129-4b15-9db0-d576bd43e546 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:34.274257 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7baf8c01-0129-4b15-9db0-d576bd43e546 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:34.281506 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7baf8c01-0129-4b15-9db0-d576bd43e546 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:34.282247 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7baf8c01-0129-4b15-9db0-d576bd43e546 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:34.283044 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7baf8c01-0129-4b15-9db0-d576bd43e546 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:34.283485 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7baf8c01-0129-4b15-9db0-d576bd43e546 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:34.346267 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7baf8c01-0129-4b15-9db0-d576bd43e546 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:34.355214 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7baf8c01-0129-4b15-9db0-d576bd43e546 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.086593 Apr 08 11:50:34.355811 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1729/2665] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:34 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:35.376075 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-15bfeb51-323d-49bf-9390-a99640421ad5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:35.376875 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-15bfeb51-323d-49bf-9390-a99640421ad5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:35.383877 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-15bfeb51-323d-49bf-9390-a99640421ad5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:35.384516 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-15bfeb51-323d-49bf-9390-a99640421ad5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:35.385644 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-15bfeb51-323d-49bf-9390-a99640421ad5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:35.386116 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-15bfeb51-323d-49bf-9390-a99640421ad5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:35.456888 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-15bfeb51-323d-49bf-9390-a99640421ad5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:35.468242 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-15bfeb51-323d-49bf-9390-a99640421ad5 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1376 microversion: 2.1 time: 0.096083 Apr 08 11:50:35.468838 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1730/2666] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:35 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1376 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:35.748743 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c1bb5326-bef9-49f3-8bae-97df9d540366 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:35.749468 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c1bb5326-bef9-49f3-8bae-97df9d540366 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:35.756695 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c1bb5326-bef9-49f3-8bae-97df9d540366 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:35.757183 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c1bb5326-bef9-49f3-8bae-97df9d540366 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:35.758219 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c1bb5326-bef9-49f3-8bae-97df9d540366 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:35.758862 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c1bb5326-bef9-49f3-8bae-97df9d540366 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:35.788342 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c1bb5326-bef9-49f3-8bae-97df9d540366 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8] Going to try to terminate instance {{(pid=117800) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 08 11:50:36.094230 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c1bb5326-bef9-49f3-8bae-97df9d540366 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8" status: 204 len: 0 microversion: 2.1 time: 0.350611 Apr 08 11:50:36.094951 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1731/2667] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 8 11:50:35 2022] DELETE /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 08 11:50:36.103930 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2c5bdadd-0608-45b7-bdb7-a2ae7a01aeb1 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:36.104637 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2c5bdadd-0608-45b7-bdb7-a2ae7a01aeb1 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:36.113004 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2c5bdadd-0608-45b7-bdb7-a2ae7a01aeb1 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:36.113529 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2c5bdadd-0608-45b7-bdb7-a2ae7a01aeb1 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:36.116973 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2c5bdadd-0608-45b7-bdb7-a2ae7a01aeb1 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:36.116973 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2c5bdadd-0608-45b7-bdb7-a2ae7a01aeb1 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:36.281183 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2c5bdadd-0608-45b7-bdb7-a2ae7a01aeb1 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:36.289133 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2c5bdadd-0608-45b7-bdb7-a2ae7a01aeb1 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8" status: 200 len: 1513 microversion: 2.1 time: 0.189415 Apr 08 11:50:36.289716 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1732/2668] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:36 2022] GET /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8 => generated 1513 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:36.486587 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-80e49a9d-a96c-4e94-b823-1ffeb6eea82e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:36.487512 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-80e49a9d-a96c-4e94-b823-1ffeb6eea82e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:36.493722 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-80e49a9d-a96c-4e94-b823-1ffeb6eea82e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:36.494261 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-80e49a9d-a96c-4e94-b823-1ffeb6eea82e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:36.495047 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-80e49a9d-a96c-4e94-b823-1ffeb6eea82e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:36.495498 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-80e49a9d-a96c-4e94-b823-1ffeb6eea82e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:36.531522 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-80e49a9d-a96c-4e94-b823-1ffeb6eea82e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:36.531975 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-80e49a9d-a96c-4e94-b823-1ffeb6eea82e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:36.532707 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-80e49a9d-a96c-4e94-b823-1ffeb6eea82e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lazy-loading 'fault' on Instance uuid bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 11:50:36.579507 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-80e49a9d-a96c-4e94-b823-1ffeb6eea82e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:36.588315 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-80e49a9d-a96c-4e94-b823-1ffeb6eea82e tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 200 len: 1470 microversion: 2.1 time: 0.106624 Apr 08 11:50:36.588924 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1733/2669] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:36 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 1470 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:37.291950 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-568a2fb8-7036-4d49-aad0-cbe7ac853e4d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:50:37.292849 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-568a2fb8-7036-4d49-aad0-cbe7ac853e4d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:37.302410 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-568a2fb8-7036-4d49-aad0-cbe7ac853e4d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:37.303167 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-568a2fb8-7036-4d49-aad0-cbe7ac853e4d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:37.304352 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-568a2fb8-7036-4d49-aad0-cbe7ac853e4d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:37.305053 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-568a2fb8-7036-4d49-aad0-cbe7ac853e4d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:37.330878 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-568a2fb8-7036-4d49-aad0-cbe7ac853e4d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lazy-loading 'flavor' on Instance uuid 1da27a98-0639-4251-ae77-64f51d7f8f76 {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 11:50:37.871741 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-568a2fb8-7036-4d49-aad0-cbe7ac853e4d tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "POST /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76/action" status: 202 len: 0 microversion: 2.20 time: 0.586331 Apr 08 11:50:37.873909 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1734/2670] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Apr 8 11:50:37 2022] POST /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76/action => generated 0 bytes in 590 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 08 11:50:37.883802 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-66654eb1-3d9e-4d7a-94ed-d0b08ca53fb2 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:37.884919 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-66654eb1-3d9e-4d7a-94ed-d0b08ca53fb2 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:37.896727 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-66654eb1-3d9e-4d7a-94ed-d0b08ca53fb2 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:37.897179 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-66654eb1-3d9e-4d7a-94ed-d0b08ca53fb2 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:37.898246 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-66654eb1-3d9e-4d7a-94ed-d0b08ca53fb2 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:37.898726 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-66654eb1-3d9e-4d7a-94ed-d0b08ca53fb2 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:38.112600 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-66654eb1-3d9e-4d7a-94ed-d0b08ca53fb2 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:38.121732 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-66654eb1-3d9e-4d7a-94ed-d0b08ca53fb2 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8" status: 200 len: 1513 microversion: 2.1 time: 0.245929 Apr 08 11:50:38.122547 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1735/2671] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:37 2022] GET /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8 => generated 1513 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:50:38.130797 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e513d976-ed66-44ed-a04c-26845ddb9552 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:38.142662 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e513d976-ed66-44ed-a04c-26845ddb9552 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: bb50c1bb-d2f9-47b0-bc8b-3b6759348c47] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:38.142662 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e513d976-ed66-44ed-a04c-26845ddb9552 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:38.142662 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e513d976-ed66-44ed-a04c-26845ddb9552 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:38.142662 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e513d976-ed66-44ed-a04c-26845ddb9552 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:38.143171 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e513d976-ed66-44ed-a04c-26845ddb9552 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:38.166007 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-e513d976-ed66-44ed-a04c-26845ddb9552 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] HTTP exception thrown: Instance bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 could not be found. Apr 08 11:50:38.166644 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e513d976-ed66-44ed-a04c-26845ddb9552 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Returning 404 to user: Instance bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 could not be found. {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:50:38.168601 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e513d976-ed66-44ed-a04c-26845ddb9552 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47" status: 404 len: 111 microversion: 2.1 time: 0.043999 Apr 08 11:50:38.170212 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1736/2672] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:38 2022] GET /compute/v2.1/servers/bb50c1bb-d2f9-47b0-bc8b-3b6759348c47 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 11:50:38.177539 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1341e615-6fdc-46aa-a2a5-d309acc5d738 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:38.178305 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1341e615-6fdc-46aa-a2a5-d309acc5d738 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:38.185019 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1341e615-6fdc-46aa-a2a5-d309acc5d738 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:38.185508 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1341e615-6fdc-46aa-a2a5-d309acc5d738 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:38.186442 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1341e615-6fdc-46aa-a2a5-d309acc5d738 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:38.186890 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1341e615-6fdc-46aa-a2a5-d309acc5d738 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:38.368182 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1341e615-6fdc-46aa-a2a5-d309acc5d738 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:38.377637 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1341e615-6fdc-46aa-a2a5-d309acc5d738 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:38.379187 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1341e615-6fdc-46aa-a2a5-d309acc5d738 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:38.380374 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1341e615-6fdc-46aa-a2a5-d309acc5d738 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1723 microversion: 2.20 time: 0.208412 Apr 08 11:50:38.380941 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1737/2673] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:50:38 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:50:38.385404 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6938b6a7-db4e-447d-9dd2-cdd1a781e42a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '.version_select at 0x7f042868b040>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:38.470243 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6938b6a7-db4e-447d-9dd2-cdd1a781e42a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2100088169" status: 202 len: 0 microversion: 2.1 time: 0.088181 Apr 08 11:50:38.470861 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1738/2674] 10.222.0.46 () {58 vars in 1220 bytes} [Fri Apr 8 11:50:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2100088169 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 11:50:38.478110 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-e9e879d8-5405-49b9-b3c5-ccd34928a258 req-c3dd6a4c-ec0b-4269-8b3c-7889027f2b01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8", "name": "network-vif-deleted", "tag": "41e9d56a-4a4f-45bd-babc-c02387afd0b8"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:50:38.486824 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-e9e879d8-5405-49b9-b3c5-ccd34928a258 req-c3dd6a4c-ec0b-4269-8b3c-7889027f2b01 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:38.489414 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-e9e879d8-5405-49b9-b3c5-ccd34928a258 req-c3dd6a4c-ec0b-4269-8b3c-7889027f2b01 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:38.500838 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-e9e879d8-5405-49b9-b3c5-ccd34928a258 req-c3dd6a4c-ec0b-4269-8b3c-7889027f2b01 service nova] Creating event network-vif-deleted:41e9d56a-4a4f-45bd-babc-c02387afd0b8 for instance cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8 on hv-cinder-83607 Apr 08 11:50:38.505874 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-e9e879d8-5405-49b9-b3c5-ccd34928a258 req-c3dd6a4c-ec0b-4269-8b3c-7889027f2b01 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033803 Apr 08 11:50:38.506479 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1739/2675] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:50:39.143394 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-02c12482-c82b-410e-bd35-131c9a7b1ffc tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:39.144457 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-02c12482-c82b-410e-bd35-131c9a7b1ffc tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:39.151230 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-02c12482-c82b-410e-bd35-131c9a7b1ffc tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:39.151682 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-02c12482-c82b-410e-bd35-131c9a7b1ffc tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:39.152476 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-02c12482-c82b-410e-bd35-131c9a7b1ffc tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:39.152988 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-02c12482-c82b-410e-bd35-131c9a7b1ffc tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:39.200902 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-02c12482-c82b-410e-bd35-131c9a7b1ffc tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:39.201513 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-02c12482-c82b-410e-bd35-131c9a7b1ffc tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:39.202230 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-02c12482-c82b-410e-bd35-131c9a7b1ffc tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lazy-loading 'fault' on Instance uuid cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8 {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 11:50:39.298343 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-02c12482-c82b-410e-bd35-131c9a7b1ffc tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:39.306742 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-02c12482-c82b-410e-bd35-131c9a7b1ffc tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8" status: 200 len: 1309 microversion: 2.1 time: 0.167667 Apr 08 11:50:39.307386 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1740/2676] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:39 2022] GET /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8 => generated 1309 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:39.399495 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-fa882b18-ee5f-4bc5-9388-bc2913a5fd82 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:39.400110 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-fa882b18-ee5f-4bc5-9388-bc2913a5fd82 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:39.407651 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fa882b18-ee5f-4bc5-9388-bc2913a5fd82 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:39.408024 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fa882b18-ee5f-4bc5-9388-bc2913a5fd82 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:39.408845 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fa882b18-ee5f-4bc5-9388-bc2913a5fd82 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:39.409289 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fa882b18-ee5f-4bc5-9388-bc2913a5fd82 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:39.573104 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-fa882b18-ee5f-4bc5-9388-bc2913a5fd82 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:39.581246 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-fa882b18-ee5f-4bc5-9388-bc2913a5fd82 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:39.582801 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-fa882b18-ee5f-4bc5-9388-bc2913a5fd82 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:39.584048 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-fa882b18-ee5f-4bc5-9388-bc2913a5fd82 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1723 microversion: 2.20 time: 0.188528 Apr 08 11:50:39.584661 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1741/2677] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:50:39 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:50:40.333266 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6ddde8fe-76a0-4d63-8bdf-09093fdeea5a tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:40.334090 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6ddde8fe-76a0-4d63-8bdf-09093fdeea5a tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:40.341167 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6ddde8fe-76a0-4d63-8bdf-09093fdeea5a tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:40.342472 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6ddde8fe-76a0-4d63-8bdf-09093fdeea5a tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:40.343481 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6ddde8fe-76a0-4d63-8bdf-09093fdeea5a tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:40.343913 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6ddde8fe-76a0-4d63-8bdf-09093fdeea5a tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:40.364287 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-6ddde8fe-76a0-4d63-8bdf-09093fdeea5a tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] HTTP exception thrown: Instance cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8 could not be found. Apr 08 11:50:40.364787 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6ddde8fe-76a0-4d63-8bdf-09093fdeea5a tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Returning 404 to user: Instance cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8 could not be found. {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:50:40.365630 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6ddde8fe-76a0-4d63-8bdf-09093fdeea5a tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8" status: 404 len: 111 microversion: 2.1 time: 0.036376 Apr 08 11:50:40.366239 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1742/2678] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:40 2022] GET /compute/v2.1/servers/cf291c9e-ddbc-4d0b-935a-9a7569d8c0b8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 11:50:40.603901 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7f3df761-a003-44f5-864d-003e83625721 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:40.604511 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7f3df761-a003-44f5-864d-003e83625721 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:40.611885 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7f3df761-a003-44f5-864d-003e83625721 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:40.612352 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7f3df761-a003-44f5-864d-003e83625721 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:40.613105 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7f3df761-a003-44f5-864d-003e83625721 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:40.613541 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7f3df761-a003-44f5-864d-003e83625721 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:40.781016 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7f3df761-a003-44f5-864d-003e83625721 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:40.793321 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7f3df761-a003-44f5-864d-003e83625721 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:40.795612 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7f3df761-a003-44f5-864d-003e83625721 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:40.796938 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7f3df761-a003-44f5-864d-003e83625721 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1723 microversion: 2.20 time: 0.196891 Apr 08 11:50:40.797614 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1743/2679] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:50:40 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:50:41.816362 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-86ce7812-36af-4d49-93d6-61f4e0963493 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:41.817077 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-86ce7812-36af-4d49-93d6-61f4e0963493 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:41.823922 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-86ce7812-36af-4d49-93d6-61f4e0963493 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:41.824416 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-86ce7812-36af-4d49-93d6-61f4e0963493 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:41.825218 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-86ce7812-36af-4d49-93d6-61f4e0963493 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:41.825670 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-86ce7812-36af-4d49-93d6-61f4e0963493 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:41.989991 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-86ce7812-36af-4d49-93d6-61f4e0963493 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:41.998486 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-86ce7812-36af-4d49-93d6-61f4e0963493 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:42.000159 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-86ce7812-36af-4d49-93d6-61f4e0963493 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:42.001355 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-86ce7812-36af-4d49-93d6-61f4e0963493 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1723 microversion: 2.20 time: 0.188995 Apr 08 11:50:42.001957 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1744/2680] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:50:41 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:50:43.024136 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7d60dc13-0858-4ce4-b3b9-57838881247a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:43.024861 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7d60dc13-0858-4ce4-b3b9-57838881247a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:43.031341 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d60dc13-0858-4ce4-b3b9-57838881247a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:43.031798 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d60dc13-0858-4ce4-b3b9-57838881247a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:43.032844 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d60dc13-0858-4ce4-b3b9-57838881247a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:43.033281 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d60dc13-0858-4ce4-b3b9-57838881247a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:43.178430 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7d60dc13-0858-4ce4-b3b9-57838881247a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:43.187474 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7d60dc13-0858-4ce4-b3b9-57838881247a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:43.189006 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7d60dc13-0858-4ce4-b3b9-57838881247a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:43.190207 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7d60dc13-0858-4ce4-b3b9-57838881247a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1723 microversion: 2.20 time: 0.170017 Apr 08 11:50:43.190777 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1745/2681] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:50:43 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:50:44.208786 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4d6a50c8-9889-46b7-8ad1-a9af3a19b6f1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:44.209446 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4d6a50c8-9889-46b7-8ad1-a9af3a19b6f1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:44.215761 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4d6a50c8-9889-46b7-8ad1-a9af3a19b6f1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:44.216259 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4d6a50c8-9889-46b7-8ad1-a9af3a19b6f1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:44.217087 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4d6a50c8-9889-46b7-8ad1-a9af3a19b6f1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:44.217528 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4d6a50c8-9889-46b7-8ad1-a9af3a19b6f1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:44.362999 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4d6a50c8-9889-46b7-8ad1-a9af3a19b6f1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:44.371380 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4d6a50c8-9889-46b7-8ad1-a9af3a19b6f1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:44.373503 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4d6a50c8-9889-46b7-8ad1-a9af3a19b6f1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:44.374715 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4d6a50c8-9889-46b7-8ad1-a9af3a19b6f1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1723 microversion: 2.20 time: 0.170037 Apr 08 11:50:44.375280 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1746/2682] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:50:44 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:50:45.395120 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9abf0567-5438-4b0a-8648-2f6475fffca5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:45.395787 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9abf0567-5438-4b0a-8648-2f6475fffca5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:45.402529 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9abf0567-5438-4b0a-8648-2f6475fffca5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:45.402991 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9abf0567-5438-4b0a-8648-2f6475fffca5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:45.403785 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9abf0567-5438-4b0a-8648-2f6475fffca5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:45.404793 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9abf0567-5438-4b0a-8648-2f6475fffca5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:45.549094 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9abf0567-5438-4b0a-8648-2f6475fffca5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:45.557679 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9abf0567-5438-4b0a-8648-2f6475fffca5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:45.559211 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9abf0567-5438-4b0a-8648-2f6475fffca5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:45.560953 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9abf0567-5438-4b0a-8648-2f6475fffca5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1723 microversion: 2.20 time: 0.169335 Apr 08 11:50:45.561511 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1747/2683] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:50:45 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:50:46.579095 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-05f591d9-3aed-4862-bf03-829f6b1a74d5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:46.579797 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-05f591d9-3aed-4862-bf03-829f6b1a74d5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:46.586922 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-05f591d9-3aed-4862-bf03-829f6b1a74d5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:46.587373 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-05f591d9-3aed-4862-bf03-829f6b1a74d5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:46.588155 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-05f591d9-3aed-4862-bf03-829f6b1a74d5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:46.588593 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-05f591d9-3aed-4862-bf03-829f6b1a74d5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:46.730456 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-05f591d9-3aed-4862-bf03-829f6b1a74d5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:46.738999 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-05f591d9-3aed-4862-bf03-829f6b1a74d5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:46.740566 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-05f591d9-3aed-4862-bf03-829f6b1a74d5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:46.741749 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-05f591d9-3aed-4862-bf03-829f6b1a74d5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1723 microversion: 2.20 time: 0.166558 Apr 08 11:50:46.742351 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1748/2684] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:50:46 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:50:47.223683 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-cc519b89-081e-408d-b3e2-99d41b150c9c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:47.224188 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-cc519b89-081e-408d-b3e2-99d41b150c9c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:47.231235 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cc519b89-081e-408d-b3e2-99d41b150c9c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:47.231235 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cc519b89-081e-408d-b3e2-99d41b150c9c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:47.232035 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cc519b89-081e-408d-b3e2-99d41b150c9c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:47.232393 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cc519b89-081e-408d-b3e2-99d41b150c9c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:47.258833 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-cc519b89-081e-408d-b3e2-99d41b150c9c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Going to try to terminate instance {{(pid=117800) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 08 11:50:47.559803 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-cc519b89-081e-408d-b3e2-99d41b150c9c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 204 len: 0 microversion: 2.1 time: 0.339750 Apr 08 11:50:47.560419 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1749/2685] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 8 11:50:47 2022] DELETE /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 08 11:50:47.573790 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6456f93d-c755-482e-820e-cda24503886d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:47.581299 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6456f93d-c755-482e-820e-cda24503886d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:47.581299 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6456f93d-c755-482e-820e-cda24503886d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:47.582123 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6456f93d-c755-482e-820e-cda24503886d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:47.583097 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6456f93d-c755-482e-820e-cda24503886d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:47.583647 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6456f93d-c755-482e-820e-cda24503886d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:47.755770 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6456f93d-c755-482e-820e-cda24503886d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:47.763878 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6456f93d-c755-482e-820e-cda24503886d tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1506 microversion: 2.1 time: 0.194262 Apr 08 11:50:47.765143 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1750/2686] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:47 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1506 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:47.770547 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b142cb88-22bf-4fa4-a950-9dd6494c19bc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:47.771169 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b142cb88-22bf-4fa4-a950-9dd6494c19bc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:47.778018 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b142cb88-22bf-4fa4-a950-9dd6494c19bc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:47.778481 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b142cb88-22bf-4fa4-a950-9dd6494c19bc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:47.779320 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b142cb88-22bf-4fa4-a950-9dd6494c19bc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:47.779815 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b142cb88-22bf-4fa4-a950-9dd6494c19bc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:47.922448 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b142cb88-22bf-4fa4-a950-9dd6494c19bc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:47.931068 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b142cb88-22bf-4fa4-a950-9dd6494c19bc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:47.932592 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b142cb88-22bf-4fa4-a950-9dd6494c19bc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:47.933791 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b142cb88-22bf-4fa4-a950-9dd6494c19bc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1723 microversion: 2.20 time: 0.167255 Apr 08 11:50:47.941669 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1751/2687] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:50:47 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:50:48.784922 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e132c6b2-f102-46ae-ad0f-bed5269aab89 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:48.785974 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e132c6b2-f102-46ae-ad0f-bed5269aab89 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:48.794120 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e132c6b2-f102-46ae-ad0f-bed5269aab89 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:48.794673 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e132c6b2-f102-46ae-ad0f-bed5269aab89 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:48.795756 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e132c6b2-f102-46ae-ad0f-bed5269aab89 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:48.796361 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e132c6b2-f102-46ae-ad0f-bed5269aab89 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:48.991299 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e132c6b2-f102-46ae-ad0f-bed5269aab89 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:49.001189 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e132c6b2-f102-46ae-ad0f-bed5269aab89 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1506 microversion: 2.1 time: 0.222169 Apr 08 11:50:49.001958 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1752/2688] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:48 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1506 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:49.007412 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-16ee533e-538a-4187-b487-4f9a3550473e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:49.008356 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-16ee533e-538a-4187-b487-4f9a3550473e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:49.020315 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-16ee533e-538a-4187-b487-4f9a3550473e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:49.021233 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-16ee533e-538a-4187-b487-4f9a3550473e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:49.022221 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-16ee533e-538a-4187-b487-4f9a3550473e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:49.022862 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-16ee533e-538a-4187-b487-4f9a3550473e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:49.209945 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-16ee533e-538a-4187-b487-4f9a3550473e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:49.219184 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-16ee533e-538a-4187-b487-4f9a3550473e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:49.220757 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-16ee533e-538a-4187-b487-4f9a3550473e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:49.222026 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-16ee533e-538a-4187-b487-4f9a3550473e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1723 microversion: 2.20 time: 0.218785 Apr 08 11:50:49.222607 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1753/2689] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:50:49 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:50:49.340341 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-a5e226e4-eadb-4a72-a031-0c20d6fdfb58 req-d0327674-1f82-4a33-93c4-68f08f370073 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b429d21-2abe-46ac-9148-962da31e1c3d", "name": "network-vif-deleted", "tag": "288e9577-3c88-4dea-b291-aa1cf2450316"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:50:49.349734 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-a5e226e4-eadb-4a72-a031-0c20d6fdfb58 req-d0327674-1f82-4a33-93c4-68f08f370073 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:49.350226 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-a5e226e4-eadb-4a72-a031-0c20d6fdfb58 req-d0327674-1f82-4a33-93c4-68f08f370073 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:49.362701 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-a5e226e4-eadb-4a72-a031-0c20d6fdfb58 req-d0327674-1f82-4a33-93c4-68f08f370073 service nova] Creating event network-vif-deleted:288e9577-3c88-4dea-b291-aa1cf2450316 for instance 6b429d21-2abe-46ac-9148-962da31e1c3d on hv-cinder-83607 Apr 08 11:50:49.368007 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-a5e226e4-eadb-4a72-a031-0c20d6fdfb58 req-d0327674-1f82-4a33-93c4-68f08f370073 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031343 Apr 08 11:50:49.368654 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1754/2690] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:50:50.030654 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-933b0655-ff18-430c-97c4-e48e17acbc7c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:50.031386 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-933b0655-ff18-430c-97c4-e48e17acbc7c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:50.038006 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-933b0655-ff18-430c-97c4-e48e17acbc7c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:50.038464 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-933b0655-ff18-430c-97c4-e48e17acbc7c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:50.039255 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-933b0655-ff18-430c-97c4-e48e17acbc7c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:50.039697 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-933b0655-ff18-430c-97c4-e48e17acbc7c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:50.103558 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-933b0655-ff18-430c-97c4-e48e17acbc7c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:50.111815 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-933b0655-ff18-430c-97c4-e48e17acbc7c tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1464 microversion: 2.1 time: 0.086519 Apr 08 11:50:50.112406 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1755/2691] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:50 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1464 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:50.240586 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7f9fe5af-1ab9-4859-99de-c96b0bdecc60 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:50.241090 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7f9fe5af-1ab9-4859-99de-c96b0bdecc60 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:50.247251 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7f9fe5af-1ab9-4859-99de-c96b0bdecc60 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:50.247710 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7f9fe5af-1ab9-4859-99de-c96b0bdecc60 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:50.248538 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7f9fe5af-1ab9-4859-99de-c96b0bdecc60 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:50.248980 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7f9fe5af-1ab9-4859-99de-c96b0bdecc60 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:50.392579 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7f9fe5af-1ab9-4859-99de-c96b0bdecc60 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:50.402214 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7f9fe5af-1ab9-4859-99de-c96b0bdecc60 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:50.403902 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7f9fe5af-1ab9-4859-99de-c96b0bdecc60 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:50.405640 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7f9fe5af-1ab9-4859-99de-c96b0bdecc60 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1723 microversion: 2.20 time: 0.169079 Apr 08 11:50:50.406250 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1756/2692] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:50:50 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:50:51.129328 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8cc24cb9-76f4-4a65-a8ff-9c4e74240d8a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:51.130149 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8cc24cb9-76f4-4a65-a8ff-9c4e74240d8a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:51.137170 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8cc24cb9-76f4-4a65-a8ff-9c4e74240d8a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:51.137750 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8cc24cb9-76f4-4a65-a8ff-9c4e74240d8a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:51.138630 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8cc24cb9-76f4-4a65-a8ff-9c4e74240d8a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:51.139634 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8cc24cb9-76f4-4a65-a8ff-9c4e74240d8a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:51.206667 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8cc24cb9-76f4-4a65-a8ff-9c4e74240d8a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:51.215018 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8cc24cb9-76f4-4a65-a8ff-9c4e74240d8a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1464 microversion: 2.1 time: 0.089662 Apr 08 11:50:51.215624 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1757/2693] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:51 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1464 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:51.425943 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9da720fa-8ae4-4287-8730-a5399191f184 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:51.426578 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9da720fa-8ae4-4287-8730-a5399191f184 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:51.433536 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9da720fa-8ae4-4287-8730-a5399191f184 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:51.434032 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9da720fa-8ae4-4287-8730-a5399191f184 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:51.434822 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9da720fa-8ae4-4287-8730-a5399191f184 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:51.435266 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9da720fa-8ae4-4287-8730-a5399191f184 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:51.590899 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9da720fa-8ae4-4287-8730-a5399191f184 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:51.598674 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9da720fa-8ae4-4287-8730-a5399191f184 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:51.600191 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9da720fa-8ae4-4287-8730-a5399191f184 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:51.601354 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9da720fa-8ae4-4287-8730-a5399191f184 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1723 microversion: 2.20 time: 0.181043 Apr 08 11:50:51.601950 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1758/2694] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:50:51 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:50:52.232848 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a17b7ff5-5bc0-41d1-a6e0-4c6b2f34be57 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:52.233563 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a17b7ff5-5bc0-41d1-a6e0-4c6b2f34be57 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:52.240151 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a17b7ff5-5bc0-41d1-a6e0-4c6b2f34be57 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:52.240600 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a17b7ff5-5bc0-41d1-a6e0-4c6b2f34be57 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:52.241378 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a17b7ff5-5bc0-41d1-a6e0-4c6b2f34be57 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:52.241845 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a17b7ff5-5bc0-41d1-a6e0-4c6b2f34be57 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:52.314948 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a17b7ff5-5bc0-41d1-a6e0-4c6b2f34be57 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:52.322848 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a17b7ff5-5bc0-41d1-a6e0-4c6b2f34be57 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1464 microversion: 2.1 time: 0.093805 Apr 08 11:50:52.323506 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1759/2695] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:52 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1464 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:52.620472 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3dd63b80-aa49-488b-8f3c-e5db9cf7bf48 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:52.621138 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3dd63b80-aa49-488b-8f3c-e5db9cf7bf48 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:52.627847 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3dd63b80-aa49-488b-8f3c-e5db9cf7bf48 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:52.628286 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3dd63b80-aa49-488b-8f3c-e5db9cf7bf48 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:52.629096 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3dd63b80-aa49-488b-8f3c-e5db9cf7bf48 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:52.629539 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3dd63b80-aa49-488b-8f3c-e5db9cf7bf48 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:52.784421 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3dd63b80-aa49-488b-8f3c-e5db9cf7bf48 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:52.793109 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3dd63b80-aa49-488b-8f3c-e5db9cf7bf48 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:52.794861 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3dd63b80-aa49-488b-8f3c-e5db9cf7bf48 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:52.796205 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3dd63b80-aa49-488b-8f3c-e5db9cf7bf48 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1723 microversion: 2.20 time: 0.180334 Apr 08 11:50:52.797314 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1760/2696] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:50:52 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:50:53.341150 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-93a74f66-6e81-4908-9617-f66f24288f84 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:53.341911 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-93a74f66-6e81-4908-9617-f66f24288f84 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:53.349072 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-93a74f66-6e81-4908-9617-f66f24288f84 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:53.349559 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-93a74f66-6e81-4908-9617-f66f24288f84 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:53.350380 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-93a74f66-6e81-4908-9617-f66f24288f84 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:53.350820 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-93a74f66-6e81-4908-9617-f66f24288f84 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:53.416548 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-93a74f66-6e81-4908-9617-f66f24288f84 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:53.424316 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-93a74f66-6e81-4908-9617-f66f24288f84 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1292 microversion: 2.1 time: 0.087213 Apr 08 11:50:53.424912 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1761/2697] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:53 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1292 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:53.817431 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-07590020-57f3-4c6e-afc5-4950c0b2881b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:53.818215 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-07590020-57f3-4c6e-afc5-4950c0b2881b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:53.824612 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-07590020-57f3-4c6e-afc5-4950c0b2881b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:53.825065 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-07590020-57f3-4c6e-afc5-4950c0b2881b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:53.825960 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-07590020-57f3-4c6e-afc5-4950c0b2881b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:53.826406 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-07590020-57f3-4c6e-afc5-4950c0b2881b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:53.972216 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-07590020-57f3-4c6e-afc5-4950c0b2881b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:53.989263 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-07590020-57f3-4c6e-afc5-4950c0b2881b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:53.992008 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-07590020-57f3-4c6e-afc5-4950c0b2881b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:53.993757 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-07590020-57f3-4c6e-afc5-4950c0b2881b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1723 microversion: 2.20 time: 0.182100 Apr 08 11:50:53.994354 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1762/2698] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:50:53 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:50:54.441111 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-167523f4-07ab-45ec-b162-e8932c12ff6a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:54.441853 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-167523f4-07ab-45ec-b162-e8932c12ff6a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:54.448546 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-167523f4-07ab-45ec-b162-e8932c12ff6a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:54.448943 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-167523f4-07ab-45ec-b162-e8932c12ff6a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:54.449917 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-167523f4-07ab-45ec-b162-e8932c12ff6a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:54.450419 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-167523f4-07ab-45ec-b162-e8932c12ff6a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:54.484933 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-167523f4-07ab-45ec-b162-e8932c12ff6a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:54.485394 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-167523f4-07ab-45ec-b162-e8932c12ff6a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:54.485916 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-167523f4-07ab-45ec-b162-e8932c12ff6a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lazy-loading 'fault' on Instance uuid 6b429d21-2abe-46ac-9148-962da31e1c3d {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 11:50:54.534887 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-167523f4-07ab-45ec-b162-e8932c12ff6a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:54.544933 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-167523f4-07ab-45ec-b162-e8932c12ff6a tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 200 len: 1311 microversion: 2.1 time: 0.108113 Apr 08 11:50:54.545544 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1763/2699] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:54 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 1311 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:55.012601 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c430994b-5b12-4e55-b582-a41d49de4def tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:55.013208 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c430994b-5b12-4e55-b582-a41d49de4def tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:55.019843 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c430994b-5b12-4e55-b582-a41d49de4def tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:55.020295 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c430994b-5b12-4e55-b582-a41d49de4def tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:55.021097 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c430994b-5b12-4e55-b582-a41d49de4def tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:55.021535 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c430994b-5b12-4e55-b582-a41d49de4def tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:55.212790 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c430994b-5b12-4e55-b582-a41d49de4def tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:55.227271 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c430994b-5b12-4e55-b582-a41d49de4def tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:55.230143 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c430994b-5b12-4e55-b582-a41d49de4def tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:55.232453 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c430994b-5b12-4e55-b582-a41d49de4def tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1723 microversion: 2.20 time: 0.223483 Apr 08 11:50:55.233352 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1764/2700] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:50:55 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:50:55.242031 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3ed2cc10-dc23-4aa8-a1e2-e2adaed38b41 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1537510205", "imageRef": "35b8d8d2-a0e9-4c3e-8586-5e088dec27e6", "flavorRef": "452", "networks": [{"uuid": "d6eced8c-35d4-42dc-a366-5f5882c42cdb"}]}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:50:55.305409 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.network.neutron [None req-3ed2cc10-dc23-4aa8-a1e2-e2adaed38b41 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] validate_networks() for [('d6eced8c-35d4-42dc-a366-5f5882c42cdb', None, None, None, None, None)] {{(pid=117800) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 08 11:50:55.709357 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-3ed2cc10-dc23-4aa8-a1e2-e2adaed38b41 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Flavor limits 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 11:50:55.710204 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-3ed2cc10-dc23-4aa8-a1e2-e2adaed38b41 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Image limits 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 11:50:55.710915 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-3ed2cc10-dc23-4aa8-a1e2-e2adaed38b41 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Flavor pref 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 11:50:55.711513 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-3ed2cc10-dc23-4aa8-a1e2-e2adaed38b41 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Image pref 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 11:50:55.712189 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-3ed2cc10-dc23-4aa8-a1e2-e2adaed38b41 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 11:50:55.723095 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3ed2cc10-dc23-4aa8-a1e2-e2adaed38b41 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:55.723598 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3ed2cc10-dc23-4aa8-a1e2-e2adaed38b41 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:55.724403 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3ed2cc10-dc23-4aa8-a1e2-e2adaed38b41 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:55.724833 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3ed2cc10-dc23-4aa8-a1e2-e2adaed38b41 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:55.745361 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-3ed2cc10-dc23-4aa8-a1e2-e2adaed38b41 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Getting quotas for project b717a37fc74e40b1be8f3e43bca2d271. Resources: {'instances', 'ram', 'cores'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 11:50:55.752565 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-3ed2cc10-dc23-4aa8-a1e2-e2adaed38b41 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Getting quotas for user 0283a594e452414d93a92a27f5cd934b and project b717a37fc74e40b1be8f3e43bca2d271. Resources: {'instances', 'ram', 'cores'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 11:50:55.765130 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3ed2cc10-dc23-4aa8-a1e2-e2adaed38b41 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Going to run 1 instances... {{(pid=117800) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 08 11:50:55.767530 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3ed2cc10-dc23-4aa8-a1e2-e2adaed38b41 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: dd2636af-65dc-485a-b874-173a3a203ee9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='35b8d8d2-a0e9-4c3e-8586-5e088dec27e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 08 11:50:55.905604 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3ed2cc10-dc23-4aa8-a1e2-e2adaed38b41 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.670015 Apr 08 11:50:55.908157 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1765/2701] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Apr 8 11:50:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 11:50:55.917590 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-524a95f4-f3e2-445f-b7ef-13572c997e36 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:55.918892 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-524a95f4-f3e2-445f-b7ef-13572c997e36 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: 6b429d21-2abe-46ac-9148-962da31e1c3d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:55.930559 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-524a95f4-f3e2-445f-b7ef-13572c997e36 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:55.931709 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-524a95f4-f3e2-445f-b7ef-13572c997e36 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:55.933189 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-524a95f4-f3e2-445f-b7ef-13572c997e36 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:55.934525 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-524a95f4-f3e2-445f-b7ef-13572c997e36 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:55.951927 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-524a95f4-f3e2-445f-b7ef-13572c997e36 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] HTTP exception thrown: Instance 6b429d21-2abe-46ac-9148-962da31e1c3d could not be found. Apr 08 11:50:55.952509 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-524a95f4-f3e2-445f-b7ef-13572c997e36 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Returning 404 to user: Instance 6b429d21-2abe-46ac-9148-962da31e1c3d could not be found. {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:50:55.953498 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-524a95f4-f3e2-445f-b7ef-13572c997e36 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d" status: 404 len: 111 microversion: 2.1 time: 0.043929 Apr 08 11:50:55.954310 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1766/2702] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:55 2022] GET /compute/v2.1/servers/6b429d21-2abe-46ac-9148-962da31e1c3d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 11:50:55.958614 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e0dabb17-cb30-41f6-bde6-4a490494fb28 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:55.959237 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e0dabb17-cb30-41f6-bde6-4a490494fb28 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: dd2636af-65dc-485a-b874-173a3a203ee9] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:56.024882 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e0dabb17-cb30-41f6-bde6-4a490494fb28 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:56.033138 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e0dabb17-cb30-41f6-bde6-4a490494fb28 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9" status: 200 len: 1219 microversion: 2.1 time: 0.077353 Apr 08 11:50:56.033379 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1767/2703] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:55 2022] GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:50:56.037803 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e3dbc9e6-30f5-4146-88f4-726311e230c0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:56.038321 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e3dbc9e6-30f5-4146-88f4-726311e230c0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: ea2b616a-165e-4f06-9017-37a69bc2a874] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:56.053282 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e3dbc9e6-30f5-4146-88f4-726311e230c0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:56.053742 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e3dbc9e6-30f5-4146-88f4-726311e230c0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:56.054557 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e3dbc9e6-30f5-4146-88f4-726311e230c0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:56.055002 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e3dbc9e6-30f5-4146-88f4-726311e230c0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:56.088131 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e3dbc9e6-30f5-4146-88f4-726311e230c0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: ea2b616a-165e-4f06-9017-37a69bc2a874] Going to try to terminate instance {{(pid=117800) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 08 11:50:56.428903 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e3dbc9e6-30f5-4146-88f4-726311e230c0 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874" status: 204 len: 0 microversion: 2.1 time: 0.394281 Apr 08 11:50:56.429505 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1768/2704] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 8 11:50:56 2022] DELETE /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 11:50:56.435008 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3e020619-3503-4758-8a70-5fe36c952f2e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:56.435704 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3e020619-3503-4758-8a70-5fe36c952f2e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:56.441701 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3e020619-3503-4758-8a70-5fe36c952f2e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:56.442206 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3e020619-3503-4758-8a70-5fe36c952f2e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:56.442972 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3e020619-3503-4758-8a70-5fe36c952f2e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:56.443408 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3e020619-3503-4758-8a70-5fe36c952f2e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:56.581657 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3e020619-3503-4758-8a70-5fe36c952f2e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:56.591631 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3e020619-3503-4758-8a70-5fe36c952f2e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:56.591783 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3e020619-3503-4758-8a70-5fe36c952f2e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:56.593160 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3e020619-3503-4758-8a70-5fe36c952f2e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1744 microversion: 2.20 time: 0.162436 Apr 08 11:50:56.594510 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1769/2705] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:50:56 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:50:56.599157 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2f383aa7-bfe5-4d1c-b560-8ca7eaf93716 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:56.601117 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2f383aa7-bfe5-4d1c-b560-8ca7eaf93716 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: ea2b616a-165e-4f06-9017-37a69bc2a874] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:56.608029 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2f383aa7-bfe5-4d1c-b560-8ca7eaf93716 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:56.608487 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2f383aa7-bfe5-4d1c-b560-8ca7eaf93716 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:56.609346 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2f383aa7-bfe5-4d1c-b560-8ca7eaf93716 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:56.609807 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2f383aa7-bfe5-4d1c-b560-8ca7eaf93716 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:56.751859 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2f383aa7-bfe5-4d1c-b560-8ca7eaf93716 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:56.760851 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2f383aa7-bfe5-4d1c-b560-8ca7eaf93716 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874" status: 200 len: 1521 microversion: 2.1 time: 0.165139 Apr 08 11:50:56.761436 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1770/2706] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:56 2022] GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:50:57.050457 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9c63efd6-1505-4331-9698-ab9faa14739a tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:57.051075 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9c63efd6-1505-4331-9698-ab9faa14739a tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: dd2636af-65dc-485a-b874-173a3a203ee9] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:57.057137 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9c63efd6-1505-4331-9698-ab9faa14739a tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:57.057597 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9c63efd6-1505-4331-9698-ab9faa14739a tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:57.058397 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9c63efd6-1505-4331-9698-ab9faa14739a tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:57.058842 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9c63efd6-1505-4331-9698-ab9faa14739a tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:57.119081 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9c63efd6-1505-4331-9698-ab9faa14739a tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:57.128827 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9c63efd6-1505-4331-9698-ab9faa14739a tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9" status: 200 len: 1223 microversion: 2.1 time: 0.082558 Apr 08 11:50:57.129635 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1771/2707] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:57 2022] GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:57.613090 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f59c5cf5-6e80-4762-93c9-66dd77f7e092 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:57.613707 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f59c5cf5-6e80-4762-93c9-66dd77f7e092 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:57.620019 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f59c5cf5-6e80-4762-93c9-66dd77f7e092 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:57.620474 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f59c5cf5-6e80-4762-93c9-66dd77f7e092 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:57.621242 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f59c5cf5-6e80-4762-93c9-66dd77f7e092 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:57.621683 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f59c5cf5-6e80-4762-93c9-66dd77f7e092 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:57.760351 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f59c5cf5-6e80-4762-93c9-66dd77f7e092 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:57.768872 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f59c5cf5-6e80-4762-93c9-66dd77f7e092 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:57.770396 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f59c5cf5-6e80-4762-93c9-66dd77f7e092 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:57.771538 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f59c5cf5-6e80-4762-93c9-66dd77f7e092 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1744 microversion: 2.20 time: 0.163011 Apr 08 11:50:57.772101 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1772/2708] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:50:57 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:50:57.777909 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-18d37f86-dd11-4631-b20e-ecd69b353ae3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:57.778646 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-18d37f86-dd11-4631-b20e-ecd69b353ae3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: ea2b616a-165e-4f06-9017-37a69bc2a874] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:57.785343 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-18d37f86-dd11-4631-b20e-ecd69b353ae3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:57.785809 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-18d37f86-dd11-4631-b20e-ecd69b353ae3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:57.786573 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-18d37f86-dd11-4631-b20e-ecd69b353ae3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:57.787006 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-18d37f86-dd11-4631-b20e-ecd69b353ae3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:57.923223 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-18d37f86-dd11-4631-b20e-ecd69b353ae3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:57.930604 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-18d37f86-dd11-4631-b20e-ecd69b353ae3 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874" status: 200 len: 1521 microversion: 2.1 time: 0.156073 Apr 08 11:50:57.931177 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1773/2709] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:57 2022] GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:58.145283 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-19895105-b9e3-4bb4-9e82-178ec0ed220d tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:58.146086 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-19895105-b9e3-4bb4-9e82-178ec0ed220d tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: dd2636af-65dc-485a-b874-173a3a203ee9] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:58.152012 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-19895105-b9e3-4bb4-9e82-178ec0ed220d tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:58.152453 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-19895105-b9e3-4bb4-9e82-178ec0ed220d tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:58.153276 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-19895105-b9e3-4bb4-9e82-178ec0ed220d tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:58.153650 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-19895105-b9e3-4bb4-9e82-178ec0ed220d tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:58.214940 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-19895105-b9e3-4bb4-9e82-178ec0ed220d tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:58.222565 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-19895105-b9e3-4bb4-9e82-178ec0ed220d tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9" status: 200 len: 1215 microversion: 2.1 time: 0.081694 Apr 08 11:50:58.223149 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1774/2710] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:58 2022] GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9 => generated 1215 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:50:58.350543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-08c32974-ccbc-4770-8afd-f7eeb1ebfd12 req-794109a4-ca73-4b20-ba6d-7d4fdcb2e0dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1da27a98-0639-4251-ae77-64f51d7f8f76", "name": "network-vif-plugged", "status": "completed", "tag": "d23a90b6-9e66-48bf-9f26-cdd76a4924a4"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:50:58.360845 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-08c32974-ccbc-4770-8afd-f7eeb1ebfd12 req-794109a4-ca73-4b20-ba6d-7d4fdcb2e0dd service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:58.361240 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-08c32974-ccbc-4770-8afd-f7eeb1ebfd12 req-794109a4-ca73-4b20-ba6d-7d4fdcb2e0dd service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:58.373568 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-08c32974-ccbc-4770-8afd-f7eeb1ebfd12 req-794109a4-ca73-4b20-ba6d-7d4fdcb2e0dd service nova] Creating event network-vif-plugged:d23a90b6-9e66-48bf-9f26-cdd76a4924a4 for instance 1da27a98-0639-4251-ae77-64f51d7f8f76 on hv-cinder-83607 Apr 08 11:50:58.379150 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-08c32974-ccbc-4770-8afd-f7eeb1ebfd12 req-794109a4-ca73-4b20-ba6d-7d4fdcb2e0dd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032301 Apr 08 11:50:58.384483 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1775/2711] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:50:58.799296 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-94e300d7-85f5-405f-a33d-76b66384e6c3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:58.800009 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-94e300d7-85f5-405f-a33d-76b66384e6c3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:58.806653 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-94e300d7-85f5-405f-a33d-76b66384e6c3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:58.807142 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-94e300d7-85f5-405f-a33d-76b66384e6c3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:58.807930 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-94e300d7-85f5-405f-a33d-76b66384e6c3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:58.808378 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-94e300d7-85f5-405f-a33d-76b66384e6c3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:58.979228 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-94e300d7-85f5-405f-a33d-76b66384e6c3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:58.987733 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-94e300d7-85f5-405f-a33d-76b66384e6c3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:58.990450 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-94e300d7-85f5-405f-a33d-76b66384e6c3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:58.991679 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-94e300d7-85f5-405f-a33d-76b66384e6c3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1744 microversion: 2.20 time: 0.199728 Apr 08 11:50:58.992238 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1776/2712] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:50:58 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1744 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:50:58.998558 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-686a6f55-a86b-44ad-a73b-c6ff7b09c045 req-8b1e0d56-084f-4bf8-a1f8-c10aa44165bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea2b616a-165e-4f06-9017-37a69bc2a874", "name": "network-vif-deleted", "tag": "e2a58113-a345-4b0a-9d62-117d6974817e"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:50:59.008647 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-686a6f55-a86b-44ad-a73b-c6ff7b09c045 req-8b1e0d56-084f-4bf8-a1f8-c10aa44165bd service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:59.009078 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-686a6f55-a86b-44ad-a73b-c6ff7b09c045 req-8b1e0d56-084f-4bf8-a1f8-c10aa44165bd service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:59.021949 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-686a6f55-a86b-44ad-a73b-c6ff7b09c045 req-8b1e0d56-084f-4bf8-a1f8-c10aa44165bd service nova] Creating event network-vif-deleted:e2a58113-a345-4b0a-9d62-117d6974817e for instance ea2b616a-165e-4f06-9017-37a69bc2a874 on hv-cinder-83607 Apr 08 11:50:59.026873 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-686a6f55-a86b-44ad-a73b-c6ff7b09c045 req-8b1e0d56-084f-4bf8-a1f8-c10aa44165bd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033280 Apr 08 11:50:59.027525 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1777/2713] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:50:59.032891 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ffcff7f8-8ba8-41d3-bd1a-ac6a0124e4c8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:59.033887 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ffcff7f8-8ba8-41d3-bd1a-ac6a0124e4c8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: ea2b616a-165e-4f06-9017-37a69bc2a874] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:59.040156 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ffcff7f8-8ba8-41d3-bd1a-ac6a0124e4c8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:59.042297 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ffcff7f8-8ba8-41d3-bd1a-ac6a0124e4c8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:59.042297 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ffcff7f8-8ba8-41d3-bd1a-ac6a0124e4c8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:59.042297 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ffcff7f8-8ba8-41d3-bd1a-ac6a0124e4c8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:59.109070 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ffcff7f8-8ba8-41d3-bd1a-ac6a0124e4c8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:59.117016 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ffcff7f8-8ba8-41d3-bd1a-ac6a0124e4c8 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874" status: 200 len: 1479 microversion: 2.1 time: 0.087868 Apr 08 11:50:59.117965 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1778/2714] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:59 2022] GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874 => generated 1479 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:50:59.238613 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-66ba6d70-18b4-4312-a90a-d6e9634945eb tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:50:59.239233 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-66ba6d70-18b4-4312-a90a-d6e9634945eb tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: dd2636af-65dc-485a-b874-173a3a203ee9] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:50:59.245350 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-66ba6d70-18b4-4312-a90a-d6e9634945eb tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:59.245842 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-66ba6d70-18b4-4312-a90a-d6e9634945eb tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:59.246630 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-66ba6d70-18b4-4312-a90a-d6e9634945eb tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:50:59.247101 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-66ba6d70-18b4-4312-a90a-d6e9634945eb tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:50:59.308192 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-66ba6d70-18b4-4312-a90a-d6e9634945eb tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:50:59.315636 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-66ba6d70-18b4-4312-a90a-d6e9634945eb tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9" status: 200 len: 1279 microversion: 2.1 time: 0.080882 Apr 08 11:50:59.316219 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1779/2715] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:50:59 2022] GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9 => generated 1279 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:51:00.010386 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-cae8bb82-da23-43ba-a5d9-d55a6e637f20 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:00.011068 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-cae8bb82-da23-43ba-a5d9-d55a6e637f20 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:00.018381 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cae8bb82-da23-43ba-a5d9-d55a6e637f20 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:00.039038 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cae8bb82-da23-43ba-a5d9-d55a6e637f20 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:00.039038 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cae8bb82-da23-43ba-a5d9-d55a6e637f20 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:00.039038 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cae8bb82-da23-43ba-a5d9-d55a6e637f20 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:00.167198 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-cae8bb82-da23-43ba-a5d9-d55a6e637f20 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:00.178780 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-cae8bb82-da23-43ba-a5d9-d55a6e637f20 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:00.180434 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-cae8bb82-da23-43ba-a5d9-d55a6e637f20 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:00.181897 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-cae8bb82-da23-43ba-a5d9-d55a6e637f20 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1744 microversion: 2.20 time: 0.175585 Apr 08 11:51:00.182735 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1780/2716] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:00 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1744 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:51:00.194571 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-84be0f02-9b9d-4cf4-9904-1798c583ad79 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:00.194571 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-84be0f02-9b9d-4cf4-9904-1798c583ad79 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: ea2b616a-165e-4f06-9017-37a69bc2a874] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:00.197316 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-84be0f02-9b9d-4cf4-9904-1798c583ad79 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:00.197869 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-84be0f02-9b9d-4cf4-9904-1798c583ad79 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:00.200705 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-84be0f02-9b9d-4cf4-9904-1798c583ad79 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:00.200705 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-84be0f02-9b9d-4cf4-9904-1798c583ad79 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:00.284295 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-84be0f02-9b9d-4cf4-9904-1798c583ad79 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:00.284295 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-84be0f02-9b9d-4cf4-9904-1798c583ad79 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:00.284295 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-84be0f02-9b9d-4cf4-9904-1798c583ad79 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lazy-loading 'fault' on Instance uuid ea2b616a-165e-4f06-9017-37a69bc2a874 {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 11:51:00.328079 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-84be0f02-9b9d-4cf4-9904-1798c583ad79 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5bdfdda63241d284449c6b2ec5c46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fe2dc297a34f0281e7a165efea5957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:00.337146 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-84be0f02-9b9d-4cf4-9904-1798c583ad79 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874" status: 200 len: 1312 microversion: 2.1 time: 0.153078 Apr 08 11:51:00.338137 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1781/2717] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:51:00 2022] GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874 => generated 1312 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:51:00.343130 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-50f5005b-38af-479f-a14e-0a95f1ead9bf tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:00.344307 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-50f5005b-38af-479f-a14e-0a95f1ead9bf tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: dd2636af-65dc-485a-b874-173a3a203ee9] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:00.351059 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-50f5005b-38af-479f-a14e-0a95f1ead9bf tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:00.351521 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-50f5005b-38af-479f-a14e-0a95f1ead9bf tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:00.352326 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-50f5005b-38af-479f-a14e-0a95f1ead9bf tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:00.352788 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-50f5005b-38af-479f-a14e-0a95f1ead9bf tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:00.503802 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-50f5005b-38af-479f-a14e-0a95f1ead9bf tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:00.512578 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-50f5005b-38af-479f-a14e-0a95f1ead9bf tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9" status: 200 len: 1319 microversion: 2.1 time: 0.173134 Apr 08 11:51:00.513394 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1782/2718] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:51:00 2022] GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:51:01.216633 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-03313b6d-1f80-44f8-ba23-0d586c9cf3b3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:01.220055 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-03313b6d-1f80-44f8-ba23-0d586c9cf3b3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:01.227546 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-03313b6d-1f80-44f8-ba23-0d586c9cf3b3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:01.228389 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-03313b6d-1f80-44f8-ba23-0d586c9cf3b3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:01.229267 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-03313b6d-1f80-44f8-ba23-0d586c9cf3b3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:01.230001 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-03313b6d-1f80-44f8-ba23-0d586c9cf3b3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:01.399313 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-03313b6d-1f80-44f8-ba23-0d586c9cf3b3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:01.409485 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-03313b6d-1f80-44f8-ba23-0d586c9cf3b3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:01.411542 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-03313b6d-1f80-44f8-ba23-0d586c9cf3b3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:01.412841 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-03313b6d-1f80-44f8-ba23-0d586c9cf3b3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1739 microversion: 2.20 time: 0.200250 Apr 08 11:51:01.413529 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1783/2719] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:01 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:51:01.418419 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-92bdab61-f0f7-4ff3-b75f-ab547aae8092 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:01.419052 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-92bdab61-f0f7-4ff3-b75f-ab547aae8092 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] [instance: ea2b616a-165e-4f06-9017-37a69bc2a874] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:01.428145 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-92bdab61-f0f7-4ff3-b75f-ab547aae8092 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:01.428609 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-92bdab61-f0f7-4ff3-b75f-ab547aae8092 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:01.429401 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-92bdab61-f0f7-4ff3-b75f-ab547aae8092 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:01.430078 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-92bdab61-f0f7-4ff3-b75f-ab547aae8092 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:01.443973 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-92bdab61-f0f7-4ff3-b75f-ab547aae8092 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] HTTP exception thrown: Instance ea2b616a-165e-4f06-9017-37a69bc2a874 could not be found. Apr 08 11:51:01.444485 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-92bdab61-f0f7-4ff3-b75f-ab547aae8092 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] Returning 404 to user: Instance ea2b616a-165e-4f06-9017-37a69bc2a874 could not be found. {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:51:01.445327 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-92bdab61-f0f7-4ff3-b75f-ab547aae8092 tempest-ServerRescueNegativeTestJSON-1904825361 tempest-ServerRescueNegativeTestJSON-1904825361-project] 10.222.0.46 "GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874" status: 404 len: 111 microversion: 2.1 time: 0.030655 Apr 08 11:51:01.445910 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1784/2720] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:51:01 2022] GET /compute/v2.1/servers/ea2b616a-165e-4f06-9017-37a69bc2a874 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 11:51:01.539352 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-7b9ad4e7-94e7-4fe3-8b4d-deb1b386ef63 req-4f7ea85e-bb9d-4ac9-8889-89754d23eb6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd2636af-65dc-485a-b874-173a3a203ee9", "tag": "0f9e1448-2d57-4d32-94ef-7a51d55f31f4"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:51:01.547126 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-7b9ad4e7-94e7-4fe3-8b4d-deb1b386ef63 req-4f7ea85e-bb9d-4ac9-8889-89754d23eb6a service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:01.547556 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-7b9ad4e7-94e7-4fe3-8b4d-deb1b386ef63 req-4f7ea85e-bb9d-4ac9-8889-89754d23eb6a service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:01.563077 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-7b9ad4e7-94e7-4fe3-8b4d-deb1b386ef63 req-4f7ea85e-bb9d-4ac9-8889-89754d23eb6a service nova] Creating event network-changed:0f9e1448-2d57-4d32-94ef-7a51d55f31f4 for instance dd2636af-65dc-485a-b874-173a3a203ee9 on hv-cinder-83607 Apr 08 11:51:01.568660 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-7b9ad4e7-94e7-4fe3-8b4d-deb1b386ef63 req-4f7ea85e-bb9d-4ac9-8889-89754d23eb6a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037514 Apr 08 11:51:01.569269 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1785/2721] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:51:01.576376 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-19117afd-2581-49a0-85b2-399528238eff tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:01.577114 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-19117afd-2581-49a0-85b2-399528238eff tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: dd2636af-65dc-485a-b874-173a3a203ee9] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:01.584146 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-19117afd-2581-49a0-85b2-399528238eff tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:01.585329 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-19117afd-2581-49a0-85b2-399528238eff tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:01.585461 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-19117afd-2581-49a0-85b2-399528238eff tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:01.585846 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-19117afd-2581-49a0-85b2-399528238eff tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:01.883517 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-19117afd-2581-49a0-85b2-399528238eff tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:01.894995 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-19117afd-2581-49a0-85b2-399528238eff tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9" status: 200 len: 1319 microversion: 2.1 time: 0.324075 Apr 08 11:51:01.904550 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1786/2722] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:51:01 2022] GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9 => generated 1319 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:51:02.432262 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9ee87e9f-eba8-42e4-bdf8-9eb3c70ff3c4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:02.433678 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9ee87e9f-eba8-42e4-bdf8-9eb3c70ff3c4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:02.445969 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9ee87e9f-eba8-42e4-bdf8-9eb3c70ff3c4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:02.446753 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9ee87e9f-eba8-42e4-bdf8-9eb3c70ff3c4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:02.447810 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9ee87e9f-eba8-42e4-bdf8-9eb3c70ff3c4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:02.448475 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9ee87e9f-eba8-42e4-bdf8-9eb3c70ff3c4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:02.696672 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9ee87e9f-eba8-42e4-bdf8-9eb3c70ff3c4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:02.705890 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9ee87e9f-eba8-42e4-bdf8-9eb3c70ff3c4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:02.707477 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9ee87e9f-eba8-42e4-bdf8-9eb3c70ff3c4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:02.708786 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9ee87e9f-eba8-42e4-bdf8-9eb3c70ff3c4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1739 microversion: 2.20 time: 0.280673 Apr 08 11:51:02.709460 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1787/2723] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:02 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1739 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:51:02.914531 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-afdfd5d5-a3f6-4c62-a323-3558b62246c1 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:02.915715 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-afdfd5d5-a3f6-4c62-a323-3558b62246c1 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: dd2636af-65dc-485a-b874-173a3a203ee9] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:02.923720 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-afdfd5d5-a3f6-4c62-a323-3558b62246c1 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:02.924433 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-afdfd5d5-a3f6-4c62-a323-3558b62246c1 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:02.925375 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-afdfd5d5-a3f6-4c62-a323-3558b62246c1 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:02.926217 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-afdfd5d5-a3f6-4c62-a323-3558b62246c1 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:03.202140 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-afdfd5d5-a3f6-4c62-a323-3558b62246c1 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:03.227184 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-afdfd5d5-a3f6-4c62-a323-3558b62246c1 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9" status: 200 len: 1319 microversion: 2.1 time: 0.317536 Apr 08 11:51:03.237410 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1788/2724] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:51:02 2022] GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9 => generated 1319 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:51:03.745250 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7cc8e7ed-d026-41df-9237-a90dc5abf6be tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:03.747923 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7cc8e7ed-d026-41df-9237-a90dc5abf6be tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:03.756490 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7cc8e7ed-d026-41df-9237-a90dc5abf6be tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:03.757263 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7cc8e7ed-d026-41df-9237-a90dc5abf6be tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:03.758417 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7cc8e7ed-d026-41df-9237-a90dc5abf6be tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:03.759022 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7cc8e7ed-d026-41df-9237-a90dc5abf6be tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:04.353694 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7cc8e7ed-d026-41df-9237-a90dc5abf6be tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:04.361919 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7cc8e7ed-d026-41df-9237-a90dc5abf6be tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:04.370333 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7cc8e7ed-d026-41df-9237-a90dc5abf6be tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:04.375234 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7cc8e7ed-d026-41df-9237-a90dc5abf6be tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1739 microversion: 2.20 time: 0.643995 Apr 08 11:51:04.376187 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1789/2725] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:03 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1739 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:51:04.390930 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7ba25bf0-d446-4f6a-bf70-0d8dd21f2454 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:04.391657 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7ba25bf0-d446-4f6a-bf70-0d8dd21f2454 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: dd2636af-65dc-485a-b874-173a3a203ee9] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:04.401998 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7ba25bf0-d446-4f6a-bf70-0d8dd21f2454 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:04.406731 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7ba25bf0-d446-4f6a-bf70-0d8dd21f2454 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:04.408597 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7ba25bf0-d446-4f6a-bf70-0d8dd21f2454 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:04.417671 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7ba25bf0-d446-4f6a-bf70-0d8dd21f2454 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:04.608846 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7ba25bf0-d446-4f6a-bf70-0d8dd21f2454 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:04.618520 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7ba25bf0-d446-4f6a-bf70-0d8dd21f2454 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9" status: 200 len: 1319 microversion: 2.1 time: 0.239668 Apr 08 11:51:04.620784 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1790/2726] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:51:04 2022] GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:51:05.395324 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1fb96ed3-2659-4949-9eb4-b1b9d2e399c5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:05.396486 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1fb96ed3-2659-4949-9eb4-b1b9d2e399c5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:05.403925 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1fb96ed3-2659-4949-9eb4-b1b9d2e399c5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:05.404512 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1fb96ed3-2659-4949-9eb4-b1b9d2e399c5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:05.405233 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1fb96ed3-2659-4949-9eb4-b1b9d2e399c5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:05.405619 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1fb96ed3-2659-4949-9eb4-b1b9d2e399c5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:05.585036 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1fb96ed3-2659-4949-9eb4-b1b9d2e399c5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:05.594279 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1fb96ed3-2659-4949-9eb4-b1b9d2e399c5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:05.597226 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1fb96ed3-2659-4949-9eb4-b1b9d2e399c5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:05.599033 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1fb96ed3-2659-4949-9eb4-b1b9d2e399c5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1739 microversion: 2.20 time: 0.209450 Apr 08 11:51:05.600209 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1791/2727] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:05 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1739 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:51:05.637734 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8b3816d7-5eef-4279-9bf9-7b685fe5afe7 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:05.638837 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8b3816d7-5eef-4279-9bf9-7b685fe5afe7 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: dd2636af-65dc-485a-b874-173a3a203ee9] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:05.662228 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8b3816d7-5eef-4279-9bf9-7b685fe5afe7 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:05.663883 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8b3816d7-5eef-4279-9bf9-7b685fe5afe7 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:05.665214 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8b3816d7-5eef-4279-9bf9-7b685fe5afe7 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:05.667688 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8b3816d7-5eef-4279-9bf9-7b685fe5afe7 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:05.874066 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8b3816d7-5eef-4279-9bf9-7b685fe5afe7 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:05.884557 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8b3816d7-5eef-4279-9bf9-7b685fe5afe7 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9" status: 200 len: 1319 microversion: 2.1 time: 0.250941 Apr 08 11:51:05.885443 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1792/2728] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:51:05 2022] GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9 => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:51:06.619280 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-aa2a70d8-8efc-4b9d-a574-1d79d0294ca9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:06.620880 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-aa2a70d8-8efc-4b9d-a574-1d79d0294ca9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:06.635311 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aa2a70d8-8efc-4b9d-a574-1d79d0294ca9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:06.636012 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aa2a70d8-8efc-4b9d-a574-1d79d0294ca9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:06.637120 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aa2a70d8-8efc-4b9d-a574-1d79d0294ca9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:06.637761 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aa2a70d8-8efc-4b9d-a574-1d79d0294ca9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:06.872934 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-aa2a70d8-8efc-4b9d-a574-1d79d0294ca9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:06.882960 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-aa2a70d8-8efc-4b9d-a574-1d79d0294ca9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:06.887889 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-aa2a70d8-8efc-4b9d-a574-1d79d0294ca9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:06.892488 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-aa2a70d8-8efc-4b9d-a574-1d79d0294ca9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1739 microversion: 2.20 time: 0.277373 Apr 08 11:51:06.895735 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1793/2729] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:06 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1739 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:51:06.913748 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9f0798da-3337-43f1-8d6b-6c2ae6ab69d1 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:06.914786 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9f0798da-3337-43f1-8d6b-6c2ae6ab69d1 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: dd2636af-65dc-485a-b874-173a3a203ee9] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:06.921465 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9f0798da-3337-43f1-8d6b-6c2ae6ab69d1 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:06.922327 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9f0798da-3337-43f1-8d6b-6c2ae6ab69d1 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:06.923359 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9f0798da-3337-43f1-8d6b-6c2ae6ab69d1 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:06.924003 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9f0798da-3337-43f1-8d6b-6c2ae6ab69d1 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:07.247762 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9f0798da-3337-43f1-8d6b-6c2ae6ab69d1 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:07.258366 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9f0798da-3337-43f1-8d6b-6c2ae6ab69d1 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9" status: 200 len: 1319 microversion: 2.1 time: 0.349537 Apr 08 11:51:07.259148 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1794/2730] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:51:06 2022] GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9 => generated 1319 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:51:07.914676 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-891fc98f-7745-4e26-b207-e5981f2549fc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:07.915659 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-891fc98f-7745-4e26-b207-e5981f2549fc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:07.923476 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-891fc98f-7745-4e26-b207-e5981f2549fc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:07.924058 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-891fc98f-7745-4e26-b207-e5981f2549fc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:07.924942 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-891fc98f-7745-4e26-b207-e5981f2549fc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:07.925548 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-891fc98f-7745-4e26-b207-e5981f2549fc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:08.120128 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-891fc98f-7745-4e26-b207-e5981f2549fc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:08.130592 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-891fc98f-7745-4e26-b207-e5981f2549fc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:08.132304 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-891fc98f-7745-4e26-b207-e5981f2549fc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:08.133583 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-891fc98f-7745-4e26-b207-e5981f2549fc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1739 microversion: 2.20 time: 0.223165 Apr 08 11:51:08.134236 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1795/2731] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:07 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1739 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:51:08.465271 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-64c61c44-2a52-4d40-9861-d414572b7911 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:08.465271 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-64c61c44-2a52-4d40-9861-d414572b7911 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: dd2636af-65dc-485a-b874-173a3a203ee9] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:08.465271 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-64c61c44-2a52-4d40-9861-d414572b7911 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:08.465271 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-64c61c44-2a52-4d40-9861-d414572b7911 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:08.465615 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-64c61c44-2a52-4d40-9861-d414572b7911 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:08.465615 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-64c61c44-2a52-4d40-9861-d414572b7911 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:08.465615 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-64c61c44-2a52-4d40-9861-d414572b7911 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:08.466010 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-64c61c44-2a52-4d40-9861-d414572b7911 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9" status: 200 len: 1319 microversion: 2.1 time: 0.168908 Apr 08 11:51:08.466010 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1796/2732] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:51:08 2022] GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:51:08.768105 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-808b7f1c-04be-4f13-941b-95e7732dce3f req-4530adee-a96c-47a7-af1d-7e1408678a83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd2636af-65dc-485a-b874-173a3a203ee9", "name": "network-vif-plugged", "status": "completed", "tag": "0f9e1448-2d57-4d32-94ef-7a51d55f31f4"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:51:08.780310 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-808b7f1c-04be-4f13-941b-95e7732dce3f req-4530adee-a96c-47a7-af1d-7e1408678a83 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:08.781521 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-808b7f1c-04be-4f13-941b-95e7732dce3f req-4530adee-a96c-47a7-af1d-7e1408678a83 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:08.795139 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-808b7f1c-04be-4f13-941b-95e7732dce3f req-4530adee-a96c-47a7-af1d-7e1408678a83 service nova] Creating event network-vif-plugged:0f9e1448-2d57-4d32-94ef-7a51d55f31f4 for instance dd2636af-65dc-485a-b874-173a3a203ee9 on hv-cinder-83607 Apr 08 11:51:08.801127 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-808b7f1c-04be-4f13-941b-95e7732dce3f req-4530adee-a96c-47a7-af1d-7e1408678a83 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038556 Apr 08 11:51:08.802070 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1797/2733] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:51:09.154242 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b5fb07ee-cb1c-4dfb-ac82-9e742c34ebc9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:09.156240 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b5fb07ee-cb1c-4dfb-ac82-9e742c34ebc9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:09.163404 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b5fb07ee-cb1c-4dfb-ac82-9e742c34ebc9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:09.164121 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b5fb07ee-cb1c-4dfb-ac82-9e742c34ebc9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:09.165079 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b5fb07ee-cb1c-4dfb-ac82-9e742c34ebc9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:09.165753 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b5fb07ee-cb1c-4dfb-ac82-9e742c34ebc9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:09.404436 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b5fb07ee-cb1c-4dfb-ac82-9e742c34ebc9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:09.415619 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b5fb07ee-cb1c-4dfb-ac82-9e742c34ebc9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:09.417226 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b5fb07ee-cb1c-4dfb-ac82-9e742c34ebc9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:09.418431 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b5fb07ee-cb1c-4dfb-ac82-9e742c34ebc9 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1739 microversion: 2.20 time: 0.269154 Apr 08 11:51:09.419569 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1798/2734] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:09 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1739 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:51:09.482918 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3707c8be-8960-4e85-9f1f-7c2fd0099657 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:09.484624 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3707c8be-8960-4e85-9f1f-7c2fd0099657 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: dd2636af-65dc-485a-b874-173a3a203ee9] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:09.495178 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3707c8be-8960-4e85-9f1f-7c2fd0099657 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:09.495642 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3707c8be-8960-4e85-9f1f-7c2fd0099657 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:09.496497 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3707c8be-8960-4e85-9f1f-7c2fd0099657 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:09.499273 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3707c8be-8960-4e85-9f1f-7c2fd0099657 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:09.711486 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3707c8be-8960-4e85-9f1f-7c2fd0099657 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:09.719820 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3707c8be-8960-4e85-9f1f-7c2fd0099657 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9" status: 200 len: 1319 microversion: 2.1 time: 0.241097 Apr 08 11:51:09.720400 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1799/2735] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:51:09 2022] GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9 => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:51:10.437711 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-21754311-c8e3-4534-8c83-a1e6c1c8eadc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:10.438421 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-21754311-c8e3-4534-8c83-a1e6c1c8eadc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:10.448084 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-21754311-c8e3-4534-8c83-a1e6c1c8eadc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:10.448542 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-21754311-c8e3-4534-8c83-a1e6c1c8eadc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:10.449334 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-21754311-c8e3-4534-8c83-a1e6c1c8eadc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:10.449799 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-21754311-c8e3-4534-8c83-a1e6c1c8eadc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:10.611057 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-21754311-c8e3-4534-8c83-a1e6c1c8eadc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:10.622065 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-21754311-c8e3-4534-8c83-a1e6c1c8eadc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:10.622065 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-21754311-c8e3-4534-8c83-a1e6c1c8eadc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:10.622470 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-21754311-c8e3-4534-8c83-a1e6c1c8eadc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1739 microversion: 2.20 time: 0.188623 Apr 08 11:51:10.623841 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1800/2736] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:10 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:51:10.736440 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e777ca48-f7fc-40ea-b8e3-22cfb9d500fa tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:10.737070 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e777ca48-f7fc-40ea-b8e3-22cfb9d500fa tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: dd2636af-65dc-485a-b874-173a3a203ee9] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:10.744155 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e777ca48-f7fc-40ea-b8e3-22cfb9d500fa tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:10.744613 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e777ca48-f7fc-40ea-b8e3-22cfb9d500fa tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:10.745405 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e777ca48-f7fc-40ea-b8e3-22cfb9d500fa tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:10.745882 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e777ca48-f7fc-40ea-b8e3-22cfb9d500fa tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:10.993455 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e777ca48-f7fc-40ea-b8e3-22cfb9d500fa tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:11.003763 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e777ca48-f7fc-40ea-b8e3-22cfb9d500fa tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9" status: 200 len: 1319 microversion: 2.1 time: 0.271100 Apr 08 11:51:11.013486 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1801/2737] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:51:10 2022] GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9 => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:51:11.641727 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7e5c74b1-e7a7-4f13-b1b6-6d0b4bb2f584 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:11.643722 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7e5c74b1-e7a7-4f13-b1b6-6d0b4bb2f584 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:11.658101 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7e5c74b1-e7a7-4f13-b1b6-6d0b4bb2f584 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:11.659158 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7e5c74b1-e7a7-4f13-b1b6-6d0b4bb2f584 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:11.660031 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7e5c74b1-e7a7-4f13-b1b6-6d0b4bb2f584 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:11.660704 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7e5c74b1-e7a7-4f13-b1b6-6d0b4bb2f584 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:11.854473 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7e5c74b1-e7a7-4f13-b1b6-6d0b4bb2f584 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:11.854473 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7e5c74b1-e7a7-4f13-b1b6-6d0b4bb2f584 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:11.854765 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7e5c74b1-e7a7-4f13-b1b6-6d0b4bb2f584 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:11.854765 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7e5c74b1-e7a7-4f13-b1b6-6d0b4bb2f584 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1739 microversion: 2.20 time: 0.190013 Apr 08 11:51:11.854765 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1802/2738] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:11 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:51:12.024797 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a5c0d898-2413-4346-ba90-00549ee65b98 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:12.025406 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a5c0d898-2413-4346-ba90-00549ee65b98 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: dd2636af-65dc-485a-b874-173a3a203ee9] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:12.032027 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a5c0d898-2413-4346-ba90-00549ee65b98 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:12.032481 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a5c0d898-2413-4346-ba90-00549ee65b98 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:12.033246 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a5c0d898-2413-4346-ba90-00549ee65b98 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:12.033973 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a5c0d898-2413-4346-ba90-00549ee65b98 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:12.188089 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a5c0d898-2413-4346-ba90-00549ee65b98 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:12.195875 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a5c0d898-2413-4346-ba90-00549ee65b98 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9" status: 200 len: 1507 microversion: 2.1 time: 0.174799 Apr 08 11:51:12.203431 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1803/2739] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:51:12 2022] GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9 => generated 1507 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:51:12.219994 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-499a005e-f0c9-462d-8023-775adc67c6a4 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2bfeb4e5-92ec-4952-b4ad-fdd79dc9cc66", "device": "/dev/sdb"}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:51:12.221108 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-499a005e-f0c9-462d-8023-775adc67c6a4 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: dd2636af-65dc-485a-b874-173a3a203ee9] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:12.227397 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-499a005e-f0c9-462d-8023-775adc67c6a4 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:12.227849 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-499a005e-f0c9-462d-8023-775adc67c6a4 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:12.228628 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-499a005e-f0c9-462d-8023-775adc67c6a4 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:12.229069 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-499a005e-f0c9-462d-8023-775adc67c6a4 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:13.081004 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-499a005e-f0c9-462d-8023-775adc67c6a4 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "POST /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.866818 Apr 08 11:51:13.081826 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1804/2740] 10.222.0.46 () {60 vars in 1322 bytes} [Fri Apr 8 11:51:12 2022] POST /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9/os-volume_attachments => generated 194 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:51:13.106336 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ba8eb28a-d421-45b0-943e-bf7d566935f1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:13.107049 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ba8eb28a-d421-45b0-943e-bf7d566935f1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:13.116593 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ba8eb28a-d421-45b0-943e-bf7d566935f1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:13.117563 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ba8eb28a-d421-45b0-943e-bf7d566935f1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:13.118536 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ba8eb28a-d421-45b0-943e-bf7d566935f1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:13.119133 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ba8eb28a-d421-45b0-943e-bf7d566935f1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:13.274968 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ba8eb28a-d421-45b0-943e-bf7d566935f1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:13.284046 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ba8eb28a-d421-45b0-943e-bf7d566935f1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:13.285586 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ba8eb28a-d421-45b0-943e-bf7d566935f1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:13.286860 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ba8eb28a-d421-45b0-943e-bf7d566935f1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1739 microversion: 2.20 time: 0.184984 Apr 08 11:51:13.287429 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1805/2741] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:13 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1739 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:51:14.304599 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-59ad9c7f-34f8-4726-8cb9-502843f488b2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:14.305536 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-59ad9c7f-34f8-4726-8cb9-502843f488b2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:14.313879 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-59ad9c7f-34f8-4726-8cb9-502843f488b2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:14.314335 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-59ad9c7f-34f8-4726-8cb9-502843f488b2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:14.315118 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-59ad9c7f-34f8-4726-8cb9-502843f488b2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:14.315558 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-59ad9c7f-34f8-4726-8cb9-502843f488b2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:14.614563 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-59ad9c7f-34f8-4726-8cb9-502843f488b2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:14.622778 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-59ad9c7f-34f8-4726-8cb9-502843f488b2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:14.624309 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-59ad9c7f-34f8-4726-8cb9-502843f488b2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:14.626119 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-59ad9c7f-34f8-4726-8cb9-502843f488b2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1739 microversion: 2.20 time: 0.325460 Apr 08 11:51:14.626718 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1806/2742] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:14 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1739 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:51:15.644693 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f52a3bc6-3860-47dc-8f59-40a65fc403c7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:15.645286 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f52a3bc6-3860-47dc-8f59-40a65fc403c7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:15.651742 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f52a3bc6-3860-47dc-8f59-40a65fc403c7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:15.652196 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f52a3bc6-3860-47dc-8f59-40a65fc403c7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:15.652976 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f52a3bc6-3860-47dc-8f59-40a65fc403c7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:15.653417 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f52a3bc6-3860-47dc-8f59-40a65fc403c7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:15.792580 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f52a3bc6-3860-47dc-8f59-40a65fc403c7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:15.801133 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f52a3bc6-3860-47dc-8f59-40a65fc403c7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:15.802684 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f52a3bc6-3860-47dc-8f59-40a65fc403c7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:15.803894 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f52a3bc6-3860-47dc-8f59-40a65fc403c7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1721 microversion: 2.20 time: 0.163466 Apr 08 11:51:15.804476 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1807/2743] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:15 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:51:16.826891 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-dc74f187-e6bd-43bb-b58a-ba65900fde88 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:16.827585 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-dc74f187-e6bd-43bb-b58a-ba65900fde88 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:16.834005 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dc74f187-e6bd-43bb-b58a-ba65900fde88 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:16.834460 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dc74f187-e6bd-43bb-b58a-ba65900fde88 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:16.835258 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dc74f187-e6bd-43bb-b58a-ba65900fde88 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:16.835700 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dc74f187-e6bd-43bb-b58a-ba65900fde88 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:16.966499 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-dc74f187-e6bd-43bb-b58a-ba65900fde88 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:16.974848 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-dc74f187-e6bd-43bb-b58a-ba65900fde88 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:16.976370 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-dc74f187-e6bd-43bb-b58a-ba65900fde88 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:16.977525 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-dc74f187-e6bd-43bb-b58a-ba65900fde88 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1721 microversion: 2.20 time: 0.154510 Apr 08 11:51:16.978137 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1808/2744] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:16 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:51:17.995759 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-36962ca7-f839-48d9-9215-05dff250f2a3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:17.996448 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-36962ca7-f839-48d9-9215-05dff250f2a3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:18.003538 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-36962ca7-f839-48d9-9215-05dff250f2a3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:18.003996 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-36962ca7-f839-48d9-9215-05dff250f2a3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:18.004766 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-36962ca7-f839-48d9-9215-05dff250f2a3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:18.005211 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-36962ca7-f839-48d9-9215-05dff250f2a3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:18.140742 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-36962ca7-f839-48d9-9215-05dff250f2a3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:18.148466 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-36962ca7-f839-48d9-9215-05dff250f2a3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:18.149981 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-36962ca7-f839-48d9-9215-05dff250f2a3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:18.151134 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-36962ca7-f839-48d9-9215-05dff250f2a3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1721 microversion: 2.20 time: 0.159325 Apr 08 11:51:18.151681 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1809/2745] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:17 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:51:19.170069 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e3142557-9086-4923-9e3c-6544f62d6c33 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:19.170738 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e3142557-9086-4923-9e3c-6544f62d6c33 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:19.177469 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e3142557-9086-4923-9e3c-6544f62d6c33 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:19.177961 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e3142557-9086-4923-9e3c-6544f62d6c33 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:19.178722 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e3142557-9086-4923-9e3c-6544f62d6c33 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:19.179155 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e3142557-9086-4923-9e3c-6544f62d6c33 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:19.333748 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e3142557-9086-4923-9e3c-6544f62d6c33 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:19.341832 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e3142557-9086-4923-9e3c-6544f62d6c33 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:19.346050 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e3142557-9086-4923-9e3c-6544f62d6c33 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:19.346050 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e3142557-9086-4923-9e3c-6544f62d6c33 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1721 microversion: 2.20 time: 0.178890 Apr 08 11:51:19.346050 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1810/2746] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:19 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:51:20.363696 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-02662a82-24c5-46db-a367-2c791d825603 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:20.364388 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-02662a82-24c5-46db-a367-2c791d825603 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:20.370570 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-02662a82-24c5-46db-a367-2c791d825603 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:20.371031 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-02662a82-24c5-46db-a367-2c791d825603 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:20.371809 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-02662a82-24c5-46db-a367-2c791d825603 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:20.372249 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-02662a82-24c5-46db-a367-2c791d825603 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:20.508622 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-02662a82-24c5-46db-a367-2c791d825603 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:20.516984 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-02662a82-24c5-46db-a367-2c791d825603 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:20.518539 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-02662a82-24c5-46db-a367-2c791d825603 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:20.519704 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-02662a82-24c5-46db-a367-2c791d825603 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1724 microversion: 2.20 time: 0.160569 Apr 08 11:51:20.520272 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1811/2747] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:20 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:51:20.537595 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-084a1510-2cdf-4884-bc72-70abcd606d83 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3bfb4a27-95f3-4b96-a37c-41a5da8d6f78"}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:51:20.538729 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-084a1510-2cdf-4884-bc72-70abcd606d83 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:20.544880 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-084a1510-2cdf-4884-bc72-70abcd606d83 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:20.545331 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-084a1510-2cdf-4884-bc72-70abcd606d83 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:20.546137 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-084a1510-2cdf-4884-bc72-70abcd606d83 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:20.546575 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-084a1510-2cdf-4884-bc72-70abcd606d83 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:21.622799 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-084a1510-2cdf-4884-bc72-70abcd606d83 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "POST /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.089159 Apr 08 11:51:21.623454 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1812/2748] 10.222.0.46 () {62 vars in 1363 bytes} [Fri Apr 8 11:51:20 2022] POST /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76/os-volume_attachments => generated 188 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 08 11:51:21.628699 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-2aaab40a-35d2-4214-a1d9-c2fbedf22103 req-cac5bbd0-2e64-4c1f-9499-8a153ab5133e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1da27a98-0639-4251-ae77-64f51d7f8f76", "name": "network-vif-unplugged", "status": "completed", "tag": "d23a90b6-9e66-48bf-9f26-cdd76a4924a4"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:51:21.643510 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-2aaab40a-35d2-4214-a1d9-c2fbedf22103 req-cac5bbd0-2e64-4c1f-9499-8a153ab5133e service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:21.643510 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-2aaab40a-35d2-4214-a1d9-c2fbedf22103 req-cac5bbd0-2e64-4c1f-9499-8a153ab5133e service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:21.660865 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-2aaab40a-35d2-4214-a1d9-c2fbedf22103 req-cac5bbd0-2e64-4c1f-9499-8a153ab5133e service nova] Creating event network-vif-unplugged:d23a90b6-9e66-48bf-9f26-cdd76a4924a4 for instance 1da27a98-0639-4251-ae77-64f51d7f8f76 on hv-cinder-83607 Apr 08 11:51:21.660865 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-2aaab40a-35d2-4214-a1d9-c2fbedf22103 req-cac5bbd0-2e64-4c1f-9499-8a153ab5133e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035536 Apr 08 11:51:21.661448 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1813/2749] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:51:21.748216 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2436fa88-033a-4459-af9a-39568fffbf2e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:21.749048 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2436fa88-033a-4459-af9a-39568fffbf2e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:21.755906 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2436fa88-033a-4459-af9a-39568fffbf2e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:21.756349 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2436fa88-033a-4459-af9a-39568fffbf2e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:21.757118 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2436fa88-033a-4459-af9a-39568fffbf2e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:21.757546 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2436fa88-033a-4459-af9a-39568fffbf2e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:22.353955 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2436fa88-033a-4459-af9a-39568fffbf2e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76/os-volume_attachments/3bfb4a27-95f3-4b96-a37c-41a5da8d6f78" status: 202 len: 0 microversion: 2.20 time: 0.609817 Apr 08 11:51:22.354480 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1814/2750] 10.222.0.46 () {60 vars in 1456 bytes} [Fri Apr 8 11:51:21 2022] DELETE /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76/os-volume_attachments/3bfb4a27-95f3-4b96-a37c-41a5da8d6f78 => generated 0 bytes in 611 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 08 11:51:22.411405 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5cf5cef9-a655-47a3-be2c-592ecaf49d4b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:51:22.411969 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5cf5cef9-a655-47a3-be2c-592ecaf49d4b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:22.418169 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5cf5cef9-a655-47a3-be2c-592ecaf49d4b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:22.418725 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5cf5cef9-a655-47a3-be2c-592ecaf49d4b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:22.419369 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5cf5cef9-a655-47a3-be2c-592ecaf49d4b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:22.419800 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5cf5cef9-a655-47a3-be2c-592ecaf49d4b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:22.671142 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5cf5cef9-a655-47a3-be2c-592ecaf49d4b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "POST /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76/action" status: 202 len: 0 microversion: 2.20 time: 0.263953 Apr 08 11:51:22.672549 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1815/2751] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Apr 8 11:51:22 2022] POST /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 08 11:51:22.681497 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5377c9af-1521-4ba0-baaa-0d476ead8b40 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:22.682712 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5377c9af-1521-4ba0-baaa-0d476ead8b40 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:22.688224 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5377c9af-1521-4ba0-baaa-0d476ead8b40 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:22.688692 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5377c9af-1521-4ba0-baaa-0d476ead8b40 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:22.689689 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5377c9af-1521-4ba0-baaa-0d476ead8b40 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:22.690232 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5377c9af-1521-4ba0-baaa-0d476ead8b40 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:22.835621 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5377c9af-1521-4ba0-baaa-0d476ead8b40 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:22.844450 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5377c9af-1521-4ba0-baaa-0d476ead8b40 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:22.847412 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5377c9af-1521-4ba0-baaa-0d476ead8b40 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:22.848878 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5377c9af-1521-4ba0-baaa-0d476ead8b40 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1732 microversion: 2.20 time: 0.171912 Apr 08 11:51:22.849866 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1816/2752] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:22 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:51:23.868259 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a9f56bc4-d3de-4cc3-9d91-e7425c53afd7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:23.870666 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a9f56bc4-d3de-4cc3-9d91-e7425c53afd7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:23.875227 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a9f56bc4-d3de-4cc3-9d91-e7425c53afd7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:23.875767 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a9f56bc4-d3de-4cc3-9d91-e7425c53afd7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:23.877313 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a9f56bc4-d3de-4cc3-9d91-e7425c53afd7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:23.877792 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a9f56bc4-d3de-4cc3-9d91-e7425c53afd7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:24.018711 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a9f56bc4-d3de-4cc3-9d91-e7425c53afd7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:24.026530 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a9f56bc4-d3de-4cc3-9d91-e7425c53afd7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:24.028026 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a9f56bc4-d3de-4cc3-9d91-e7425c53afd7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:24.029176 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a9f56bc4-d3de-4cc3-9d91-e7425c53afd7 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1672 microversion: 2.20 time: 0.164803 Apr 08 11:51:24.029734 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1817/2753] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:23 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1672 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:51:25.048300 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-fd52b34a-c05a-4d06-bbe4-7f501ae93c74 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:25.049114 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-fd52b34a-c05a-4d06-bbe4-7f501ae93c74 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:25.056708 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fd52b34a-c05a-4d06-bbe4-7f501ae93c74 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:25.057178 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fd52b34a-c05a-4d06-bbe4-7f501ae93c74 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:25.057963 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fd52b34a-c05a-4d06-bbe4-7f501ae93c74 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:25.058530 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fd52b34a-c05a-4d06-bbe4-7f501ae93c74 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:25.201671 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-fd52b34a-c05a-4d06-bbe4-7f501ae93c74 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:25.211045 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-fd52b34a-c05a-4d06-bbe4-7f501ae93c74 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:25.212725 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-fd52b34a-c05a-4d06-bbe4-7f501ae93c74 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:25.213938 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-fd52b34a-c05a-4d06-bbe4-7f501ae93c74 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1730 microversion: 2.20 time: 0.169561 Apr 08 11:51:25.214508 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1818/2754] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:25 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:51:26.241570 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1141665a-a145-4ad5-9960-bf56067ff62b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:26.242428 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1141665a-a145-4ad5-9960-bf56067ff62b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:26.249129 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1141665a-a145-4ad5-9960-bf56067ff62b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:26.249608 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1141665a-a145-4ad5-9960-bf56067ff62b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:26.250419 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1141665a-a145-4ad5-9960-bf56067ff62b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:26.251001 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1141665a-a145-4ad5-9960-bf56067ff62b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:26.389971 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1141665a-a145-4ad5-9960-bf56067ff62b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:26.398031 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1141665a-a145-4ad5-9960-bf56067ff62b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:26.399537 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1141665a-a145-4ad5-9960-bf56067ff62b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:26.400763 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1141665a-a145-4ad5-9960-bf56067ff62b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1730 microversion: 2.20 time: 0.164293 Apr 08 11:51:26.401319 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1819/2755] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:26 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:51:27.420135 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3e303464-9195-4bab-8ccc-89d621b53dd6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:27.420848 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3e303464-9195-4bab-8ccc-89d621b53dd6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:27.428018 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3e303464-9195-4bab-8ccc-89d621b53dd6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:27.428478 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3e303464-9195-4bab-8ccc-89d621b53dd6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:27.429264 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3e303464-9195-4bab-8ccc-89d621b53dd6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:27.429708 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3e303464-9195-4bab-8ccc-89d621b53dd6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:27.564752 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3e303464-9195-4bab-8ccc-89d621b53dd6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:27.573281 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3e303464-9195-4bab-8ccc-89d621b53dd6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:27.574881 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3e303464-9195-4bab-8ccc-89d621b53dd6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:27.576029 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3e303464-9195-4bab-8ccc-89d621b53dd6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1730 microversion: 2.20 time: 0.159841 Apr 08 11:51:27.576665 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1820/2756] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:27 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:51:28.594387 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d19cc538-3633-44c5-a851-f995c13eb4e8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:28.595069 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d19cc538-3633-44c5-a851-f995c13eb4e8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:28.601506 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d19cc538-3633-44c5-a851-f995c13eb4e8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:28.602004 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d19cc538-3633-44c5-a851-f995c13eb4e8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:28.602781 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d19cc538-3633-44c5-a851-f995c13eb4e8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:28.603226 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d19cc538-3633-44c5-a851-f995c13eb4e8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:28.740875 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d19cc538-3633-44c5-a851-f995c13eb4e8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:28.748811 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d19cc538-3633-44c5-a851-f995c13eb4e8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:28.750356 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d19cc538-3633-44c5-a851-f995c13eb4e8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:28.751543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d19cc538-3633-44c5-a851-f995c13eb4e8 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1730 microversion: 2.20 time: 0.161181 Apr 08 11:51:28.752117 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1821/2757] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:28 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:51:29.769551 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8b82dc6d-f33d-4e0c-9570-50c4a23e62b4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:29.770278 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8b82dc6d-f33d-4e0c-9570-50c4a23e62b4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:29.776776 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8b82dc6d-f33d-4e0c-9570-50c4a23e62b4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:29.779248 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8b82dc6d-f33d-4e0c-9570-50c4a23e62b4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:29.779248 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8b82dc6d-f33d-4e0c-9570-50c4a23e62b4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:29.779248 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8b82dc6d-f33d-4e0c-9570-50c4a23e62b4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:29.918833 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8b82dc6d-f33d-4e0c-9570-50c4a23e62b4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:29.931407 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8b82dc6d-f33d-4e0c-9570-50c4a23e62b4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:29.933955 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8b82dc6d-f33d-4e0c-9570-50c4a23e62b4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:29.935156 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8b82dc6d-f33d-4e0c-9570-50c4a23e62b4 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1730 microversion: 2.20 time: 0.169544 Apr 08 11:51:29.935886 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1822/2758] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:29 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:51:30.956202 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-83d7a538-1059-4f5b-b43b-36a5a44360c1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:30.957529 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-83d7a538-1059-4f5b-b43b-36a5a44360c1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:30.964348 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-83d7a538-1059-4f5b-b43b-36a5a44360c1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:30.964869 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-83d7a538-1059-4f5b-b43b-36a5a44360c1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:30.967953 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-83d7a538-1059-4f5b-b43b-36a5a44360c1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:30.967953 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-83d7a538-1059-4f5b-b43b-36a5a44360c1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:31.135964 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-83d7a538-1059-4f5b-b43b-36a5a44360c1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:31.145309 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-83d7a538-1059-4f5b-b43b-36a5a44360c1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:31.147203 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-83d7a538-1059-4f5b-b43b-36a5a44360c1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:31.148629 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-83d7a538-1059-4f5b-b43b-36a5a44360c1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1730 microversion: 2.20 time: 0.196577 Apr 08 11:51:31.149688 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1823/2759] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:30 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1730 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:51:32.168708 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b32dfa91-85d6-4088-a354-291c5bcc29cd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:32.170354 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b32dfa91-85d6-4088-a354-291c5bcc29cd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:32.177113 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b32dfa91-85d6-4088-a354-291c5bcc29cd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:32.177835 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b32dfa91-85d6-4088-a354-291c5bcc29cd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:32.178624 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b32dfa91-85d6-4088-a354-291c5bcc29cd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:32.179065 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b32dfa91-85d6-4088-a354-291c5bcc29cd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:32.323708 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b32dfa91-85d6-4088-a354-291c5bcc29cd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:32.332341 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b32dfa91-85d6-4088-a354-291c5bcc29cd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:32.333910 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b32dfa91-85d6-4088-a354-291c5bcc29cd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:32.335137 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b32dfa91-85d6-4088-a354-291c5bcc29cd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1730 microversion: 2.20 time: 0.170480 Apr 08 11:51:32.335713 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1824/2760] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:32 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:51:33.360870 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5e678206-7545-425e-944a-514436a94a90 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:33.361656 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5e678206-7545-425e-944a-514436a94a90 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:33.368069 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5e678206-7545-425e-944a-514436a94a90 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:33.368529 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5e678206-7545-425e-944a-514436a94a90 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:33.369309 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5e678206-7545-425e-944a-514436a94a90 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:33.369750 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5e678206-7545-425e-944a-514436a94a90 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:33.520858 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5e678206-7545-425e-944a-514436a94a90 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:33.528630 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5e678206-7545-425e-944a-514436a94a90 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:33.530166 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5e678206-7545-425e-944a-514436a94a90 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:33.531315 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5e678206-7545-425e-944a-514436a94a90 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1730 microversion: 2.20 time: 0.174734 Apr 08 11:51:33.531875 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1825/2761] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:33 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:51:34.551905 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-550c4a49-7d0e-45a1-9517-cfaeee01bcb1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:34.552693 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-550c4a49-7d0e-45a1-9517-cfaeee01bcb1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:34.559641 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-550c4a49-7d0e-45a1-9517-cfaeee01bcb1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:34.560106 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-550c4a49-7d0e-45a1-9517-cfaeee01bcb1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:34.560881 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-550c4a49-7d0e-45a1-9517-cfaeee01bcb1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:34.561317 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-550c4a49-7d0e-45a1-9517-cfaeee01bcb1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:34.761425 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-550c4a49-7d0e-45a1-9517-cfaeee01bcb1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:34.770803 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-550c4a49-7d0e-45a1-9517-cfaeee01bcb1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:34.772782 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-550c4a49-7d0e-45a1-9517-cfaeee01bcb1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:34.774336 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-550c4a49-7d0e-45a1-9517-cfaeee01bcb1 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1730 microversion: 2.20 time: 0.227654 Apr 08 11:51:34.774961 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1826/2762] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:34 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1730 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:51:35.794210 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-41cbed25-5e2a-4860-9993-4066d92f03a6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:35.799579 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-41cbed25-5e2a-4860-9993-4066d92f03a6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:35.804239 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-41cbed25-5e2a-4860-9993-4066d92f03a6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:35.804700 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-41cbed25-5e2a-4860-9993-4066d92f03a6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:35.805489 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-41cbed25-5e2a-4860-9993-4066d92f03a6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:35.806039 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-41cbed25-5e2a-4860-9993-4066d92f03a6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:35.942074 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-41cbed25-5e2a-4860-9993-4066d92f03a6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:35.949868 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-41cbed25-5e2a-4860-9993-4066d92f03a6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:35.951365 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-41cbed25-5e2a-4860-9993-4066d92f03a6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:35.952519 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-41cbed25-5e2a-4860-9993-4066d92f03a6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1730 microversion: 2.20 time: 0.162744 Apr 08 11:51:35.953082 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1827/2763] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:35 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:51:36.972339 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7e75a2d9-5937-4289-aba8-d4b5f57cc88a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:36.973018 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7e75a2d9-5937-4289-aba8-d4b5f57cc88a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:36.979233 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7e75a2d9-5937-4289-aba8-d4b5f57cc88a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:36.979675 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7e75a2d9-5937-4289-aba8-d4b5f57cc88a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:36.980436 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7e75a2d9-5937-4289-aba8-d4b5f57cc88a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:36.980870 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7e75a2d9-5937-4289-aba8-d4b5f57cc88a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:37.117551 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7e75a2d9-5937-4289-aba8-d4b5f57cc88a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:37.125379 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7e75a2d9-5937-4289-aba8-d4b5f57cc88a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:37.126966 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7e75a2d9-5937-4289-aba8-d4b5f57cc88a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:37.134129 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7e75a2d9-5937-4289-aba8-d4b5f57cc88a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1730 microversion: 2.20 time: 0.159668 Apr 08 11:51:37.134129 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1828/2764] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:36 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:51:38.147572 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-34c21289-1f38-4b2d-a191-a3be60a526bd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:38.148273 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-34c21289-1f38-4b2d-a191-a3be60a526bd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:38.154333 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-34c21289-1f38-4b2d-a191-a3be60a526bd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:38.154785 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-34c21289-1f38-4b2d-a191-a3be60a526bd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:38.155554 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-34c21289-1f38-4b2d-a191-a3be60a526bd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:38.155988 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-34c21289-1f38-4b2d-a191-a3be60a526bd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:38.296863 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-34c21289-1f38-4b2d-a191-a3be60a526bd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:38.305044 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-34c21289-1f38-4b2d-a191-a3be60a526bd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:38.306665 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-34c21289-1f38-4b2d-a191-a3be60a526bd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:38.307857 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-34c21289-1f38-4b2d-a191-a3be60a526bd tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1730 microversion: 2.20 time: 0.164781 Apr 08 11:51:38.308395 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1829/2765] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:38 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:51:39.327072 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-fa825c5c-82a9-40f4-a9ef-622112b8a722 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:39.327815 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-fa825c5c-82a9-40f4-a9ef-622112b8a722 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:39.335285 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fa825c5c-82a9-40f4-a9ef-622112b8a722 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:39.335896 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fa825c5c-82a9-40f4-a9ef-622112b8a722 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:39.336960 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fa825c5c-82a9-40f4-a9ef-622112b8a722 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:39.337506 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-fa825c5c-82a9-40f4-a9ef-622112b8a722 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:39.660918 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-fa825c5c-82a9-40f4-a9ef-622112b8a722 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:39.669066 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-fa825c5c-82a9-40f4-a9ef-622112b8a722 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:39.670629 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-fa825c5c-82a9-40f4-a9ef-622112b8a722 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:39.671854 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-fa825c5c-82a9-40f4-a9ef-622112b8a722 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1730 microversion: 2.20 time: 0.348963 Apr 08 11:51:39.672366 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1830/2766] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:39 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1730 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:51:40.693128 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-826a83d2-d9b3-4b4d-b04e-81165949d34c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:40.694120 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-826a83d2-d9b3-4b4d-b04e-81165949d34c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:40.711804 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-826a83d2-d9b3-4b4d-b04e-81165949d34c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:40.712260 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-826a83d2-d9b3-4b4d-b04e-81165949d34c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:40.713050 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-826a83d2-d9b3-4b4d-b04e-81165949d34c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:40.713692 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-826a83d2-d9b3-4b4d-b04e-81165949d34c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:40.895471 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-826a83d2-d9b3-4b4d-b04e-81165949d34c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:40.904203 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-826a83d2-d9b3-4b4d-b04e-81165949d34c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:40.905863 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-826a83d2-d9b3-4b4d-b04e-81165949d34c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:40.907453 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-826a83d2-d9b3-4b4d-b04e-81165949d34c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1730 microversion: 2.20 time: 0.218897 Apr 08 11:51:40.921548 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1831/2767] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:40 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1730 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:51:41.929789 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-00d30f03-4d8f-4b4b-81cd-e778ddfd7147 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:41.930437 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-00d30f03-4d8f-4b4b-81cd-e778ddfd7147 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:41.936836 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-00d30f03-4d8f-4b4b-81cd-e778ddfd7147 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:41.937291 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-00d30f03-4d8f-4b4b-81cd-e778ddfd7147 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:41.938094 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-00d30f03-4d8f-4b4b-81cd-e778ddfd7147 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:41.938537 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-00d30f03-4d8f-4b4b-81cd-e778ddfd7147 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:42.082760 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-00d30f03-4d8f-4b4b-81cd-e778ddfd7147 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:42.091195 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-00d30f03-4d8f-4b4b-81cd-e778ddfd7147 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:42.092731 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-00d30f03-4d8f-4b4b-81cd-e778ddfd7147 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:42.093960 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-00d30f03-4d8f-4b4b-81cd-e778ddfd7147 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1730 microversion: 2.20 time: 0.168803 Apr 08 11:51:42.094513 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1832/2768] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:41 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:51:43.118723 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7de1f965-a710-4bca-843a-4c43bb2f0b02 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:43.119407 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7de1f965-a710-4bca-843a-4c43bb2f0b02 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:43.126585 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7de1f965-a710-4bca-843a-4c43bb2f0b02 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:43.127387 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7de1f965-a710-4bca-843a-4c43bb2f0b02 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:43.128712 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7de1f965-a710-4bca-843a-4c43bb2f0b02 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:43.130028 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7de1f965-a710-4bca-843a-4c43bb2f0b02 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:43.303155 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7de1f965-a710-4bca-843a-4c43bb2f0b02 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:43.303155 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7de1f965-a710-4bca-843a-4c43bb2f0b02 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:43.303458 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7de1f965-a710-4bca-843a-4c43bb2f0b02 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:43.303458 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7de1f965-a710-4bca-843a-4c43bb2f0b02 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1730 microversion: 2.20 time: 0.189581 Apr 08 11:51:43.303458 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1833/2769] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:43 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1730 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:51:44.323293 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-673a7ca1-f50d-4d7e-afe2-06620114b87b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:44.323978 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-673a7ca1-f50d-4d7e-afe2-06620114b87b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:44.330894 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-673a7ca1-f50d-4d7e-afe2-06620114b87b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:44.331679 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-673a7ca1-f50d-4d7e-afe2-06620114b87b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:44.332513 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-673a7ca1-f50d-4d7e-afe2-06620114b87b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:44.332980 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-673a7ca1-f50d-4d7e-afe2-06620114b87b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:44.508314 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-673a7ca1-f50d-4d7e-afe2-06620114b87b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:44.517291 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-673a7ca1-f50d-4d7e-afe2-06620114b87b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:44.518962 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-673a7ca1-f50d-4d7e-afe2-06620114b87b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:44.520250 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-673a7ca1-f50d-4d7e-afe2-06620114b87b tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1730 microversion: 2.20 time: 0.205054 Apr 08 11:51:44.520897 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1834/2770] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:44 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1730 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:51:45.538052 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0e047bab-bc2d-4c5d-be43-600219f1131f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:45.538684 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0e047bab-bc2d-4c5d-be43-600219f1131f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:45.544953 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0e047bab-bc2d-4c5d-be43-600219f1131f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:45.545405 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0e047bab-bc2d-4c5d-be43-600219f1131f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:45.546213 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0e047bab-bc2d-4c5d-be43-600219f1131f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:45.546699 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0e047bab-bc2d-4c5d-be43-600219f1131f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:45.687594 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0e047bab-bc2d-4c5d-be43-600219f1131f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:45.696997 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0e047bab-bc2d-4c5d-be43-600219f1131f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:45.701557 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0e047bab-bc2d-4c5d-be43-600219f1131f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:45.701557 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0e047bab-bc2d-4c5d-be43-600219f1131f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1730 microversion: 2.20 time: 0.165838 Apr 08 11:51:45.701557 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1835/2771] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:45 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:51:46.717749 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5b34fc8a-b5e0-48b2-8501-dc0303f172fe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:46.718636 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5b34fc8a-b5e0-48b2-8501-dc0303f172fe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:46.724671 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5b34fc8a-b5e0-48b2-8501-dc0303f172fe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:46.725126 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5b34fc8a-b5e0-48b2-8501-dc0303f172fe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:46.725929 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5b34fc8a-b5e0-48b2-8501-dc0303f172fe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:46.726443 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5b34fc8a-b5e0-48b2-8501-dc0303f172fe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:46.866485 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5b34fc8a-b5e0-48b2-8501-dc0303f172fe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:46.874487 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5b34fc8a-b5e0-48b2-8501-dc0303f172fe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:46.876134 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5b34fc8a-b5e0-48b2-8501-dc0303f172fe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:46.877335 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5b34fc8a-b5e0-48b2-8501-dc0303f172fe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1730 microversion: 2.20 time: 0.163402 Apr 08 11:51:46.877929 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1836/2772] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:46 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:51:47.758229 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-79ce6690-7382-4675-8732-e76b44e3d437 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:47.758914 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-79ce6690-7382-4675-8732-e76b44e3d437 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: dd2636af-65dc-485a-b874-173a3a203ee9] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:47.769629 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-79ce6690-7382-4675-8732-e76b44e3d437 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:47.769629 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-79ce6690-7382-4675-8732-e76b44e3d437 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:47.769629 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-79ce6690-7382-4675-8732-e76b44e3d437 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:47.769629 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-79ce6690-7382-4675-8732-e76b44e3d437 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:47.846689 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-79ce6690-7382-4675-8732-e76b44e3d437 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lazy-loading 'services' on Instance uuid dd2636af-65dc-485a-b874-173a3a203ee9 {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 11:51:48.147469 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-79ce6690-7382-4675-8732-e76b44e3d437 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "DELETE /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9/os-volume_attachments/2bfeb4e5-92ec-4952-b4ad-fdd79dc9cc66" status: 202 len: 0 microversion: 2.1 time: 0.388698 Apr 08 11:51:48.147469 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1837/2773] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Apr 8 11:51:47 2022] DELETE /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9/os-volume_attachments/2bfeb4e5-92ec-4952-b4ad-fdd79dc9cc66 => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 08 11:51:48.148904 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b0c791bf-05a1-4678-b871-3ce26c133397 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:48.149622 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b0c791bf-05a1-4678-b871-3ce26c133397 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:48.165458 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b0c791bf-05a1-4678-b871-3ce26c133397 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:48.165955 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b0c791bf-05a1-4678-b871-3ce26c133397 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:48.166750 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b0c791bf-05a1-4678-b871-3ce26c133397 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:48.167193 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b0c791bf-05a1-4678-b871-3ce26c133397 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:48.316388 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b0c791bf-05a1-4678-b871-3ce26c133397 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:48.329837 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b0c791bf-05a1-4678-b871-3ce26c133397 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:48.336856 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b0c791bf-05a1-4678-b871-3ce26c133397 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:48.336856 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b0c791bf-05a1-4678-b871-3ce26c133397 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1730 microversion: 2.20 time: 0.187678 Apr 08 11:51:48.336856 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1838/2774] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:48 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:51:49.354975 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b4a6e985-0e0b-4dba-91a2-6fd97f0161bc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:49.355649 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b4a6e985-0e0b-4dba-91a2-6fd97f0161bc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:49.362104 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b4a6e985-0e0b-4dba-91a2-6fd97f0161bc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:49.362561 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b4a6e985-0e0b-4dba-91a2-6fd97f0161bc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:49.363335 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b4a6e985-0e0b-4dba-91a2-6fd97f0161bc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:49.363789 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b4a6e985-0e0b-4dba-91a2-6fd97f0161bc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:49.507754 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b4a6e985-0e0b-4dba-91a2-6fd97f0161bc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:49.515712 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b4a6e985-0e0b-4dba-91a2-6fd97f0161bc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:49.523772 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b4a6e985-0e0b-4dba-91a2-6fd97f0161bc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:49.523772 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b4a6e985-0e0b-4dba-91a2-6fd97f0161bc tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1730 microversion: 2.20 time: 0.167367 Apr 08 11:51:49.523772 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1839/2775] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:49 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:51:50.537082 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2ebc7fc2-0aca-420f-ad43-9e0093d155db tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:50.537885 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2ebc7fc2-0aca-420f-ad43-9e0093d155db tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:50.544362 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2ebc7fc2-0aca-420f-ad43-9e0093d155db tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:50.544886 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2ebc7fc2-0aca-420f-ad43-9e0093d155db tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:50.545726 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2ebc7fc2-0aca-420f-ad43-9e0093d155db tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:50.546229 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2ebc7fc2-0aca-420f-ad43-9e0093d155db tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:50.689787 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2ebc7fc2-0aca-420f-ad43-9e0093d155db tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:50.697644 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2ebc7fc2-0aca-420f-ad43-9e0093d155db tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:50.699132 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2ebc7fc2-0aca-420f-ad43-9e0093d155db tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:50.700288 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2ebc7fc2-0aca-420f-ad43-9e0093d155db tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1730 microversion: 2.20 time: 0.167936 Apr 08 11:51:50.700854 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1840/2776] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:50 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:51:51.718434 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e949e880-5313-4a1f-9755-8e9538edd902 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:51.719152 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e949e880-5313-4a1f-9755-8e9538edd902 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:51.726033 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e949e880-5313-4a1f-9755-8e9538edd902 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:51.726542 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e949e880-5313-4a1f-9755-8e9538edd902 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:51.727364 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e949e880-5313-4a1f-9755-8e9538edd902 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:51.727808 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e949e880-5313-4a1f-9755-8e9538edd902 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:51.884191 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e949e880-5313-4a1f-9755-8e9538edd902 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:51.891998 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e949e880-5313-4a1f-9755-8e9538edd902 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:51.893522 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e949e880-5313-4a1f-9755-8e9538edd902 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:51.894710 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e949e880-5313-4a1f-9755-8e9538edd902 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1730 microversion: 2.20 time: 0.180287 Apr 08 11:51:51.895478 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1841/2777] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:51 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:51:52.447074 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-26e349a8-b5ef-4573-b5c6-c78a51f51743 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:52.447603 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-26e349a8-b5ef-4573-b5c6-c78a51f51743 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: dd2636af-65dc-485a-b874-173a3a203ee9] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:52.453589 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-26e349a8-b5ef-4573-b5c6-c78a51f51743 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:52.454080 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-26e349a8-b5ef-4573-b5c6-c78a51f51743 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:52.454847 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-26e349a8-b5ef-4573-b5c6-c78a51f51743 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:52.455377 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-26e349a8-b5ef-4573-b5c6-c78a51f51743 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:52.479149 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-26e349a8-b5ef-4573-b5c6-c78a51f51743 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: dd2636af-65dc-485a-b874-173a3a203ee9] Going to try to terminate instance {{(pid=117800) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 08 11:51:52.715062 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-26e349a8-b5ef-4573-b5c6-c78a51f51743 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "DELETE /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9" status: 204 len: 0 microversion: 2.1 time: 0.272048 Apr 08 11:51:52.715667 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1842/2778] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 8 11:51:52 2022] DELETE /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 08 11:51:52.724362 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ebb7efb6-e910-42b0-a30d-4c970cd2f409 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:52.725057 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ebb7efb6-e910-42b0-a30d-4c970cd2f409 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: dd2636af-65dc-485a-b874-173a3a203ee9] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:52.731485 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ebb7efb6-e910-42b0-a30d-4c970cd2f409 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:52.731935 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ebb7efb6-e910-42b0-a30d-4c970cd2f409 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:52.732704 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ebb7efb6-e910-42b0-a30d-4c970cd2f409 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:52.733137 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ebb7efb6-e910-42b0-a30d-4c970cd2f409 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:52.873074 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ebb7efb6-e910-42b0-a30d-4c970cd2f409 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:52.881492 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ebb7efb6-e910-42b0-a30d-4c970cd2f409 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9" status: 200 len: 1513 microversion: 2.1 time: 0.161067 Apr 08 11:51:52.882210 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1843/2779] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:51:52 2022] GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:51:52.912838 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-57d1d936-f704-4994-8dd2-50dbd7708ac6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:52.913391 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-57d1d936-f704-4994-8dd2-50dbd7708ac6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:52.919416 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-57d1d936-f704-4994-8dd2-50dbd7708ac6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:52.920930 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-57d1d936-f704-4994-8dd2-50dbd7708ac6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:52.920930 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-57d1d936-f704-4994-8dd2-50dbd7708ac6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:52.921289 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-57d1d936-f704-4994-8dd2-50dbd7708ac6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:53.068166 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-57d1d936-f704-4994-8dd2-50dbd7708ac6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:53.075808 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-57d1d936-f704-4994-8dd2-50dbd7708ac6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:53.081187 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-57d1d936-f704-4994-8dd2-50dbd7708ac6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:53.081187 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-57d1d936-f704-4994-8dd2-50dbd7708ac6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1730 microversion: 2.20 time: 0.170105 Apr 08 11:51:53.081187 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1844/2780] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:52 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:51:53.898192 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d012a5ad-2b2b-440f-9f49-59d0e0389af3 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:53.898827 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d012a5ad-2b2b-440f-9f49-59d0e0389af3 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: dd2636af-65dc-485a-b874-173a3a203ee9] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:53.905053 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d012a5ad-2b2b-440f-9f49-59d0e0389af3 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:53.905509 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d012a5ad-2b2b-440f-9f49-59d0e0389af3 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:53.906292 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d012a5ad-2b2b-440f-9f49-59d0e0389af3 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:53.906728 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d012a5ad-2b2b-440f-9f49-59d0e0389af3 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:54.044011 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d012a5ad-2b2b-440f-9f49-59d0e0389af3 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:54.051624 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d012a5ad-2b2b-440f-9f49-59d0e0389af3 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9" status: 200 len: 1513 microversion: 2.1 time: 0.157787 Apr 08 11:51:54.052238 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1845/2781] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:51:53 2022] GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:51:54.097863 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-304edb8c-2ea3-44e9-ac16-f1512e27aec5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:54.098529 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-304edb8c-2ea3-44e9-ac16-f1512e27aec5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:54.104470 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-304edb8c-2ea3-44e9-ac16-f1512e27aec5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:54.104925 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-304edb8c-2ea3-44e9-ac16-f1512e27aec5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:54.106728 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-304edb8c-2ea3-44e9-ac16-f1512e27aec5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:54.107499 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-304edb8c-2ea3-44e9-ac16-f1512e27aec5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:54.251977 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-304edb8c-2ea3-44e9-ac16-f1512e27aec5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:54.260707 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-304edb8c-2ea3-44e9-ac16-f1512e27aec5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:54.262238 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-304edb8c-2ea3-44e9-ac16-f1512e27aec5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:54.263406 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-304edb8c-2ea3-44e9-ac16-f1512e27aec5 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1730 microversion: 2.20 time: 0.169557 Apr 08 11:51:54.264026 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1846/2782] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:54 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:51:54.292619 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-111a829b-f209-40be-bafa-ceb76eb8445f req-8f8d990d-c5ae-4688-a95a-127fb4df620b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1da27a98-0639-4251-ae77-64f51d7f8f76", "name": "network-vif-plugged", "status": "completed", "tag": "d23a90b6-9e66-48bf-9f26-cdd76a4924a4"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:51:54.300687 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-111a829b-f209-40be-bafa-ceb76eb8445f req-8f8d990d-c5ae-4688-a95a-127fb4df620b service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:54.301129 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-111a829b-f209-40be-bafa-ceb76eb8445f req-8f8d990d-c5ae-4688-a95a-127fb4df620b service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:54.312388 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-111a829b-f209-40be-bafa-ceb76eb8445f req-8f8d990d-c5ae-4688-a95a-127fb4df620b service nova] Creating event network-vif-plugged:d23a90b6-9e66-48bf-9f26-cdd76a4924a4 for instance 1da27a98-0639-4251-ae77-64f51d7f8f76 on hv-cinder-83607 Apr 08 11:51:54.317131 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-111a829b-f209-40be-bafa-ceb76eb8445f req-8f8d990d-c5ae-4688-a95a-127fb4df620b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028165 Apr 08 11:51:54.317707 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1847/2783] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:51:55.069739 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-adb450c9-a5e2-4e40-a103-176674108613 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:55.070456 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-adb450c9-a5e2-4e40-a103-176674108613 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: dd2636af-65dc-485a-b874-173a3a203ee9] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:55.077405 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-adb450c9-a5e2-4e40-a103-176674108613 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:55.077916 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-adb450c9-a5e2-4e40-a103-176674108613 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:55.078808 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-adb450c9-a5e2-4e40-a103-176674108613 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:55.079512 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-adb450c9-a5e2-4e40-a103-176674108613 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:55.323627 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-adb450c9-a5e2-4e40-a103-176674108613 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:55.331585 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-adb450c9-a5e2-4e40-a103-176674108613 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9" status: 200 len: 1513 microversion: 2.1 time: 0.266758 Apr 08 11:51:55.332182 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1848/2784] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:51:55 2022] GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9 => generated 1513 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:51:55.337389 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bec30040-b690-48e6-ba30-510df197ecfe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:55.338032 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-bec30040-b690-48e6-ba30-510df197ecfe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:55.346509 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bec30040-b690-48e6-ba30-510df197ecfe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:55.347379 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bec30040-b690-48e6-ba30-510df197ecfe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:55.348817 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bec30040-b690-48e6-ba30-510df197ecfe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:55.349634 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bec30040-b690-48e6-ba30-510df197ecfe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:55.504113 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-bec30040-b690-48e6-ba30-510df197ecfe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:55.512170 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-bec30040-b690-48e6-ba30-510df197ecfe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:55.513675 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-bec30040-b690-48e6-ba30-510df197ecfe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:55.520777 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-bec30040-b690-48e6-ba30-510df197ecfe tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1730 microversion: 2.20 time: 0.181768 Apr 08 11:51:55.520777 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1849/2785] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:55 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:51:55.606203 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-55547731-3dfb-43bf-81bc-792227850782 req-f4f8a3c3-9b58-4bbe-8442-d356cb8e3702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd2636af-65dc-485a-b874-173a3a203ee9", "name": "network-vif-deleted", "tag": "0f9e1448-2d57-4d32-94ef-7a51d55f31f4"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:51:55.614420 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-55547731-3dfb-43bf-81bc-792227850782 req-f4f8a3c3-9b58-4bbe-8442-d356cb8e3702 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:55.614867 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-55547731-3dfb-43bf-81bc-792227850782 req-f4f8a3c3-9b58-4bbe-8442-d356cb8e3702 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:55.626287 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-55547731-3dfb-43bf-81bc-792227850782 req-f4f8a3c3-9b58-4bbe-8442-d356cb8e3702 service nova] Creating event network-vif-deleted:0f9e1448-2d57-4d32-94ef-7a51d55f31f4 for instance dd2636af-65dc-485a-b874-173a3a203ee9 on hv-cinder-83607 Apr 08 11:51:55.631428 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-55547731-3dfb-43bf-81bc-792227850782 req-f4f8a3c3-9b58-4bbe-8442-d356cb8e3702 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029680 Apr 08 11:51:55.632494 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1850/2786] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:51:56.350325 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0b39aa11-0a36-4ce6-9cb7-9885603ffb5f tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:56.351128 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0b39aa11-0a36-4ce6-9cb7-9885603ffb5f tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: dd2636af-65dc-485a-b874-173a3a203ee9] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:56.357139 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0b39aa11-0a36-4ce6-9cb7-9885603ffb5f tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:56.357584 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0b39aa11-0a36-4ce6-9cb7-9885603ffb5f tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:56.358420 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0b39aa11-0a36-4ce6-9cb7-9885603ffb5f tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:56.367316 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0b39aa11-0a36-4ce6-9cb7-9885603ffb5f tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:56.392195 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0b39aa11-0a36-4ce6-9cb7-9885603ffb5f tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:56.392640 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0b39aa11-0a36-4ce6-9cb7-9885603ffb5f tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:56.394676 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-0b39aa11-0a36-4ce6-9cb7-9885603ffb5f tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lazy-loading 'fault' on Instance uuid dd2636af-65dc-485a-b874-173a3a203ee9 {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 11:51:56.437123 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0b39aa11-0a36-4ce6-9cb7-9885603ffb5f tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:56.444996 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0b39aa11-0a36-4ce6-9cb7-9885603ffb5f tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9" status: 200 len: 1309 microversion: 2.1 time: 0.099069 Apr 08 11:51:56.445595 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1851/2787] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:51:56 2022] GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9 => generated 1309 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:51:56.533619 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d65f77bb-4724-4bee-8c7b-72f93f1ca381 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:56.534251 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d65f77bb-4724-4bee-8c7b-72f93f1ca381 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:56.540273 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d65f77bb-4724-4bee-8c7b-72f93f1ca381 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:56.540725 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d65f77bb-4724-4bee-8c7b-72f93f1ca381 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:56.541479 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d65f77bb-4724-4bee-8c7b-72f93f1ca381 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:56.541946 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d65f77bb-4724-4bee-8c7b-72f93f1ca381 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:56.689400 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d65f77bb-4724-4bee-8c7b-72f93f1ca381 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:56.698161 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d65f77bb-4724-4bee-8c7b-72f93f1ca381 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:56.699714 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d65f77bb-4724-4bee-8c7b-72f93f1ca381 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:56.700892 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d65f77bb-4724-4bee-8c7b-72f93f1ca381 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1730 microversion: 2.20 time: 0.171357 Apr 08 11:51:56.701452 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1852/2788] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:56 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:51:57.467074 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4efe9cf1-9ef3-4358-b52f-43e553444177 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:57.467772 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4efe9cf1-9ef3-4358-b52f-43e553444177 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: dd2636af-65dc-485a-b874-173a3a203ee9] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:57.473963 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4efe9cf1-9ef3-4358-b52f-43e553444177 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:57.474411 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4efe9cf1-9ef3-4358-b52f-43e553444177 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:57.475793 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4efe9cf1-9ef3-4358-b52f-43e553444177 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:57.476225 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4efe9cf1-9ef3-4358-b52f-43e553444177 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:57.506335 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4efe9cf1-9ef3-4358-b52f-43e553444177 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:57.506864 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4efe9cf1-9ef3-4358-b52f-43e553444177 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:57.507228 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-4efe9cf1-9ef3-4358-b52f-43e553444177 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lazy-loading 'fault' on Instance uuid dd2636af-65dc-485a-b874-173a3a203ee9 {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 11:51:57.547647 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4efe9cf1-9ef3-4358-b52f-43e553444177 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:57.554919 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4efe9cf1-9ef3-4358-b52f-43e553444177 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9" status: 200 len: 1309 microversion: 2.1 time: 0.091714 Apr 08 11:51:57.555483 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1853/2789] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:51:57 2022] GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9 => generated 1309 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:51:57.719087 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5a4fff73-879f-4784-a488-a9eabd5e424a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:57.719702 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5a4fff73-879f-4784-a488-a9eabd5e424a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:57.725422 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5a4fff73-879f-4784-a488-a9eabd5e424a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:57.725909 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5a4fff73-879f-4784-a488-a9eabd5e424a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:57.726668 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5a4fff73-879f-4784-a488-a9eabd5e424a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:57.727107 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5a4fff73-879f-4784-a488-a9eabd5e424a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:57.869426 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5a4fff73-879f-4784-a488-a9eabd5e424a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:57.877452 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5a4fff73-879f-4784-a488-a9eabd5e424a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:57.879032 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-5a4fff73-879f-4784-a488-a9eabd5e424a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:57.880186 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5a4fff73-879f-4784-a488-a9eabd5e424a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1730 microversion: 2.20 time: 0.165001 Apr 08 11:51:57.880755 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1854/2790] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:57 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:51:58.571398 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e86ce290-447a-4150-af98-521cc8c2953b tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:58.572087 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e86ce290-447a-4150-af98-521cc8c2953b tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: dd2636af-65dc-485a-b874-173a3a203ee9] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:58.578701 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e86ce290-447a-4150-af98-521cc8c2953b tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:58.579156 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e86ce290-447a-4150-af98-521cc8c2953b tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:58.579923 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e86ce290-447a-4150-af98-521cc8c2953b tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:58.580364 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e86ce290-447a-4150-af98-521cc8c2953b tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:58.609902 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e86ce290-447a-4150-af98-521cc8c2953b tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:58.610355 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e86ce290-447a-4150-af98-521cc8c2953b tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:58.610804 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-e86ce290-447a-4150-af98-521cc8c2953b tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lazy-loading 'fault' on Instance uuid dd2636af-65dc-485a-b874-173a3a203ee9 {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 11:51:58.652634 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e86ce290-447a-4150-af98-521cc8c2953b tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:58.661232 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e86ce290-447a-4150-af98-521cc8c2953b tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9" status: 200 len: 1309 microversion: 2.1 time: 0.093240 Apr 08 11:51:58.662047 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1855/2791] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:51:58 2022] GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9 => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:51:58.898921 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0edef501-0fc5-4a24-99df-84566ecf1318 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:58.899497 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0edef501-0fc5-4a24-99df-84566ecf1318 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:58.905376 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0edef501-0fc5-4a24-99df-84566ecf1318 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:58.905864 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0edef501-0fc5-4a24-99df-84566ecf1318 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:58.906638 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0edef501-0fc5-4a24-99df-84566ecf1318 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:58.907079 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0edef501-0fc5-4a24-99df-84566ecf1318 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:59.039128 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0edef501-0fc5-4a24-99df-84566ecf1318 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:59.046883 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0edef501-0fc5-4a24-99df-84566ecf1318 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:59.048375 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-0edef501-0fc5-4a24-99df-84566ecf1318 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:59.049526 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0edef501-0fc5-4a24-99df-84566ecf1318 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1730 microversion: 2.20 time: 0.155102 Apr 08 11:51:59.050120 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1856/2792] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:51:58 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:51:59.680713 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9b50b455-b7da-4ec5-96f8-54bb5a1f0408 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:51:59.681371 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9b50b455-b7da-4ec5-96f8-54bb5a1f0408 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: dd2636af-65dc-485a-b874-173a3a203ee9] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:51:59.688126 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9b50b455-b7da-4ec5-96f8-54bb5a1f0408 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:59.688585 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9b50b455-b7da-4ec5-96f8-54bb5a1f0408 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:59.689369 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9b50b455-b7da-4ec5-96f8-54bb5a1f0408 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:59.689845 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9b50b455-b7da-4ec5-96f8-54bb5a1f0408 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:59.721519 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9b50b455-b7da-4ec5-96f8-54bb5a1f0408 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:51:59.722018 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9b50b455-b7da-4ec5-96f8-54bb5a1f0408 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:51:59.722479 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-9b50b455-b7da-4ec5-96f8-54bb5a1f0408 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lazy-loading 'fault' on Instance uuid dd2636af-65dc-485a-b874-173a3a203ee9 {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 11:51:59.764088 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9b50b455-b7da-4ec5-96f8-54bb5a1f0408 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:51:59.771372 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9b50b455-b7da-4ec5-96f8-54bb5a1f0408 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9" status: 200 len: 1309 microversion: 2.1 time: 0.096674 Apr 08 11:51:59.775817 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1857/2793] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:51:59 2022] GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9 => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:52:00.067748 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a25a26b0-96c6-4674-b567-3abe84f9bba3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:52:00.068356 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a25a26b0-96c6-4674-b567-3abe84f9bba3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:52:00.074406 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a25a26b0-96c6-4674-b567-3abe84f9bba3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:52:00.074853 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a25a26b0-96c6-4674-b567-3abe84f9bba3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:52:00.075626 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a25a26b0-96c6-4674-b567-3abe84f9bba3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:52:00.076060 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a25a26b0-96c6-4674-b567-3abe84f9bba3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:52:00.208801 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a25a26b0-96c6-4674-b567-3abe84f9bba3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:52:00.216542 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a25a26b0-96c6-4674-b567-3abe84f9bba3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:52:00.218077 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a25a26b0-96c6-4674-b567-3abe84f9bba3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:52:00.219229 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a25a26b0-96c6-4674-b567-3abe84f9bba3 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1730 microversion: 2.20 time: 0.155480 Apr 08 11:52:00.219785 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1858/2794] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:52:00 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:52:00.790686 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7b31108d-c98e-4dd3-ac37-01be3b0d47fe tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:52:00.791363 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7b31108d-c98e-4dd3-ac37-01be3b0d47fe tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: dd2636af-65dc-485a-b874-173a3a203ee9] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:52:00.797627 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7b31108d-c98e-4dd3-ac37-01be3b0d47fe tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:52:00.798192 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7b31108d-c98e-4dd3-ac37-01be3b0d47fe tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:52:00.799013 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7b31108d-c98e-4dd3-ac37-01be3b0d47fe tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:52:00.799458 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7b31108d-c98e-4dd3-ac37-01be3b0d47fe tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:52:00.831247 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7b31108d-c98e-4dd3-ac37-01be3b0d47fe tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:52:00.831702 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7b31108d-c98e-4dd3-ac37-01be3b0d47fe tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:52:00.832161 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-7b31108d-c98e-4dd3-ac37-01be3b0d47fe tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lazy-loading 'fault' on Instance uuid dd2636af-65dc-485a-b874-173a3a203ee9 {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 11:52:00.870864 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7b31108d-c98e-4dd3-ac37-01be3b0d47fe tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0283a594e452414d93a92a27f5cd934b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b717a37fc74e40b1be8f3e43bca2d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:52:00.878051 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7b31108d-c98e-4dd3-ac37-01be3b0d47fe tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9" status: 200 len: 1309 microversion: 2.1 time: 0.091201 Apr 08 11:52:00.878625 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1859/2795] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:52:00 2022] GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9 => generated 1309 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:52:01.237946 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f811b8eb-875a-4222-a6fa-f984e1d92436 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:52:01.238562 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f811b8eb-875a-4222-a6fa-f984e1d92436 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:52:01.244992 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f811b8eb-875a-4222-a6fa-f984e1d92436 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:52:01.245449 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f811b8eb-875a-4222-a6fa-f984e1d92436 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:52:01.246329 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f811b8eb-875a-4222-a6fa-f984e1d92436 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:52:01.246806 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f811b8eb-875a-4222-a6fa-f984e1d92436 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:52:01.416277 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f811b8eb-875a-4222-a6fa-f984e1d92436 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:52:01.425603 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f811b8eb-875a-4222-a6fa-f984e1d92436 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:52:01.427292 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f811b8eb-875a-4222-a6fa-f984e1d92436 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:52:01.429304 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f811b8eb-875a-4222-a6fa-f984e1d92436 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1730 microversion: 2.20 time: 0.195386 Apr 08 11:52:01.429892 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1860/2796] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:52:01 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1730 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:52:01.895310 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7a255351-eea1-4c03-af70-cdc51645d9c2 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:52:01.895927 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7a255351-eea1-4c03-af70-cdc51645d9c2 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] [instance: dd2636af-65dc-485a-b874-173a3a203ee9] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:52:01.902857 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7a255351-eea1-4c03-af70-cdc51645d9c2 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:52:01.903313 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7a255351-eea1-4c03-af70-cdc51645d9c2 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:52:01.904090 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7a255351-eea1-4c03-af70-cdc51645d9c2 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:52:01.904529 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7a255351-eea1-4c03-af70-cdc51645d9c2 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:52:01.918988 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-7a255351-eea1-4c03-af70-cdc51645d9c2 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] HTTP exception thrown: Instance dd2636af-65dc-485a-b874-173a3a203ee9 could not be found. Apr 08 11:52:01.919769 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7a255351-eea1-4c03-af70-cdc51645d9c2 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] Returning 404 to user: Instance dd2636af-65dc-485a-b874-173a3a203ee9 could not be found. {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:52:01.920463 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7a255351-eea1-4c03-af70-cdc51645d9c2 tempest-VolumesSnapshotTestJSON-309699312 tempest-VolumesSnapshotTestJSON-309699312-project] 10.222.0.46 "GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9" status: 404 len: 111 microversion: 2.1 time: 0.029210 Apr 08 11:52:01.921020 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1861/2797] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:52:01 2022] GET /compute/v2.1/servers/dd2636af-65dc-485a-b874-173a3a203ee9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 11:52:02.448240 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a94f598c-8187-4132-b58c-90daabe24d30 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:52:02.448984 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a94f598c-8187-4132-b58c-90daabe24d30 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:52:02.455193 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a94f598c-8187-4132-b58c-90daabe24d30 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:52:02.455715 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a94f598c-8187-4132-b58c-90daabe24d30 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:52:02.456682 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a94f598c-8187-4132-b58c-90daabe24d30 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:52:02.457198 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a94f598c-8187-4132-b58c-90daabe24d30 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:52:02.596896 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a94f598c-8187-4132-b58c-90daabe24d30 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:52:02.604877 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a94f598c-8187-4132-b58c-90daabe24d30 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:52:02.606429 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a94f598c-8187-4132-b58c-90daabe24d30 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:52:02.607646 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a94f598c-8187-4132-b58c-90daabe24d30 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1717 microversion: 2.20 time: 0.163924 Apr 08 11:52:02.608150 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1862/2798] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:52:02 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1717 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:53:17.435202 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8cfb9960-9e75-43c3-afb0-d71b7deae791 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:53:17.436137 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8cfb9960-9e75-43c3-afb0-d71b7deae791 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:53:17.442300 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8cfb9960-9e75-43c3-afb0-d71b7deae791 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:53:17.442834 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8cfb9960-9e75-43c3-afb0-d71b7deae791 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:53:17.443531 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8cfb9960-9e75-43c3-afb0-d71b7deae791 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:53:17.443971 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8cfb9960-9e75-43c3-afb0-d71b7deae791 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:53:17.471550 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8cfb9960-9e75-43c3-afb0-d71b7deae791 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042251 Apr 08 11:53:17.472110 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1863/2799] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Apr 8 11:53:17 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:53:17.531248 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c28303bc-1daa-4cfb-ac7a-5bea0c93c6f6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:53:17.538573 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c28303bc-1daa-4cfb-ac7a-5bea0c93c6f6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:53:17.538573 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c28303bc-1daa-4cfb-ac7a-5bea0c93c6f6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:53:17.538573 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c28303bc-1daa-4cfb-ac7a-5bea0c93c6f6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:53:17.539225 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c28303bc-1daa-4cfb-ac7a-5bea0c93c6f6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:53:17.539646 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c28303bc-1daa-4cfb-ac7a-5bea0c93c6f6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:53:17.564073 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c28303bc-1daa-4cfb-ac7a-5bea0c93c6f6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Going to try to terminate instance {{(pid=117800) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 08 11:53:17.859510 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c28303bc-1daa-4cfb-ac7a-5bea0c93c6f6 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 204 len: 0 microversion: 2.20 time: 0.331901 Apr 08 11:53:17.860126 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1864/2800] 10.222.0.46 () {60 vars in 1279 bytes} [Fri Apr 8 11:53:17 2022] DELETE /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 08 11:53:17.868680 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1562af6a-9ae7-4d22-8063-4004d1e2c8ac tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:53:17.869360 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1562af6a-9ae7-4d22-8063-4004d1e2c8ac tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:53:17.875322 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1562af6a-9ae7-4d22-8063-4004d1e2c8ac tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:53:17.875794 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1562af6a-9ae7-4d22-8063-4004d1e2c8ac tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:53:17.876559 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1562af6a-9ae7-4d22-8063-4004d1e2c8ac tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:53:17.877007 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1562af6a-9ae7-4d22-8063-4004d1e2c8ac tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:53:18.010046 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1562af6a-9ae7-4d22-8063-4004d1e2c8ac tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:53:18.018105 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1562af6a-9ae7-4d22-8063-4004d1e2c8ac tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:53:18.019648 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1562af6a-9ae7-4d22-8063-4004d1e2c8ac tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:53:18.020821 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1562af6a-9ae7-4d22-8063-4004d1e2c8ac tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1723 microversion: 2.20 time: 0.156215 Apr 08 11:53:18.021396 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1865/2801] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:53:17 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:53:19.040541 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4cb61952-dddd-4d96-9917-ea5316090043 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:53:19.041106 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4cb61952-dddd-4d96-9917-ea5316090043 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:53:19.047950 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4cb61952-dddd-4d96-9917-ea5316090043 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:53:19.048406 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4cb61952-dddd-4d96-9917-ea5316090043 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:53:19.049193 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4cb61952-dddd-4d96-9917-ea5316090043 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:53:19.049638 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4cb61952-dddd-4d96-9917-ea5316090043 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:53:19.187088 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4cb61952-dddd-4d96-9917-ea5316090043 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:53:19.197073 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4cb61952-dddd-4d96-9917-ea5316090043 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:53:19.198645 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4cb61952-dddd-4d96-9917-ea5316090043 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:53:19.199884 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4cb61952-dddd-4d96-9917-ea5316090043 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1723 microversion: 2.20 time: 0.163914 Apr 08 11:53:19.200454 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1866/2802] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:53:19 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:53:20.219117 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-299278b7-359a-41bc-820d-998e419c90b2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:53:20.219855 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-299278b7-359a-41bc-820d-998e419c90b2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:53:20.228185 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-299278b7-359a-41bc-820d-998e419c90b2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:53:20.228594 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-299278b7-359a-41bc-820d-998e419c90b2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:53:20.229377 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-299278b7-359a-41bc-820d-998e419c90b2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:53:20.229847 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-299278b7-359a-41bc-820d-998e419c90b2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:53:20.474118 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-299278b7-359a-41bc-820d-998e419c90b2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:53:20.482064 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-299278b7-359a-41bc-820d-998e419c90b2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:53:20.483483 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-299278b7-359a-41bc-820d-998e419c90b2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:53:20.484654 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-299278b7-359a-41bc-820d-998e419c90b2 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1723 microversion: 2.20 time: 0.270566 Apr 08 11:53:20.485229 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1867/2803] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:53:20 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1723 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 11:53:20.927419 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 11:53:20.927850 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:53:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 11:53:21.192360 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-c83faebd-4d7c-4b60-8420-cb041af49954 req-f1605e03-11fe-4b85-b9b9-5f9cb28d5e6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1da27a98-0639-4251-ae77-64f51d7f8f76", "name": "network-vif-deleted", "tag": "d23a90b6-9e66-48bf-9f26-cdd76a4924a4"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:53:21.201617 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-c83faebd-4d7c-4b60-8420-cb041af49954 req-f1605e03-11fe-4b85-b9b9-5f9cb28d5e6a service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:53:21.202084 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-c83faebd-4d7c-4b60-8420-cb041af49954 req-f1605e03-11fe-4b85-b9b9-5f9cb28d5e6a service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:53:21.216769 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-c83faebd-4d7c-4b60-8420-cb041af49954 req-f1605e03-11fe-4b85-b9b9-5f9cb28d5e6a service nova] Creating event network-vif-deleted:d23a90b6-9e66-48bf-9f26-cdd76a4924a4 for instance 1da27a98-0639-4251-ae77-64f51d7f8f76 on hv-cinder-83607 Apr 08 11:53:21.222585 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-c83faebd-4d7c-4b60-8420-cb041af49954 req-f1605e03-11fe-4b85-b9b9-5f9cb28d5e6a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.246873 Apr 08 11:53:21.224192 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1868/2804] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:53:21.504231 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-89c6a598-034d-4b3d-8089-5144b9861d0f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:53:21.504928 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-89c6a598-034d-4b3d-8089-5144b9861d0f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:53:21.513364 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-89c6a598-034d-4b3d-8089-5144b9861d0f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:53:21.513832 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-89c6a598-034d-4b3d-8089-5144b9861d0f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:53:21.514628 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-89c6a598-034d-4b3d-8089-5144b9861d0f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:53:21.515066 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-89c6a598-034d-4b3d-8089-5144b9861d0f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:53:21.547242 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-89c6a598-034d-4b3d-8089-5144b9861d0f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:53:21.547735 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-89c6a598-034d-4b3d-8089-5144b9861d0f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:53:21.548200 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-89c6a598-034d-4b3d-8089-5144b9861d0f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lazy-loading 'fault' on Instance uuid 1da27a98-0639-4251-ae77-64f51d7f8f76 {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 11:53:21.592405 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-89c6a598-034d-4b3d-8089-5144b9861d0f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:53:21.600416 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-89c6a598-034d-4b3d-8089-5144b9861d0f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:53:21.601958 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-89c6a598-034d-4b3d-8089-5144b9861d0f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc136334416c403780722f1c3bb6bc7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5dd9671a5114358a9c0b092a8f1ac1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:53:21.603276 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-89c6a598-034d-4b3d-8089-5144b9861d0f tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 200 len: 1370 microversion: 2.20 time: 0.103782 Apr 08 11:53:21.604898 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1869/2805] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:53:21 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 1370 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 11:53:22.621516 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bad13020-2038-40d7-877c-e8e46c967297 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:53:22.622261 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-bad13020-2038-40d7-877c-e8e46c967297 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:53:22.628400 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bad13020-2038-40d7-877c-e8e46c967297 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:53:22.628857 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bad13020-2038-40d7-877c-e8e46c967297 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:53:22.629628 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bad13020-2038-40d7-877c-e8e46c967297 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:53:22.630140 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bad13020-2038-40d7-877c-e8e46c967297 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:53:22.643660 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-bad13020-2038-40d7-877c-e8e46c967297 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] HTTP exception thrown: Instance 1da27a98-0639-4251-ae77-64f51d7f8f76 could not be found. Apr 08 11:53:22.644255 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bad13020-2038-40d7-877c-e8e46c967297 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Returning 404 to user: Instance 1da27a98-0639-4251-ae77-64f51d7f8f76 could not be found. {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:53:22.645092 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-bad13020-2038-40d7-877c-e8e46c967297 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 404 len: 111 microversion: 2.20 time: 0.027525 Apr 08 11:53:22.645660 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1870/2806] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:53:22 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 08 11:53:22.654505 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-abec994c-9bf2-4cbf-89d4-c66c6214c989 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '.version_select at 0x7f042861e790>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:53:22.747319 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-abec994c-9bf2-4cbf-89d4-c66c6214c989 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1132330898" status: 204 len: 0 microversion: 2.20 time: 0.096438 Apr 08 11:53:22.747909 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1871/2807] 10.222.0.46 () {60 vars in 1261 bytes} [Fri Apr 8 11:53:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1132330898 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 08 11:53:24.834116 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4ced3749-003f-4eeb-b0ab-d2fd1d688958 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:53:24.834763 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4ced3749-003f-4eeb-b0ab-d2fd1d688958 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:53:24.841217 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4ced3749-003f-4eeb-b0ab-d2fd1d688958 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:53:24.841833 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4ced3749-003f-4eeb-b0ab-d2fd1d688958 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:53:24.842517 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4ced3749-003f-4eeb-b0ab-d2fd1d688958 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:53:24.842915 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4ced3749-003f-4eeb-b0ab-d2fd1d688958 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:53:24.855757 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-4ced3749-003f-4eeb-b0ab-d2fd1d688958 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] HTTP exception thrown: Instance 1da27a98-0639-4251-ae77-64f51d7f8f76 could not be found. Apr 08 11:53:24.856374 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4ced3749-003f-4eeb-b0ab-d2fd1d688958 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Returning 404 to user: Instance 1da27a98-0639-4251-ae77-64f51d7f8f76 could not be found. {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:53:24.857203 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4ced3749-003f-4eeb-b0ab-d2fd1d688958 tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 404 len: 111 microversion: 2.20 time: 0.027514 Apr 08 11:53:24.858269 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1872/2808] 10.222.0.46 () {60 vars in 1279 bytes} [Fri Apr 8 11:53:24 2022] DELETE /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 08 11:53:24.865884 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e649632f-da22-4086-b307-954077b1cc0e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:53:24.866524 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e649632f-da22-4086-b307-954077b1cc0e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 1da27a98-0639-4251-ae77-64f51d7f8f76] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:53:24.872203 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e649632f-da22-4086-b307-954077b1cc0e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:53:24.872658 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e649632f-da22-4086-b307-954077b1cc0e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:53:24.874037 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e649632f-da22-4086-b307-954077b1cc0e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:53:24.874528 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e649632f-da22-4086-b307-954077b1cc0e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:53:24.887075 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-e649632f-da22-4086-b307-954077b1cc0e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] HTTP exception thrown: Instance 1da27a98-0639-4251-ae77-64f51d7f8f76 could not be found. Apr 08 11:53:24.887648 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e649632f-da22-4086-b307-954077b1cc0e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Returning 404 to user: Instance 1da27a98-0639-4251-ae77-64f51d7f8f76 could not be found. {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:53:24.888466 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e649632f-da22-4086-b307-954077b1cc0e tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76" status: 404 len: 111 microversion: 2.20 time: 0.026115 Apr 08 11:53:24.888984 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1873/2809] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:53:24 2022] GET /compute/v2.1/servers/1da27a98-0639-4251-ae77-64f51d7f8f76 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 08 11:53:26.208725 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e2c54a45-d968-44b5-917c-9e76d4d3665c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:53:26.209594 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e2c54a45-d968-44b5-917c-9e76d4d3665c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:53:26.216627 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e2c54a45-d968-44b5-917c-9e76d4d3665c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:53:26.217937 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e2c54a45-d968-44b5-917c-9e76d4d3665c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:53:26.219307 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e2c54a45-d968-44b5-917c-9e76d4d3665c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:53:26.219977 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e2c54a45-d968-44b5-917c-9e76d4d3665c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:53:26.238585 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-e2c54a45-d968-44b5-917c-9e76d4d3665c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] HTTP exception thrown: Instance 594ceb52-9d1f-494f-818d-eb66144bc49d could not be found. Apr 08 11:53:26.239188 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e2c54a45-d968-44b5-917c-9e76d4d3665c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Returning 404 to user: Instance 594ceb52-9d1f-494f-818d-eb66144bc49d could not be found. {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:53:26.240048 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e2c54a45-d968-44b5-917c-9e76d4d3665c tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "DELETE /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 404 len: 111 microversion: 2.20 time: 0.038293 Apr 08 11:53:26.240660 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1874/2810] 10.222.0.46 () {60 vars in 1279 bytes} [Fri Apr 8 11:53:26 2022] DELETE /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 08 11:53:26.248986 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f8f04ea7-c507-48ed-91dc-dee30964533a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:53:26.249619 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f8f04ea7-c507-48ed-91dc-dee30964533a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] [instance: 594ceb52-9d1f-494f-818d-eb66144bc49d] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:53:26.255928 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f8f04ea7-c507-48ed-91dc-dee30964533a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:53:26.256391 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f8f04ea7-c507-48ed-91dc-dee30964533a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:53:26.257193 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f8f04ea7-c507-48ed-91dc-dee30964533a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:53:26.257641 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f8f04ea7-c507-48ed-91dc-dee30964533a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:53:26.277920 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-f8f04ea7-c507-48ed-91dc-dee30964533a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] HTTP exception thrown: Instance 594ceb52-9d1f-494f-818d-eb66144bc49d could not be found. Apr 08 11:53:26.278521 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f8f04ea7-c507-48ed-91dc-dee30964533a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] Returning 404 to user: Instance 594ceb52-9d1f-494f-818d-eb66144bc49d could not be found. {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:53:26.279376 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f8f04ea7-c507-48ed-91dc-dee30964533a tempest-AttachVolumeShelveTestJSON-86856042 tempest-AttachVolumeShelveTestJSON-86856042-project] 10.222.0.46 "GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d" status: 404 len: 111 microversion: 2.20 time: 0.034561 Apr 08 11:53:26.280516 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1875/2811] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 8 11:53:26 2022] GET /compute/v2.1/servers/594ceb52-9d1f-494f-818d-eb66144bc49d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 08 11:53:33.165867 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7fa75351-7b8d-4bfb-8651-7bd0b4074e9e tempest-VolumesNegativeTest-1050288234 tempest-VolumesNegativeTest-1050288234-project] Action: 'create', calling method: .version_select at 0x7f0428579b80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-71266881", "metadata": {"Type": "work"}}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:53:33.167619 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7fa75351-7b8d-4bfb-8651-7bd0b4074e9e tempest-VolumesNegativeTest-1050288234 tempest-VolumesNegativeTest-1050288234-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:53:33.168883 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7fa75351-7b8d-4bfb-8651-7bd0b4074e9e tempest-VolumesNegativeTest-1050288234 tempest-VolumesNegativeTest-1050288234-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.145054 Apr 08 11:53:33.173668 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1876/2812] 10.222.0.46 () {60 vars in 1155 bytes} [Fri Apr 8 11:53:33 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 147 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 08 11:53:33.180336 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bcf3ea48-48fb-4155-8be8-c816e1fa3c24 tempest-VolumesNegativeTest-1050288234 tempest-VolumesNegativeTest-1050288234-project] Action: 'create', calling method: .version_select at 0x7f042861c790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-979457804", "metadata": {"Type": "work"}}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:53:33.182017 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bcf3ea48-48fb-4155-8be8-c816e1fa3c24 tempest-VolumesNegativeTest-1050288234 tempest-VolumesNegativeTest-1050288234-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:53:33.182927 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-bcf3ea48-48fb-4155-8be8-c816e1fa3c24 tempest-VolumesNegativeTest-1050288234 tempest-VolumesNegativeTest-1050288234-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006978 Apr 08 11:53:33.183444 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1877/2813] 10.222.0.46 () {60 vars in 1155 bytes} [Fri Apr 8 11:53:33 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 08 11:53:33.194453 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a9008530-3d18-4144-8cc0-2ecb063bc8c9 tempest-VolumesNegativeTest-1050288234 tempest-VolumesNegativeTest-1050288234-project] Action: 'create', calling method: .version_select at 0x7f04285c0550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2067123072", "metadata": {"Type": "work"}}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:53:33.196234 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a9008530-3d18-4144-8cc0-2ecb063bc8c9 tempest-VolumesNegativeTest-1050288234 tempest-VolumesNegativeTest-1050288234-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:53:33.197072 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a9008530-3d18-4144-8cc0-2ecb063bc8c9 tempest-VolumesNegativeTest-1050288234 tempest-VolumesNegativeTest-1050288234-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006534 Apr 08 11:53:33.197648 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1878/2814] 10.222.0.46 () {60 vars in 1155 bytes} [Fri Apr 8 11:53:33 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 08 11:53:33.207176 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ebc29283-8440-42d4-98f2-5fdb24e58b7b tempest-VolumesNegativeTest-1050288234 tempest-VolumesNegativeTest-1050288234-project] Calling method '.version_select at 0x7f042861c280>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:53:33.245614 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-ebc29283-8440-42d4-98f2-5fdb24e58b7b tempest-VolumesNegativeTest-1050288234 tempest-VolumesNegativeTest-1050288234-project] HTTP exception thrown: Volume tempest-invalid-747648836 could not be found. Apr 08 11:53:33.246256 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ebc29283-8440-42d4-98f2-5fdb24e58b7b tempest-VolumesNegativeTest-1050288234 tempest-VolumesNegativeTest-1050288234-project] Returning 404 to user: Volume tempest-invalid-747648836 could not be found. {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:53:33.247103 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ebc29283-8440-42d4-98f2-5fdb24e58b7b tempest-VolumesNegativeTest-1050288234 tempest-VolumesNegativeTest-1050288234-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/tempest-invalid-747648836" status: 404 len: 98 microversion: 2.1 time: 0.043731 Apr 08 11:53:33.247853 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1879/2815] 10.222.0.46 () {58 vars in 1214 bytes} [Fri Apr 8 11:53:33 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-747648836 => generated 98 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 08 11:53:33.258867 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4927ec95-6eae-4e1c-bcf6-2828a09135c3 tempest-VolumesNegativeTest-1050288234 tempest-VolumesNegativeTest-1050288234-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003850 Apr 08 11:53:33.259397 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1880/2816] 10.222.0.46 () {58 vars in 1139 bytes} [Fri Apr 8 11:53:33 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Apr 08 11:53:33.270432 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-44cba696-df7f-4bc9-8d43-ad9296924138 tempest-VolumesNegativeTest-1050288234 tempest-VolumesNegativeTest-1050288234-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004897 Apr 08 11:53:33.271197 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1881/2817] 10.222.0.46 () {58 vars in 1136 bytes} [Fri Apr 8 11:53:33 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Apr 08 11:53:33.281127 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ec4589bb-543a-4ac0-8275-f9746c68a69f tempest-VolumesNegativeTest-1050288234 tempest-VolumesNegativeTest-1050288234-project] Calling method '.version_select at 0x7f041f72b820>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:53:33.312356 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-ec4589bb-543a-4ac0-8275-f9746c68a69f tempest-VolumesNegativeTest-1050288234 tempest-VolumesNegativeTest-1050288234-project] HTTP exception thrown: Volume fa176972-f68e-4316-85db-29f8384f12d5 could not be found. Apr 08 11:53:33.313060 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ec4589bb-543a-4ac0-8275-f9746c68a69f tempest-VolumesNegativeTest-1050288234 tempest-VolumesNegativeTest-1050288234-project] Returning 404 to user: Volume fa176972-f68e-4316-85db-29f8384f12d5 could not be found. {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:53:33.313946 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ec4589bb-543a-4ac0-8275-f9746c68a69f tempest-VolumesNegativeTest-1050288234 tempest-VolumesNegativeTest-1050288234-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/fa176972-f68e-4316-85db-29f8384f12d5" status: 404 len: 109 microversion: 2.1 time: 0.036674 Apr 08 11:53:33.314506 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1882/2818] 10.222.0.46 () {58 vars in 1247 bytes} [Fri Apr 8 11:53:33 2022] DELETE /compute/v2.1/os-volumes/fa176972-f68e-4316-85db-29f8384f12d5 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 11:53:33.329433 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f0178ce8-c1e9-4aee-b3bf-ff5b2d6e4da4 tempest-VolumesNegativeTest-1050288234 tempest-VolumesNegativeTest-1050288234-project] Calling method '.version_select at 0x7f0428578790>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:53:33.358459 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-f0178ce8-c1e9-4aee-b3bf-ff5b2d6e4da4 tempest-VolumesNegativeTest-1050288234 tempest-VolumesNegativeTest-1050288234-project] HTTP exception thrown: Volume af968fa0-9972-4f3c-a600-ebf39dbc3977 could not be found. Apr 08 11:53:33.359600 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f0178ce8-c1e9-4aee-b3bf-ff5b2d6e4da4 tempest-VolumesNegativeTest-1050288234 tempest-VolumesNegativeTest-1050288234-project] Returning 404 to user: Volume af968fa0-9972-4f3c-a600-ebf39dbc3977 could not be found. {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:53:33.360827 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f0178ce8-c1e9-4aee-b3bf-ff5b2d6e4da4 tempest-VolumesNegativeTest-1050288234 tempest-VolumesNegativeTest-1050288234-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/af968fa0-9972-4f3c-a600-ebf39dbc3977" status: 404 len: 109 microversion: 2.1 time: 0.035041 Apr 08 11:53:33.361514 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1883/2819] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Apr 8 11:53:33 2022] GET /compute/v2.1/os-volumes/af968fa0-9972-4f3c-a600-ebf39dbc3977 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 11:54:31.949659 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 11:54:31.950363 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 11:54:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 11:54:40.141441 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0521c075-dcae-4d6f-a783-910503709209 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:54:40.142239 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0521c075-dcae-4d6f-a783-910503709209 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:54:40.150032 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0521c075-dcae-4d6f-a783-910503709209 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:54:40.150407 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0521c075-dcae-4d6f-a783-910503709209 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:54:40.151872 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0521c075-dcae-4d6f-a783-910503709209 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:54:40.152244 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0521c075-dcae-4d6f-a783-910503709209 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:54:40.176023 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0521c075-dcae-4d6f-a783-910503709209 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Going to try to terminate instance {{(pid=117800) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 08 11:54:40.508613 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0521c075-dcae-4d6f-a783-910503709209 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "DELETE /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 204 len: 0 microversion: 2.1 time: 0.371801 Apr 08 11:54:40.509232 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1884/2820] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 8 11:54:40 2022] DELETE /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 08 11:54:40.521655 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-92cae256-14ce-4daf-96cf-7431460c37e3 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:54:40.522388 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-92cae256-14ce-4daf-96cf-7431460c37e3 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:54:40.528775 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-92cae256-14ce-4daf-96cf-7431460c37e3 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:54:40.529184 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-92cae256-14ce-4daf-96cf-7431460c37e3 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:54:40.530007 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-92cae256-14ce-4daf-96cf-7431460c37e3 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:54:40.530443 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-92cae256-14ce-4daf-96cf-7431460c37e3 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:54:40.665213 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-92cae256-14ce-4daf-96cf-7431460c37e3 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:54:40.674029 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-92cae256-14ce-4daf-96cf-7431460c37e3 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1719 microversion: 2.1 time: 0.156751 Apr 08 11:54:40.674627 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1885/2821] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:54:40 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:54:41.692821 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-533bdc62-7397-4736-8a1f-3b0a4b2feac3 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:54:41.693547 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-533bdc62-7397-4736-8a1f-3b0a4b2feac3 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:54:41.701117 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-533bdc62-7397-4736-8a1f-3b0a4b2feac3 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:54:41.701564 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-533bdc62-7397-4736-8a1f-3b0a4b2feac3 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:54:41.702426 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-533bdc62-7397-4736-8a1f-3b0a4b2feac3 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:54:41.702854 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-533bdc62-7397-4736-8a1f-3b0a4b2feac3 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:54:41.937165 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-533bdc62-7397-4736-8a1f-3b0a4b2feac3 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:54:41.945267 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-533bdc62-7397-4736-8a1f-3b0a4b2feac3 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1719 microversion: 2.1 time: 0.256368 Apr 08 11:54:41.945885 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1886/2822] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:54:41 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1719 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:54:42.721586 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-9fa08252-e133-40f2-b190-d988e5f9a34c req-31cdaa77-ffd5-46cf-af53-bb4b386d0a80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eff1b1a4-3738-43db-86ce-a17e2f08ffc0", "name": "network-vif-deleted", "tag": "e41cba02-8f69-4396-ac0c-333ff20bdcbe"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:54:42.732986 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-9fa08252-e133-40f2-b190-d988e5f9a34c req-31cdaa77-ffd5-46cf-af53-bb4b386d0a80 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:54:42.738251 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-9fa08252-e133-40f2-b190-d988e5f9a34c req-31cdaa77-ffd5-46cf-af53-bb4b386d0a80 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:54:42.745109 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-9fa08252-e133-40f2-b190-d988e5f9a34c req-31cdaa77-ffd5-46cf-af53-bb4b386d0a80 service nova] Creating event network-vif-deleted:e41cba02-8f69-4396-ac0c-333ff20bdcbe for instance eff1b1a4-3738-43db-86ce-a17e2f08ffc0 on hv-cinder-83607 Apr 08 11:54:42.751047 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-9fa08252-e133-40f2-b190-d988e5f9a34c req-31cdaa77-ffd5-46cf-af53-bb4b386d0a80 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034992 Apr 08 11:54:42.751972 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1887/2823] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:54:42.965041 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-45863a62-77ce-4f32-a47c-7be5b98f00aa tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:54:42.965740 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-45863a62-77ce-4f32-a47c-7be5b98f00aa tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:54:42.972004 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-45863a62-77ce-4f32-a47c-7be5b98f00aa tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:54:42.972711 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-45863a62-77ce-4f32-a47c-7be5b98f00aa tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:54:42.973572 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-45863a62-77ce-4f32-a47c-7be5b98f00aa tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:54:42.974277 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-45863a62-77ce-4f32-a47c-7be5b98f00aa tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:54:43.040255 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-45863a62-77ce-4f32-a47c-7be5b98f00aa tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:54:43.048581 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-45863a62-77ce-4f32-a47c-7be5b98f00aa tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 200 len: 1369 microversion: 2.1 time: 0.088800 Apr 08 11:54:43.050689 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1888/2824] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:54:42 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:54:44.066838 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3e7facee-8d3d-4a86-818f-8e34c7ef6c65 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:54:44.067555 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3e7facee-8d3d-4a86-818f-8e34c7ef6c65 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:54:44.073610 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3e7facee-8d3d-4a86-818f-8e34c7ef6c65 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:54:44.074096 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3e7facee-8d3d-4a86-818f-8e34c7ef6c65 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:54:44.074859 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3e7facee-8d3d-4a86-818f-8e34c7ef6c65 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:54:44.075292 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3e7facee-8d3d-4a86-818f-8e34c7ef6c65 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:54:44.088741 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-3e7facee-8d3d-4a86-818f-8e34c7ef6c65 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] HTTP exception thrown: Instance eff1b1a4-3738-43db-86ce-a17e2f08ffc0 could not be found. Apr 08 11:54:44.089356 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3e7facee-8d3d-4a86-818f-8e34c7ef6c65 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Returning 404 to user: Instance eff1b1a4-3738-43db-86ce-a17e2f08ffc0 could not be found. {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:54:44.092829 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3e7facee-8d3d-4a86-818f-8e34c7ef6c65 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 404 len: 111 microversion: 2.1 time: 0.027253 Apr 08 11:54:44.092829 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1889/2825] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:54:44 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 11:54:44.098679 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6964bf9f-ad2a-48ba-acc6-970139f718ca tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '.version_select at 0x7f041f676160>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:54:44.220057 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6964bf9f-ad2a-48ba-acc6-970139f718ca tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1755896538" status: 202 len: 0 microversion: 2.1 time: 0.124871 Apr 08 11:54:44.220631 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1890/2826] 10.222.0.46 () {58 vars in 1220 bytes} [Fri Apr 8 11:54:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1755896538 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 08 11:54:45.390503 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-827b6e26-9aab-4cea-a154-91513773feb7 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Action: 'create', calling method: .version_select at 0x7f04285a4820>, body: {"keypair": {"name": "tempest-keypair-1499975988"}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:54:45.405925 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-827b6e26-9aab-4cea-a154-91513773feb7 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Getting quotas for project bab0811e055f46b98a70790223b64a13. Resources: {'key_pairs'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 11:54:45.409712 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-827b6e26-9aab-4cea-a154-91513773feb7 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Getting quotas for user af7f5f8b5df94835ae32b80a106ede09 and project bab0811e055f46b98a70790223b64a13. Resources: {'key_pairs'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 11:54:45.630392 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-827b6e26-9aab-4cea-a154-91513773feb7 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Getting quotas for project bab0811e055f46b98a70790223b64a13. Resources: {'key_pairs'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 11:54:45.634207 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-827b6e26-9aab-4cea-a154-91513773feb7 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Getting quotas for user af7f5f8b5df94835ae32b80a106ede09 and project bab0811e055f46b98a70790223b64a13. Resources: {'key_pairs'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 11:54:45.647932 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-827b6e26-9aab-4cea-a154-91513773feb7 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.262050 Apr 08 11:54:45.648523 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1891/2827] 10.222.0.46 () {60 vars in 1157 bytes} [Fri Apr 8 11:54:45 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:54:47.829643 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d1d94c12-3088-4f47-882b-26fd5f3e5585 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1734298061", "imageRef": "35b8d8d2-a0e9-4c3e-8586-5e088dec27e6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21532aea-6123-4104-bb2d-623657c68d39"}], "security_groups": [{"name": "tempest-securitygroup--1929766389"}], "key_name": "tempest-keypair-1499975988", "user_data": "}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:54:47.931182 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.network.neutron [None req-d1d94c12-3088-4f47-882b-26fd5f3e5585 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] validate_networks() for [('21532aea-6123-4104-bb2d-623657c68d39', None, None, None, None, None)] {{(pid=117800) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 08 11:54:48.399735 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-d1d94c12-3088-4f47-882b-26fd5f3e5585 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Flavor limits 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 11:54:48.401659 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-d1d94c12-3088-4f47-882b-26fd5f3e5585 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Image limits 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 11:54:48.402289 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-d1d94c12-3088-4f47-882b-26fd5f3e5585 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Flavor pref 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 11:54:48.402710 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-d1d94c12-3088-4f47-882b-26fd5f3e5585 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Image pref 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 11:54:48.403130 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-d1d94c12-3088-4f47-882b-26fd5f3e5585 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 11:54:48.412156 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d1d94c12-3088-4f47-882b-26fd5f3e5585 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:54:48.414513 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d1d94c12-3088-4f47-882b-26fd5f3e5585 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:54:48.414513 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d1d94c12-3088-4f47-882b-26fd5f3e5585 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:54:48.414513 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d1d94c12-3088-4f47-882b-26fd5f3e5585 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:54:48.435085 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-d1d94c12-3088-4f47-882b-26fd5f3e5585 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Getting quotas for project bab0811e055f46b98a70790223b64a13. Resources: {'instances', 'ram', 'cores'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 11:54:48.439043 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-d1d94c12-3088-4f47-882b-26fd5f3e5585 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Getting quotas for user af7f5f8b5df94835ae32b80a106ede09 and project bab0811e055f46b98a70790223b64a13. Resources: {'instances', 'ram', 'cores'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 11:54:48.449782 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d1d94c12-3088-4f47-882b-26fd5f3e5585 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Going to run 1 instances... {{(pid=117800) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 08 11:54:48.452060 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d1d94c12-3088-4f47-882b-26fd5f3e5585 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: 75f28f3c-9647-4254-8b70-4b1f38be43eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='35b8d8d2-a0e9-4c3e-8586-5e088dec27e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 08 11:54:48.585948 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d1d94c12-3088-4f47-882b-26fd5f3e5585 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.760509 Apr 08 11:54:48.586602 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1892/2828] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Apr 8 11:54:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 08 11:54:48.597743 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4b0495b2-e06c-424a-8b6a-f3603aeaa47a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:54:48.598379 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4b0495b2-e06c-424a-8b6a-f3603aeaa47a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: 75f28f3c-9647-4254-8b70-4b1f38be43eb] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:54:48.653594 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4b0495b2-e06c-424a-8b6a-f3603aeaa47a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:54:48.661717 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4b0495b2-e06c-424a-8b6a-f3603aeaa47a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb" status: 200 len: 1238 microversion: 2.1 time: 0.067837 Apr 08 11:54:48.662375 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1893/2829] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:54:48 2022] GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:54:49.680410 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b788ce36-4649-4128-8f5a-7a59ce610d81 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:54:49.681760 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b788ce36-4649-4128-8f5a-7a59ce610d81 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: 75f28f3c-9647-4254-8b70-4b1f38be43eb] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:54:49.688429 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b788ce36-4649-4128-8f5a-7a59ce610d81 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:54:49.688888 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b788ce36-4649-4128-8f5a-7a59ce610d81 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:54:49.689672 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b788ce36-4649-4128-8f5a-7a59ce610d81 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:54:49.690146 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b788ce36-4649-4128-8f5a-7a59ce610d81 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:54:49.757448 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b788ce36-4649-4128-8f5a-7a59ce610d81 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:54:49.765616 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b788ce36-4649-4128-8f5a-7a59ce610d81 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb" status: 200 len: 1242 microversion: 2.1 time: 0.089191 Apr 08 11:54:49.766229 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1894/2830] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:54:49 2022] GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb => generated 1242 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:54:50.782475 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6c84ae06-8b91-45d5-854a-6a9ba51dcb80 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:54:50.783185 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6c84ae06-8b91-45d5-854a-6a9ba51dcb80 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: 75f28f3c-9647-4254-8b70-4b1f38be43eb] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:54:50.789466 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6c84ae06-8b91-45d5-854a-6a9ba51dcb80 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:54:50.789966 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6c84ae06-8b91-45d5-854a-6a9ba51dcb80 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:54:50.790994 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6c84ae06-8b91-45d5-854a-6a9ba51dcb80 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:54:50.792036 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6c84ae06-8b91-45d5-854a-6a9ba51dcb80 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:54:50.864329 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6c84ae06-8b91-45d5-854a-6a9ba51dcb80 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:54:50.871843 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6c84ae06-8b91-45d5-854a-6a9ba51dcb80 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb" status: 200 len: 1298 microversion: 2.1 time: 0.093211 Apr 08 11:54:50.874164 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1895/2831] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:54:50 2022] GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb => generated 1298 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:54:51.888687 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3e95476c-81ee-4acd-9ed4-f9b419445a05 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:54:51.890024 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3e95476c-81ee-4acd-9ed4-f9b419445a05 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: 75f28f3c-9647-4254-8b70-4b1f38be43eb] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:54:51.897322 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3e95476c-81ee-4acd-9ed4-f9b419445a05 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:54:51.898008 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3e95476c-81ee-4acd-9ed4-f9b419445a05 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:54:51.898982 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3e95476c-81ee-4acd-9ed4-f9b419445a05 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:54:51.899594 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3e95476c-81ee-4acd-9ed4-f9b419445a05 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:54:52.172575 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3e95476c-81ee-4acd-9ed4-f9b419445a05 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:54:52.180276 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3e95476c-81ee-4acd-9ed4-f9b419445a05 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb" status: 200 len: 1364 microversion: 2.1 time: 0.295473 Apr 08 11:54:52.182011 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1896/2832] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:54:51 2022] GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb => generated 1364 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:54:52.934192 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-31876c1e-e036-4def-9dfa-985983cce054 req-ac9b5c40-bd4a-4101-b979-69fc3813757d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75f28f3c-9647-4254-8b70-4b1f38be43eb", "tag": "46820bbd-ab2e-4ce5-a8cb-5306f4130e88"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:54:52.942950 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-31876c1e-e036-4def-9dfa-985983cce054 req-ac9b5c40-bd4a-4101-b979-69fc3813757d service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:54:52.943401 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-31876c1e-e036-4def-9dfa-985983cce054 req-ac9b5c40-bd4a-4101-b979-69fc3813757d service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:54:52.956549 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-31876c1e-e036-4def-9dfa-985983cce054 req-ac9b5c40-bd4a-4101-b979-69fc3813757d service nova] Creating event network-changed:46820bbd-ab2e-4ce5-a8cb-5306f4130e88 for instance 75f28f3c-9647-4254-8b70-4b1f38be43eb on hv-cinder-83607 Apr 08 11:54:52.963706 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-31876c1e-e036-4def-9dfa-985983cce054 req-ac9b5c40-bd4a-4101-b979-69fc3813757d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032671 Apr 08 11:54:52.964742 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1897/2833] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:54:53.200582 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9143ff1f-5555-402e-b206-08b4be8409e9 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:54:53.201296 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9143ff1f-5555-402e-b206-08b4be8409e9 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: 75f28f3c-9647-4254-8b70-4b1f38be43eb] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:54:53.208611 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9143ff1f-5555-402e-b206-08b4be8409e9 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:54:53.209353 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9143ff1f-5555-402e-b206-08b4be8409e9 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:54:53.210178 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9143ff1f-5555-402e-b206-08b4be8409e9 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:54:53.210863 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9143ff1f-5555-402e-b206-08b4be8409e9 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:54:53.409549 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9143ff1f-5555-402e-b206-08b4be8409e9 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:54:53.421475 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9143ff1f-5555-402e-b206-08b4be8409e9 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb" status: 200 len: 1364 microversion: 2.1 time: 0.222327 Apr 08 11:54:53.421475 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1898/2834] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:54:53 2022] GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb => generated 1364 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:54:54.434742 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-46d436f9-8473-4d4f-89d8-c7791b72dfc4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:54:54.435503 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-46d436f9-8473-4d4f-89d8-c7791b72dfc4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: 75f28f3c-9647-4254-8b70-4b1f38be43eb] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:54:54.441659 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-46d436f9-8473-4d4f-89d8-c7791b72dfc4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:54:54.442145 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-46d436f9-8473-4d4f-89d8-c7791b72dfc4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:54:54.442939 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-46d436f9-8473-4d4f-89d8-c7791b72dfc4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:54:54.443378 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-46d436f9-8473-4d4f-89d8-c7791b72dfc4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:54:54.588596 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-46d436f9-8473-4d4f-89d8-c7791b72dfc4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:54:54.599675 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-46d436f9-8473-4d4f-89d8-c7791b72dfc4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb" status: 200 len: 1364 microversion: 2.1 time: 0.168705 Apr 08 11:54:54.600546 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1899/2835] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:54:54 2022] GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:54:55.617303 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-07d2630d-8cbb-49e6-9810-e0ec19bf2f33 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:54:55.618066 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-07d2630d-8cbb-49e6-9810-e0ec19bf2f33 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: 75f28f3c-9647-4254-8b70-4b1f38be43eb] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:54:55.624405 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-07d2630d-8cbb-49e6-9810-e0ec19bf2f33 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:54:55.624854 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-07d2630d-8cbb-49e6-9810-e0ec19bf2f33 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:54:55.625628 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-07d2630d-8cbb-49e6-9810-e0ec19bf2f33 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:54:55.626099 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-07d2630d-8cbb-49e6-9810-e0ec19bf2f33 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:54:55.769755 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-07d2630d-8cbb-49e6-9810-e0ec19bf2f33 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:54:55.778748 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-07d2630d-8cbb-49e6-9810-e0ec19bf2f33 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb" status: 200 len: 1364 microversion: 2.1 time: 0.165385 Apr 08 11:54:55.779333 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1900/2836] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:54:55 2022] GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:54:56.796303 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-438288b9-446d-438f-be6d-fbb6d67d56a4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:54:56.796986 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-438288b9-446d-438f-be6d-fbb6d67d56a4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: 75f28f3c-9647-4254-8b70-4b1f38be43eb] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:54:56.802913 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-438288b9-446d-438f-be6d-fbb6d67d56a4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:54:56.803456 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-438288b9-446d-438f-be6d-fbb6d67d56a4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:54:56.804307 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-438288b9-446d-438f-be6d-fbb6d67d56a4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:54:56.804800 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-438288b9-446d-438f-be6d-fbb6d67d56a4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:54:56.938822 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-438288b9-446d-438f-be6d-fbb6d67d56a4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:54:56.945995 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-438288b9-446d-438f-be6d-fbb6d67d56a4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb" status: 200 len: 1364 microversion: 2.1 time: 0.153557 Apr 08 11:54:56.946629 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1901/2837] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:54:56 2022] GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:54:57.962894 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-aa34ba87-ad22-4a1e-975b-1aec14d073d6 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:54:57.963557 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-aa34ba87-ad22-4a1e-975b-1aec14d073d6 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: 75f28f3c-9647-4254-8b70-4b1f38be43eb] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:54:57.969718 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aa34ba87-ad22-4a1e-975b-1aec14d073d6 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:54:57.970201 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aa34ba87-ad22-4a1e-975b-1aec14d073d6 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:54:57.970966 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aa34ba87-ad22-4a1e-975b-1aec14d073d6 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:54:57.971403 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aa34ba87-ad22-4a1e-975b-1aec14d073d6 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:54:58.100789 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-aa34ba87-ad22-4a1e-975b-1aec14d073d6 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:54:58.109257 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-aa34ba87-ad22-4a1e-975b-1aec14d073d6 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb" status: 200 len: 1364 microversion: 2.1 time: 0.150280 Apr 08 11:54:58.109849 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1902/2838] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:54:57 2022] GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:54:59.126426 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c03739f0-c9f0-4a03-b560-a5c976d62ad0 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:54:59.127079 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c03739f0-c9f0-4a03-b560-a5c976d62ad0 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: 75f28f3c-9647-4254-8b70-4b1f38be43eb] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:54:59.135435 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c03739f0-c9f0-4a03-b560-a5c976d62ad0 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:54:59.135885 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c03739f0-c9f0-4a03-b560-a5c976d62ad0 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:54:59.136658 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c03739f0-c9f0-4a03-b560-a5c976d62ad0 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:54:59.137196 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c03739f0-c9f0-4a03-b560-a5c976d62ad0 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:54:59.276901 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c03739f0-c9f0-4a03-b560-a5c976d62ad0 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:54:59.284301 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c03739f0-c9f0-4a03-b560-a5c976d62ad0 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb" status: 200 len: 1364 microversion: 2.1 time: 0.161935 Apr 08 11:54:59.284870 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1903/2839] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:54:59 2022] GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:55:00.301858 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-aa4f9976-78db-43dd-ac41-204488d7fbb6 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:00.302508 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-aa4f9976-78db-43dd-ac41-204488d7fbb6 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: 75f28f3c-9647-4254-8b70-4b1f38be43eb] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:00.308896 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aa4f9976-78db-43dd-ac41-204488d7fbb6 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:00.309341 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aa4f9976-78db-43dd-ac41-204488d7fbb6 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:00.310176 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aa4f9976-78db-43dd-ac41-204488d7fbb6 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:00.310621 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aa4f9976-78db-43dd-ac41-204488d7fbb6 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:00.443669 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-aa4f9976-78db-43dd-ac41-204488d7fbb6 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:55:00.451922 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-aa4f9976-78db-43dd-ac41-204488d7fbb6 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb" status: 200 len: 1364 microversion: 2.1 time: 0.154054 Apr 08 11:55:00.452761 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1904/2840] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:55:00 2022] GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:55:00.580979 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-14356905-8903-45ed-b0e0-e98eb1a06427 req-ab62c9ab-20d7-46ed-833d-9557a81bf52e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75f28f3c-9647-4254-8b70-4b1f38be43eb", "name": "network-vif-plugged", "status": "completed", "tag": "46820bbd-ab2e-4ce5-a8cb-5306f4130e88"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:55:00.589121 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-14356905-8903-45ed-b0e0-e98eb1a06427 req-ab62c9ab-20d7-46ed-833d-9557a81bf52e service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:00.589567 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-14356905-8903-45ed-b0e0-e98eb1a06427 req-ab62c9ab-20d7-46ed-833d-9557a81bf52e service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:00.600133 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-14356905-8903-45ed-b0e0-e98eb1a06427 req-ab62c9ab-20d7-46ed-833d-9557a81bf52e service nova] Creating event network-vif-plugged:46820bbd-ab2e-4ce5-a8cb-5306f4130e88 for instance 75f28f3c-9647-4254-8b70-4b1f38be43eb on hv-cinder-83607 Apr 08 11:55:00.606026 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-14356905-8903-45ed-b0e0-e98eb1a06427 req-ab62c9ab-20d7-46ed-833d-9557a81bf52e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151502 Apr 08 11:55:00.606629 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1905/2841] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:55:01.471198 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ec251c79-e25e-45ef-9b44-68ca2c5e1c1c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:01.471908 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ec251c79-e25e-45ef-9b44-68ca2c5e1c1c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: 75f28f3c-9647-4254-8b70-4b1f38be43eb] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:01.478776 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ec251c79-e25e-45ef-9b44-68ca2c5e1c1c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:01.479173 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ec251c79-e25e-45ef-9b44-68ca2c5e1c1c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:01.479945 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ec251c79-e25e-45ef-9b44-68ca2c5e1c1c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:01.480387 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ec251c79-e25e-45ef-9b44-68ca2c5e1c1c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:01.611567 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ec251c79-e25e-45ef-9b44-68ca2c5e1c1c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:55:01.618726 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ec251c79-e25e-45ef-9b44-68ca2c5e1c1c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb" status: 200 len: 1364 microversion: 2.1 time: 0.152605 Apr 08 11:55:01.619269 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1906/2842] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:55:01 2022] GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:55:02.635656 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c0db71ea-7c6d-402c-b18a-0ebaedf3b97a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:02.636852 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c0db71ea-7c6d-402c-b18a-0ebaedf3b97a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: 75f28f3c-9647-4254-8b70-4b1f38be43eb] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:02.643502 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c0db71ea-7c6d-402c-b18a-0ebaedf3b97a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:02.643955 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c0db71ea-7c6d-402c-b18a-0ebaedf3b97a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:02.644731 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c0db71ea-7c6d-402c-b18a-0ebaedf3b97a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:02.645165 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c0db71ea-7c6d-402c-b18a-0ebaedf3b97a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:02.790154 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c0db71ea-7c6d-402c-b18a-0ebaedf3b97a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:55:02.799851 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c0db71ea-7c6d-402c-b18a-0ebaedf3b97a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb" status: 200 len: 1364 microversion: 2.1 time: 0.168124 Apr 08 11:55:02.800977 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1907/2843] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:55:02 2022] GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:55:03.816910 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d3fcaa4f-df1d-4335-9ed4-e62b989cd230 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:03.817581 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d3fcaa4f-df1d-4335-9ed4-e62b989cd230 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: 75f28f3c-9647-4254-8b70-4b1f38be43eb] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:03.824469 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d3fcaa4f-df1d-4335-9ed4-e62b989cd230 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:03.824923 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d3fcaa4f-df1d-4335-9ed4-e62b989cd230 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:03.825691 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d3fcaa4f-df1d-4335-9ed4-e62b989cd230 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:03.826159 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d3fcaa4f-df1d-4335-9ed4-e62b989cd230 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:04.143306 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d3fcaa4f-df1d-4335-9ed4-e62b989cd230 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:55:04.151547 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d3fcaa4f-df1d-4335-9ed4-e62b989cd230 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb" status: 200 len: 1550 microversion: 2.1 time: 0.338850 Apr 08 11:55:04.152622 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1908/2844] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:55:03 2022] GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb => generated 1550 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:55:04.168600 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-53a7ae30-98c1-48f3-97ca-5e3f15f3859b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:04.169091 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-53a7ae30-98c1-48f3-97ca-5e3f15f3859b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: 75f28f3c-9647-4254-8b70-4b1f38be43eb] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:04.174935 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-53a7ae30-98c1-48f3-97ca-5e3f15f3859b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:04.175449 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-53a7ae30-98c1-48f3-97ca-5e3f15f3859b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:04.176258 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-53a7ae30-98c1-48f3-97ca-5e3f15f3859b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:04.176702 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-53a7ae30-98c1-48f3-97ca-5e3f15f3859b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:04.281521 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-53a7ae30-98c1-48f3-97ca-5e3f15f3859b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.117330 Apr 08 11:55:04.282154 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1909/2845] 10.222.0.46 () {58 vars in 1274 bytes} [Fri Apr 8 11:55:04 2022] GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb/os-interface => generated 285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:55:05.611264 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-3e8dc864-9844-4898-83cf-ff0b0919cfb4 req-fc3878cb-5f56-4aef-bd7b-9dc38a134b3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75f28f3c-9647-4254-8b70-4b1f38be43eb", "tag": "46820bbd-ab2e-4ce5-a8cb-5306f4130e88"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:55:05.619721 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-3e8dc864-9844-4898-83cf-ff0b0919cfb4 req-fc3878cb-5f56-4aef-bd7b-9dc38a134b3a service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:05.620171 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-3e8dc864-9844-4898-83cf-ff0b0919cfb4 req-fc3878cb-5f56-4aef-bd7b-9dc38a134b3a service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:05.631972 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-3e8dc864-9844-4898-83cf-ff0b0919cfb4 req-fc3878cb-5f56-4aef-bd7b-9dc38a134b3a service nova] Creating event network-changed:46820bbd-ab2e-4ce5-a8cb-5306f4130e88 for instance 75f28f3c-9647-4254-8b70-4b1f38be43eb on hv-cinder-83607 Apr 08 11:55:05.637065 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-3e8dc864-9844-4898-83cf-ff0b0919cfb4 req-fc3878cb-5f56-4aef-bd7b-9dc38a134b3a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088466 Apr 08 11:55:05.637745 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1910/2846] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:55:14.980692 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4c8685b0-acd5-4b67-880e-45b150776561 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1021412863", "imageRef": "35b8d8d2-a0e9-4c3e-8586-5e088dec27e6", "flavorRef": "452", "networks": [{"uuid": "2fe1a5dd-0c05-4087-a540-02120ee56bca"}]}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:55:15.032264 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.network.neutron [None req-4c8685b0-acd5-4b67-880e-45b150776561 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] validate_networks() for [('2fe1a5dd-0c05-4087-a540-02120ee56bca', None, None, None, None, None)] {{(pid=117800) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 08 11:55:15.640053 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-4c8685b0-acd5-4b67-880e-45b150776561 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Flavor limits 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 11:55:15.640480 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-4c8685b0-acd5-4b67-880e-45b150776561 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Image limits 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 11:55:15.640952 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-4c8685b0-acd5-4b67-880e-45b150776561 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Flavor pref 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 11:55:15.641360 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-4c8685b0-acd5-4b67-880e-45b150776561 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Image pref 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 11:55:15.641789 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-4c8685b0-acd5-4b67-880e-45b150776561 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 11:55:15.651306 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4c8685b0-acd5-4b67-880e-45b150776561 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:15.651750 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4c8685b0-acd5-4b67-880e-45b150776561 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:15.652534 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4c8685b0-acd5-4b67-880e-45b150776561 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:15.652978 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4c8685b0-acd5-4b67-880e-45b150776561 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:15.669131 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-4c8685b0-acd5-4b67-880e-45b150776561 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Getting quotas for project 628fc0d9593f4593835f41c45ecc4ca8. Resources: {'instances', 'ram', 'cores'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 11:55:15.672983 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-4c8685b0-acd5-4b67-880e-45b150776561 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Getting quotas for user 6a2bebb9df0049b699bb30e7fea39dde and project 628fc0d9593f4593835f41c45ecc4ca8. Resources: {'instances', 'ram', 'cores'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 11:55:15.684220 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4c8685b0-acd5-4b67-880e-45b150776561 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Going to run 1 instances... {{(pid=117800) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 08 11:55:15.686563 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4c8685b0-acd5-4b67-880e-45b150776561 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] [instance: f8e8735f-ea30-46e1-8ef4-8808c7cd3e72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='35b8d8d2-a0e9-4c3e-8586-5e088dec27e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 08 11:55:15.783720 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4c8685b0-acd5-4b67-880e-45b150776561 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.807676 Apr 08 11:55:15.784552 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1911/2847] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Apr 8 11:55:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 08 11:55:15.794707 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3660c296-068e-4498-b85a-78161aee7efc tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:15.795479 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3660c296-068e-4498-b85a-78161aee7efc tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] [instance: f8e8735f-ea30-46e1-8ef4-8808c7cd3e72] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:15.846181 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3660c296-068e-4498-b85a-78161aee7efc tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bebb9df0049b699bb30e7fea39dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628fc0d9593f4593835f41c45ecc4ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:55:15.855035 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3660c296-068e-4498-b85a-78161aee7efc tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] 10.222.0.46 "GET /compute/v2.1/servers/f8e8735f-ea30-46e1-8ef4-8808c7cd3e72" status: 200 len: 1214 microversion: 2.1 time: 0.063884 Apr 08 11:55:15.855613 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1912/2848] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:55:15 2022] GET /compute/v2.1/servers/f8e8735f-ea30-46e1-8ef4-8808c7cd3e72 => generated 1214 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:55:16.872198 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3c129d68-a42a-41fd-ac85-b2f651dd7255 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:16.872898 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3c129d68-a42a-41fd-ac85-b2f651dd7255 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] [instance: f8e8735f-ea30-46e1-8ef4-8808c7cd3e72] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:16.879686 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3c129d68-a42a-41fd-ac85-b2f651dd7255 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:16.880149 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3c129d68-a42a-41fd-ac85-b2f651dd7255 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:16.880922 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3c129d68-a42a-41fd-ac85-b2f651dd7255 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:16.881368 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3c129d68-a42a-41fd-ac85-b2f651dd7255 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:16.940975 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3c129d68-a42a-41fd-ac85-b2f651dd7255 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bebb9df0049b699bb30e7fea39dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628fc0d9593f4593835f41c45ecc4ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:55:16.948630 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3c129d68-a42a-41fd-ac85-b2f651dd7255 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] 10.222.0.46 "GET /compute/v2.1/servers/f8e8735f-ea30-46e1-8ef4-8808c7cd3e72" status: 200 len: 1218 microversion: 2.1 time: 0.081372 Apr 08 11:55:16.949204 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1913/2849] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:55:16 2022] GET /compute/v2.1/servers/f8e8735f-ea30-46e1-8ef4-8808c7cd3e72 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:55:17.965416 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2fad40e3-02b3-4be9-8e9f-7fc69d0616b3 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:17.966118 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2fad40e3-02b3-4be9-8e9f-7fc69d0616b3 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] [instance: f8e8735f-ea30-46e1-8ef4-8808c7cd3e72] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:17.972361 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2fad40e3-02b3-4be9-8e9f-7fc69d0616b3 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:17.972815 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2fad40e3-02b3-4be9-8e9f-7fc69d0616b3 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:17.973590 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2fad40e3-02b3-4be9-8e9f-7fc69d0616b3 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:17.974060 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2fad40e3-02b3-4be9-8e9f-7fc69d0616b3 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:18.044399 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2fad40e3-02b3-4be9-8e9f-7fc69d0616b3 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bebb9df0049b699bb30e7fea39dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628fc0d9593f4593835f41c45ecc4ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:55:18.051950 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2fad40e3-02b3-4be9-8e9f-7fc69d0616b3 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] 10.222.0.46 "GET /compute/v2.1/servers/f8e8735f-ea30-46e1-8ef4-8808c7cd3e72" status: 200 len: 1274 microversion: 2.1 time: 0.090488 Apr 08 11:55:18.052528 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1914/2850] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:55:17 2022] GET /compute/v2.1/servers/f8e8735f-ea30-46e1-8ef4-8808c7cd3e72 => generated 1274 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:55:19.070323 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-cec42d44-4245-4c7f-a5c4-9e6e383b79a5 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:19.071029 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-cec42d44-4245-4c7f-a5c4-9e6e383b79a5 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] [instance: f8e8735f-ea30-46e1-8ef4-8808c7cd3e72] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:19.077940 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cec42d44-4245-4c7f-a5c4-9e6e383b79a5 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:19.078392 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cec42d44-4245-4c7f-a5c4-9e6e383b79a5 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:19.079193 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cec42d44-4245-4c7f-a5c4-9e6e383b79a5 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:19.079678 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cec42d44-4245-4c7f-a5c4-9e6e383b79a5 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:19.314219 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-cec42d44-4245-4c7f-a5c4-9e6e383b79a5 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bebb9df0049b699bb30e7fea39dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628fc0d9593f4593835f41c45ecc4ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:55:19.323565 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-cec42d44-4245-4c7f-a5c4-9e6e383b79a5 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] 10.222.0.46 "GET /compute/v2.1/servers/f8e8735f-ea30-46e1-8ef4-8808c7cd3e72" status: 200 len: 1314 microversion: 2.1 time: 0.257395 Apr 08 11:55:19.324331 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1915/2851] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:55:19 2022] GET /compute/v2.1/servers/f8e8735f-ea30-46e1-8ef4-8808c7cd3e72 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:55:19.876338 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-1cac2438-8141-454b-92df-300b0a9825a5 req-c54c5130-c5ce-43ac-a070-bf0b49ed37ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8e8735f-ea30-46e1-8ef4-8808c7cd3e72", "tag": "a02fbf89-6a93-45d2-bd0e-217d060ff97f"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:55:19.885090 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-1cac2438-8141-454b-92df-300b0a9825a5 req-c54c5130-c5ce-43ac-a070-bf0b49ed37ef service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:19.885629 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-1cac2438-8141-454b-92df-300b0a9825a5 req-c54c5130-c5ce-43ac-a070-bf0b49ed37ef service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:19.898435 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-1cac2438-8141-454b-92df-300b0a9825a5 req-c54c5130-c5ce-43ac-a070-bf0b49ed37ef service nova] Creating event network-changed:a02fbf89-6a93-45d2-bd0e-217d060ff97f for instance f8e8735f-ea30-46e1-8ef4-8808c7cd3e72 on hv-cinder-83607 Apr 08 11:55:19.903362 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-1cac2438-8141-454b-92df-300b0a9825a5 req-c54c5130-c5ce-43ac-a070-bf0b49ed37ef service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031429 Apr 08 11:55:19.903952 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1916/2852] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:55:20.360600 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6935d42c-3332-490b-b39e-8197e7e0efd2 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:20.361489 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6935d42c-3332-490b-b39e-8197e7e0efd2 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] [instance: f8e8735f-ea30-46e1-8ef4-8808c7cd3e72] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:20.367624 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6935d42c-3332-490b-b39e-8197e7e0efd2 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:20.368071 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6935d42c-3332-490b-b39e-8197e7e0efd2 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:20.368849 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6935d42c-3332-490b-b39e-8197e7e0efd2 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:20.369286 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6935d42c-3332-490b-b39e-8197e7e0efd2 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:20.592795 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6935d42c-3332-490b-b39e-8197e7e0efd2 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bebb9df0049b699bb30e7fea39dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628fc0d9593f4593835f41c45ecc4ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:55:20.600042 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6935d42c-3332-490b-b39e-8197e7e0efd2 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] 10.222.0.46 "GET /compute/v2.1/servers/f8e8735f-ea30-46e1-8ef4-8808c7cd3e72" status: 200 len: 1314 microversion: 2.1 time: 0.244622 Apr 08 11:55:20.600622 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1917/2853] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:55:20 2022] GET /compute/v2.1/servers/f8e8735f-ea30-46e1-8ef4-8808c7cd3e72 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:55:21.616596 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-31122095-dd62-420f-9116-0eb9d89b92e3 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:21.617326 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-31122095-dd62-420f-9116-0eb9d89b92e3 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] [instance: f8e8735f-ea30-46e1-8ef4-8808c7cd3e72] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:21.624162 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-31122095-dd62-420f-9116-0eb9d89b92e3 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:21.624620 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-31122095-dd62-420f-9116-0eb9d89b92e3 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:21.625387 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-31122095-dd62-420f-9116-0eb9d89b92e3 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:21.625861 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-31122095-dd62-420f-9116-0eb9d89b92e3 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:21.756423 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-31122095-dd62-420f-9116-0eb9d89b92e3 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bebb9df0049b699bb30e7fea39dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628fc0d9593f4593835f41c45ecc4ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:55:21.764045 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-31122095-dd62-420f-9116-0eb9d89b92e3 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] 10.222.0.46 "GET /compute/v2.1/servers/f8e8735f-ea30-46e1-8ef4-8808c7cd3e72" status: 200 len: 1314 microversion: 2.1 time: 0.151253 Apr 08 11:55:21.764606 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1918/2854] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:55:21 2022] GET /compute/v2.1/servers/f8e8735f-ea30-46e1-8ef4-8808c7cd3e72 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:55:22.781384 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-360d3ba2-861c-43b0-b7e9-3e5c713bdae8 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:22.782092 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-360d3ba2-861c-43b0-b7e9-3e5c713bdae8 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] [instance: f8e8735f-ea30-46e1-8ef4-8808c7cd3e72] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:22.788688 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-360d3ba2-861c-43b0-b7e9-3e5c713bdae8 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:22.789146 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-360d3ba2-861c-43b0-b7e9-3e5c713bdae8 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:22.789958 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-360d3ba2-861c-43b0-b7e9-3e5c713bdae8 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:22.790405 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-360d3ba2-861c-43b0-b7e9-3e5c713bdae8 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:22.925234 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-360d3ba2-861c-43b0-b7e9-3e5c713bdae8 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bebb9df0049b699bb30e7fea39dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628fc0d9593f4593835f41c45ecc4ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:55:22.932414 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-360d3ba2-861c-43b0-b7e9-3e5c713bdae8 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] 10.222.0.46 "GET /compute/v2.1/servers/f8e8735f-ea30-46e1-8ef4-8808c7cd3e72" status: 200 len: 1314 microversion: 2.1 time: 0.155511 Apr 08 11:55:22.932974 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1919/2855] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:55:22 2022] GET /compute/v2.1/servers/f8e8735f-ea30-46e1-8ef4-8808c7cd3e72 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:55:23.949010 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-824ce4e7-e36d-4e6b-96ed-0338aae76595 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:23.949736 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-824ce4e7-e36d-4e6b-96ed-0338aae76595 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] [instance: f8e8735f-ea30-46e1-8ef4-8808c7cd3e72] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:23.956038 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-824ce4e7-e36d-4e6b-96ed-0338aae76595 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:23.956493 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-824ce4e7-e36d-4e6b-96ed-0338aae76595 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:23.957261 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-824ce4e7-e36d-4e6b-96ed-0338aae76595 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:23.957701 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-824ce4e7-e36d-4e6b-96ed-0338aae76595 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:24.088127 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-824ce4e7-e36d-4e6b-96ed-0338aae76595 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bebb9df0049b699bb30e7fea39dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628fc0d9593f4593835f41c45ecc4ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:55:24.095814 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-824ce4e7-e36d-4e6b-96ed-0338aae76595 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] 10.222.0.46 "GET /compute/v2.1/servers/f8e8735f-ea30-46e1-8ef4-8808c7cd3e72" status: 200 len: 1314 microversion: 2.1 time: 0.150704 Apr 08 11:55:24.096375 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1920/2856] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:55:23 2022] GET /compute/v2.1/servers/f8e8735f-ea30-46e1-8ef4-8808c7cd3e72 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:55:25.112228 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-01131b2e-9f5d-4731-9f24-3c4146405bb0 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:25.112895 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-01131b2e-9f5d-4731-9f24-3c4146405bb0 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] [instance: f8e8735f-ea30-46e1-8ef4-8808c7cd3e72] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:25.118945 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-01131b2e-9f5d-4731-9f24-3c4146405bb0 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:25.119392 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-01131b2e-9f5d-4731-9f24-3c4146405bb0 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:25.120156 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-01131b2e-9f5d-4731-9f24-3c4146405bb0 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:25.120589 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-01131b2e-9f5d-4731-9f24-3c4146405bb0 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:25.263652 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-01131b2e-9f5d-4731-9f24-3c4146405bb0 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bebb9df0049b699bb30e7fea39dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628fc0d9593f4593835f41c45ecc4ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:55:25.271620 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-01131b2e-9f5d-4731-9f24-3c4146405bb0 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] 10.222.0.46 "GET /compute/v2.1/servers/f8e8735f-ea30-46e1-8ef4-8808c7cd3e72" status: 200 len: 1314 microversion: 2.1 time: 0.163203 Apr 08 11:55:25.272207 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1921/2857] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:55:25 2022] GET /compute/v2.1/servers/f8e8735f-ea30-46e1-8ef4-8808c7cd3e72 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:55:26.289059 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d8cc7006-3d55-45fd-a3d7-f1e8e4b6127b tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:26.289753 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d8cc7006-3d55-45fd-a3d7-f1e8e4b6127b tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] [instance: f8e8735f-ea30-46e1-8ef4-8808c7cd3e72] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:26.296564 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d8cc7006-3d55-45fd-a3d7-f1e8e4b6127b tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:26.297015 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d8cc7006-3d55-45fd-a3d7-f1e8e4b6127b tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:26.297809 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d8cc7006-3d55-45fd-a3d7-f1e8e4b6127b tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:26.298855 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d8cc7006-3d55-45fd-a3d7-f1e8e4b6127b tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:26.433642 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d8cc7006-3d55-45fd-a3d7-f1e8e4b6127b tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bebb9df0049b699bb30e7fea39dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628fc0d9593f4593835f41c45ecc4ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:55:26.440957 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d8cc7006-3d55-45fd-a3d7-f1e8e4b6127b tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] 10.222.0.46 "GET /compute/v2.1/servers/f8e8735f-ea30-46e1-8ef4-8808c7cd3e72" status: 200 len: 1314 microversion: 2.1 time: 0.156223 Apr 08 11:55:26.441749 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1922/2858] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:55:26 2022] GET /compute/v2.1/servers/f8e8735f-ea30-46e1-8ef4-8808c7cd3e72 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:55:26.504374 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-f07776e7-8cb9-417a-a289-8c9f3734c051 req-04584eb9-2868-47e4-ac35-034fff46d239 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8e8735f-ea30-46e1-8ef4-8808c7cd3e72", "name": "network-vif-plugged", "status": "completed", "tag": "a02fbf89-6a93-45d2-bd0e-217d060ff97f"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:55:26.512368 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-f07776e7-8cb9-417a-a289-8c9f3734c051 req-04584eb9-2868-47e4-ac35-034fff46d239 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:26.512783 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-f07776e7-8cb9-417a-a289-8c9f3734c051 req-04584eb9-2868-47e4-ac35-034fff46d239 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:26.523601 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-f07776e7-8cb9-417a-a289-8c9f3734c051 req-04584eb9-2868-47e4-ac35-034fff46d239 service nova] Creating event network-vif-plugged:a02fbf89-6a93-45d2-bd0e-217d060ff97f for instance f8e8735f-ea30-46e1-8ef4-8808c7cd3e72 on hv-cinder-83607 Apr 08 11:55:26.529244 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-f07776e7-8cb9-417a-a289-8c9f3734c051 req-04584eb9-2868-47e4-ac35-034fff46d239 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028518 Apr 08 11:55:26.529870 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1923/2859] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:55:27.458523 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a25286f5-2bdb-4870-b301-43074470e928 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:27.459212 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a25286f5-2bdb-4870-b301-43074470e928 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] [instance: f8e8735f-ea30-46e1-8ef4-8808c7cd3e72] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:27.465316 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a25286f5-2bdb-4870-b301-43074470e928 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:27.465761 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a25286f5-2bdb-4870-b301-43074470e928 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:27.466533 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a25286f5-2bdb-4870-b301-43074470e928 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:27.466975 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a25286f5-2bdb-4870-b301-43074470e928 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:27.597186 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a25286f5-2bdb-4870-b301-43074470e928 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bebb9df0049b699bb30e7fea39dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628fc0d9593f4593835f41c45ecc4ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:55:27.604347 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a25286f5-2bdb-4870-b301-43074470e928 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] 10.222.0.46 "GET /compute/v2.1/servers/f8e8735f-ea30-46e1-8ef4-8808c7cd3e72" status: 200 len: 1314 microversion: 2.1 time: 0.150427 Apr 08 11:55:27.604912 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1924/2860] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:55:27 2022] GET /compute/v2.1/servers/f8e8735f-ea30-46e1-8ef4-8808c7cd3e72 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:55:28.621539 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d4d79c18-9e47-47e8-b4a1-cff0d9081c96 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:28.622298 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d4d79c18-9e47-47e8-b4a1-cff0d9081c96 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] [instance: f8e8735f-ea30-46e1-8ef4-8808c7cd3e72] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:28.628880 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d4d79c18-9e47-47e8-b4a1-cff0d9081c96 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:28.629330 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d4d79c18-9e47-47e8-b4a1-cff0d9081c96 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:28.630127 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d4d79c18-9e47-47e8-b4a1-cff0d9081c96 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:28.630564 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d4d79c18-9e47-47e8-b4a1-cff0d9081c96 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:28.768543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d4d79c18-9e47-47e8-b4a1-cff0d9081c96 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bebb9df0049b699bb30e7fea39dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628fc0d9593f4593835f41c45ecc4ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:55:28.775883 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d4d79c18-9e47-47e8-b4a1-cff0d9081c96 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] 10.222.0.46 "GET /compute/v2.1/servers/f8e8735f-ea30-46e1-8ef4-8808c7cd3e72" status: 200 len: 1314 microversion: 2.1 time: 0.158175 Apr 08 11:55:28.776621 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1925/2861] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:55:28 2022] GET /compute/v2.1/servers/f8e8735f-ea30-46e1-8ef4-8808c7cd3e72 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:55:29.792701 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ae3e3a89-9cd2-4530-8d1a-67e02825e7b9 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:29.793439 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ae3e3a89-9cd2-4530-8d1a-67e02825e7b9 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] [instance: f8e8735f-ea30-46e1-8ef4-8808c7cd3e72] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:29.800188 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ae3e3a89-9cd2-4530-8d1a-67e02825e7b9 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:29.800639 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ae3e3a89-9cd2-4530-8d1a-67e02825e7b9 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:29.801492 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ae3e3a89-9cd2-4530-8d1a-67e02825e7b9 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:29.801894 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ae3e3a89-9cd2-4530-8d1a-67e02825e7b9 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:29.940360 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ae3e3a89-9cd2-4530-8d1a-67e02825e7b9 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bebb9df0049b699bb30e7fea39dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628fc0d9593f4593835f41c45ecc4ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:55:29.947598 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ae3e3a89-9cd2-4530-8d1a-67e02825e7b9 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] 10.222.0.46 "GET /compute/v2.1/servers/f8e8735f-ea30-46e1-8ef4-8808c7cd3e72" status: 200 len: 1498 microversion: 2.1 time: 0.158809 Apr 08 11:55:29.948177 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1926/2862] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:55:29 2022] GET /compute/v2.1/servers/f8e8735f-ea30-46e1-8ef4-8808c7cd3e72 => generated 1498 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:55:30.817180 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-86d25c37-badb-49f4-ba0a-5d0b23d763ab tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:30.817860 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-86d25c37-badb-49f4-ba0a-5d0b23d763ab tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] [instance: f8e8735f-ea30-46e1-8ef4-8808c7cd3e72] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:30.824094 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-86d25c37-badb-49f4-ba0a-5d0b23d763ab tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:30.824547 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-86d25c37-badb-49f4-ba0a-5d0b23d763ab tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:30.825310 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-86d25c37-badb-49f4-ba0a-5d0b23d763ab tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:30.826400 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-86d25c37-badb-49f4-ba0a-5d0b23d763ab tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:30.849720 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-86d25c37-badb-49f4-ba0a-5d0b23d763ab tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] [instance: f8e8735f-ea30-46e1-8ef4-8808c7cd3e72] Going to try to terminate instance {{(pid=117800) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 08 11:55:31.151215 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-86d25c37-badb-49f4-ba0a-5d0b23d763ab tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f8e8735f-ea30-46e1-8ef4-8808c7cd3e72" status: 204 len: 0 microversion: 2.1 time: 0.337443 Apr 08 11:55:31.151750 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1927/2863] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 8 11:55:30 2022] DELETE /compute/v2.1/servers/f8e8735f-ea30-46e1-8ef4-8808c7cd3e72 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 08 11:55:31.160125 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ac9098ee-cc21-4663-922e-45a2bcd4c324 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:31.160798 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ac9098ee-cc21-4663-922e-45a2bcd4c324 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] [instance: f8e8735f-ea30-46e1-8ef4-8808c7cd3e72] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:31.167050 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ac9098ee-cc21-4663-922e-45a2bcd4c324 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:31.167503 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ac9098ee-cc21-4663-922e-45a2bcd4c324 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:31.168276 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ac9098ee-cc21-4663-922e-45a2bcd4c324 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:31.168720 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ac9098ee-cc21-4663-922e-45a2bcd4c324 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:31.303533 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ac9098ee-cc21-4663-922e-45a2bcd4c324 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bebb9df0049b699bb30e7fea39dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628fc0d9593f4593835f41c45ecc4ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:55:31.311327 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ac9098ee-cc21-4663-922e-45a2bcd4c324 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] 10.222.0.46 "GET /compute/v2.1/servers/f8e8735f-ea30-46e1-8ef4-8808c7cd3e72" status: 200 len: 1504 microversion: 2.1 time: 0.155305 Apr 08 11:55:31.311883 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1928/2864] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:55:31 2022] GET /compute/v2.1/servers/f8e8735f-ea30-46e1-8ef4-8808c7cd3e72 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:55:32.329011 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-45906df7-d938-48b4-962d-d259ebbec46c tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:32.329703 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-45906df7-d938-48b4-962d-d259ebbec46c tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] [instance: f8e8735f-ea30-46e1-8ef4-8808c7cd3e72] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:32.336040 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-45906df7-d938-48b4-962d-d259ebbec46c tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:32.336494 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-45906df7-d938-48b4-962d-d259ebbec46c tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:32.337265 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-45906df7-d938-48b4-962d-d259ebbec46c tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:32.337704 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-45906df7-d938-48b4-962d-d259ebbec46c tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:32.472628 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-45906df7-d938-48b4-962d-d259ebbec46c tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bebb9df0049b699bb30e7fea39dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628fc0d9593f4593835f41c45ecc4ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:55:32.479888 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-45906df7-d938-48b4-962d-d259ebbec46c tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] 10.222.0.46 "GET /compute/v2.1/servers/f8e8735f-ea30-46e1-8ef4-8808c7cd3e72" status: 200 len: 1504 microversion: 2.1 time: 0.155407 Apr 08 11:55:32.480452 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1929/2865] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:55:32 2022] GET /compute/v2.1/servers/f8e8735f-ea30-46e1-8ef4-8808c7cd3e72 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:55:33.356352 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-aa4ead05-a9bc-47f3-b209-f0c2bcbce22b req-dce3760f-b9aa-4ab4-8647-60a856d5e8fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8e8735f-ea30-46e1-8ef4-8808c7cd3e72", "name": "network-vif-deleted", "tag": "a02fbf89-6a93-45d2-bd0e-217d060ff97f"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:55:33.364558 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-aa4ead05-a9bc-47f3-b209-f0c2bcbce22b req-dce3760f-b9aa-4ab4-8647-60a856d5e8fe service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:33.365007 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-aa4ead05-a9bc-47f3-b209-f0c2bcbce22b req-dce3760f-b9aa-4ab4-8647-60a856d5e8fe service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:33.376145 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-aa4ead05-a9bc-47f3-b209-f0c2bcbce22b req-dce3760f-b9aa-4ab4-8647-60a856d5e8fe service nova] Creating event network-vif-deleted:a02fbf89-6a93-45d2-bd0e-217d060ff97f for instance f8e8735f-ea30-46e1-8ef4-8808c7cd3e72 on hv-cinder-83607 Apr 08 11:55:33.381008 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-aa4ead05-a9bc-47f3-b209-f0c2bcbce22b req-dce3760f-b9aa-4ab4-8647-60a856d5e8fe service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028267 Apr 08 11:55:33.381558 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1930/2866] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:55:33.497731 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-090d3b4d-b079-4734-99a2-5abe4cf8aeb8 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:33.498405 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-090d3b4d-b079-4734-99a2-5abe4cf8aeb8 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] [instance: f8e8735f-ea30-46e1-8ef4-8808c7cd3e72] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:33.504619 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-090d3b4d-b079-4734-99a2-5abe4cf8aeb8 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:33.505071 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-090d3b4d-b079-4734-99a2-5abe4cf8aeb8 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:33.506014 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-090d3b4d-b079-4734-99a2-5abe4cf8aeb8 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:33.506464 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-090d3b4d-b079-4734-99a2-5abe4cf8aeb8 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:33.572290 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-090d3b4d-b079-4734-99a2-5abe4cf8aeb8 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bebb9df0049b699bb30e7fea39dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628fc0d9593f4593835f41c45ecc4ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:55:33.579801 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-090d3b4d-b079-4734-99a2-5abe4cf8aeb8 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] 10.222.0.46 "GET /compute/v2.1/servers/f8e8735f-ea30-46e1-8ef4-8808c7cd3e72" status: 200 len: 1299 microversion: 2.1 time: 0.087030 Apr 08 11:55:33.580374 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1931/2867] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:55:33 2022] GET /compute/v2.1/servers/f8e8735f-ea30-46e1-8ef4-8808c7cd3e72 => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:55:34.596540 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5b76d77f-59c1-40ba-89f8-fae46c85f8db tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:34.597265 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5b76d77f-59c1-40ba-89f8-fae46c85f8db tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] [instance: f8e8735f-ea30-46e1-8ef4-8808c7cd3e72] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:34.603557 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5b76d77f-59c1-40ba-89f8-fae46c85f8db tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:34.604004 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5b76d77f-59c1-40ba-89f8-fae46c85f8db tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:34.604776 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5b76d77f-59c1-40ba-89f8-fae46c85f8db tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:34.605213 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5b76d77f-59c1-40ba-89f8-fae46c85f8db tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:34.621337 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-5b76d77f-59c1-40ba-89f8-fae46c85f8db tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] HTTP exception thrown: Instance f8e8735f-ea30-46e1-8ef4-8808c7cd3e72 could not be found. Apr 08 11:55:34.622556 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5b76d77f-59c1-40ba-89f8-fae46c85f8db tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Returning 404 to user: Instance f8e8735f-ea30-46e1-8ef4-8808c7cd3e72 could not be found. {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:55:34.623405 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5b76d77f-59c1-40ba-89f8-fae46c85f8db tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] 10.222.0.46 "GET /compute/v2.1/servers/f8e8735f-ea30-46e1-8ef4-8808c7cd3e72" status: 404 len: 111 microversion: 2.1 time: 0.030758 Apr 08 11:55:34.623953 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1932/2868] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:55:34 2022] GET /compute/v2.1/servers/f8e8735f-ea30-46e1-8ef4-8808c7cd3e72 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 11:55:34.675224 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-36a651fe-a085-45d7-9ce0-1bdd0362afd3 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-307251789", "imageRef": "35b8d8d2-a0e9-4c3e-8586-5e088dec27e6", "flavorRef": "452", "networks": [{"uuid": "2fe1a5dd-0c05-4087-a540-02120ee56bca"}]}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:55:34.724998 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.network.neutron [None req-36a651fe-a085-45d7-9ce0-1bdd0362afd3 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] validate_networks() for [('2fe1a5dd-0c05-4087-a540-02120ee56bca', None, None, None, None, None)] {{(pid=117800) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 08 11:55:35.073707 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-36a651fe-a085-45d7-9ce0-1bdd0362afd3 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Flavor limits 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 11:55:35.074326 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-36a651fe-a085-45d7-9ce0-1bdd0362afd3 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Image limits 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 11:55:35.074807 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-36a651fe-a085-45d7-9ce0-1bdd0362afd3 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Flavor pref 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 11:55:35.075940 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-36a651fe-a085-45d7-9ce0-1bdd0362afd3 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Image pref 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 11:55:35.076358 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-36a651fe-a085-45d7-9ce0-1bdd0362afd3 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 11:55:35.085547 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-36a651fe-a085-45d7-9ce0-1bdd0362afd3 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:35.086270 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-36a651fe-a085-45d7-9ce0-1bdd0362afd3 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:35.087077 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-36a651fe-a085-45d7-9ce0-1bdd0362afd3 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:35.087514 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-36a651fe-a085-45d7-9ce0-1bdd0362afd3 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:35.105281 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-36a651fe-a085-45d7-9ce0-1bdd0362afd3 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Getting quotas for project 628fc0d9593f4593835f41c45ecc4ca8. Resources: {'instances', 'ram', 'cores'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 11:55:35.109913 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-36a651fe-a085-45d7-9ce0-1bdd0362afd3 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Getting quotas for user 6a2bebb9df0049b699bb30e7fea39dde and project 628fc0d9593f4593835f41c45ecc4ca8. Resources: {'instances', 'ram', 'cores'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 11:55:35.120982 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-36a651fe-a085-45d7-9ce0-1bdd0362afd3 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Going to run 1 instances... {{(pid=117800) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 08 11:55:35.123295 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-36a651fe-a085-45d7-9ce0-1bdd0362afd3 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] [instance: 442ac6c6-0a92-4998-9641-222eed9500d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='35b8d8d2-a0e9-4c3e-8586-5e088dec27e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 08 11:55:35.256509 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-36a651fe-a085-45d7-9ce0-1bdd0362afd3 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.583760 Apr 08 11:55:35.256509 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1933/2869] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Apr 8 11:55:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 11:55:35.267099 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-82363d54-c0f0-4e5d-86e1-d1970ffc9904 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:35.267635 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-82363d54-c0f0-4e5d-86e1-d1970ffc9904 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] [instance: 442ac6c6-0a92-4998-9641-222eed9500d3] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:35.332194 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-82363d54-c0f0-4e5d-86e1-d1970ffc9904 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bebb9df0049b699bb30e7fea39dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628fc0d9593f4593835f41c45ecc4ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:55:35.339746 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-82363d54-c0f0-4e5d-86e1-d1970ffc9904 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] 10.222.0.46 "GET /compute/v2.1/servers/442ac6c6-0a92-4998-9641-222eed9500d3" status: 200 len: 1213 microversion: 2.1 time: 0.077436 Apr 08 11:55:35.341310 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1934/2870] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:55:35 2022] GET /compute/v2.1/servers/442ac6c6-0a92-4998-9641-222eed9500d3 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:55:36.357325 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a68307bf-e67d-49fd-b304-1d5372eb8eac tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:36.357973 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a68307bf-e67d-49fd-b304-1d5372eb8eac tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] [instance: 442ac6c6-0a92-4998-9641-222eed9500d3] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:36.364470 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a68307bf-e67d-49fd-b304-1d5372eb8eac tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:36.364926 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a68307bf-e67d-49fd-b304-1d5372eb8eac tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:36.365701 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a68307bf-e67d-49fd-b304-1d5372eb8eac tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:36.366245 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a68307bf-e67d-49fd-b304-1d5372eb8eac tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:36.425015 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a68307bf-e67d-49fd-b304-1d5372eb8eac tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bebb9df0049b699bb30e7fea39dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628fc0d9593f4593835f41c45ecc4ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:55:36.432520 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a68307bf-e67d-49fd-b304-1d5372eb8eac tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] 10.222.0.46 "GET /compute/v2.1/servers/442ac6c6-0a92-4998-9641-222eed9500d3" status: 200 len: 1209 microversion: 2.1 time: 0.079163 Apr 08 11:55:36.433094 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1935/2871] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:55:36 2022] GET /compute/v2.1/servers/442ac6c6-0a92-4998-9641-222eed9500d3 => generated 1209 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:55:37.449746 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7b74d5e8-3a30-4659-99c9-2aa5d66b5e99 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:37.451115 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7b74d5e8-3a30-4659-99c9-2aa5d66b5e99 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] [instance: 442ac6c6-0a92-4998-9641-222eed9500d3] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:37.457346 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7b74d5e8-3a30-4659-99c9-2aa5d66b5e99 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:37.458179 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7b74d5e8-3a30-4659-99c9-2aa5d66b5e99 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:37.458606 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7b74d5e8-3a30-4659-99c9-2aa5d66b5e99 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:37.459048 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7b74d5e8-3a30-4659-99c9-2aa5d66b5e99 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:37.531885 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7b74d5e8-3a30-4659-99c9-2aa5d66b5e99 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bebb9df0049b699bb30e7fea39dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628fc0d9593f4593835f41c45ecc4ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:55:37.539503 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7b74d5e8-3a30-4659-99c9-2aa5d66b5e99 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] 10.222.0.46 "GET /compute/v2.1/servers/442ac6c6-0a92-4998-9641-222eed9500d3" status: 200 len: 1271 microversion: 2.1 time: 0.093694 Apr 08 11:55:37.540081 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1936/2872] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:55:37 2022] GET /compute/v2.1/servers/442ac6c6-0a92-4998-9641-222eed9500d3 => generated 1271 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:55:38.556460 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-94a0f0fb-b581-419b-8bb7-11f32cd2d6a6 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:38.557268 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-94a0f0fb-b581-419b-8bb7-11f32cd2d6a6 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] [instance: 442ac6c6-0a92-4998-9641-222eed9500d3] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:38.564253 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-94a0f0fb-b581-419b-8bb7-11f32cd2d6a6 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:38.564628 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-94a0f0fb-b581-419b-8bb7-11f32cd2d6a6 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:38.565393 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-94a0f0fb-b581-419b-8bb7-11f32cd2d6a6 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:38.565855 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-94a0f0fb-b581-419b-8bb7-11f32cd2d6a6 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:38.720864 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-94a0f0fb-b581-419b-8bb7-11f32cd2d6a6 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bebb9df0049b699bb30e7fea39dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628fc0d9593f4593835f41c45ecc4ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:55:38.728569 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-94a0f0fb-b581-419b-8bb7-11f32cd2d6a6 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] 10.222.0.46 "GET /compute/v2.1/servers/442ac6c6-0a92-4998-9641-222eed9500d3" status: 200 len: 1313 microversion: 2.1 time: 0.175935 Apr 08 11:55:38.729151 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1937/2873] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:55:38 2022] GET /compute/v2.1/servers/442ac6c6-0a92-4998-9641-222eed9500d3 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:55:38.770461 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-c0d33027-82ed-4ba6-a54c-6efb3edaa75d req-2e3c67ea-9f01-4e0d-9f46-e2f937486bfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "442ac6c6-0a92-4998-9641-222eed9500d3", "tag": "116d02d1-05d1-4718-a391-cd0ec9be6118"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:55:38.779558 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-c0d33027-82ed-4ba6-a54c-6efb3edaa75d req-2e3c67ea-9f01-4e0d-9f46-e2f937486bfc service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:38.782850 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-c0d33027-82ed-4ba6-a54c-6efb3edaa75d req-2e3c67ea-9f01-4e0d-9f46-e2f937486bfc service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:38.792786 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-c0d33027-82ed-4ba6-a54c-6efb3edaa75d req-2e3c67ea-9f01-4e0d-9f46-e2f937486bfc service nova] Creating event network-changed:116d02d1-05d1-4718-a391-cd0ec9be6118 for instance 442ac6c6-0a92-4998-9641-222eed9500d3 on hv-cinder-83607 Apr 08 11:55:38.798351 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-c0d33027-82ed-4ba6-a54c-6efb3edaa75d req-2e3c67ea-9f01-4e0d-9f46-e2f937486bfc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036601 Apr 08 11:55:38.798985 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1938/2874] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:55:39.746402 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-12f7826a-7dc8-4fbc-91fc-1b674bfaaeb0 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:39.747112 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-12f7826a-7dc8-4fbc-91fc-1b674bfaaeb0 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] [instance: 442ac6c6-0a92-4998-9641-222eed9500d3] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:39.753566 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-12f7826a-7dc8-4fbc-91fc-1b674bfaaeb0 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:39.754051 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-12f7826a-7dc8-4fbc-91fc-1b674bfaaeb0 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:39.754840 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-12f7826a-7dc8-4fbc-91fc-1b674bfaaeb0 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:39.755261 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-12f7826a-7dc8-4fbc-91fc-1b674bfaaeb0 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:39.884429 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-12f7826a-7dc8-4fbc-91fc-1b674bfaaeb0 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bebb9df0049b699bb30e7fea39dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628fc0d9593f4593835f41c45ecc4ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:55:39.891649 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-12f7826a-7dc8-4fbc-91fc-1b674bfaaeb0 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] 10.222.0.46 "GET /compute/v2.1/servers/442ac6c6-0a92-4998-9641-222eed9500d3" status: 200 len: 1313 microversion: 2.1 time: 0.149526 Apr 08 11:55:39.892220 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1939/2875] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:55:39 2022] GET /compute/v2.1/servers/442ac6c6-0a92-4998-9641-222eed9500d3 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:55:40.909242 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-254cf125-609d-4e74-b149-e458b7acbca4 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:40.909918 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-254cf125-609d-4e74-b149-e458b7acbca4 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] [instance: 442ac6c6-0a92-4998-9641-222eed9500d3] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:40.916503 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-254cf125-609d-4e74-b149-e458b7acbca4 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:40.916960 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-254cf125-609d-4e74-b149-e458b7acbca4 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:40.917744 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-254cf125-609d-4e74-b149-e458b7acbca4 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:40.918809 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-254cf125-609d-4e74-b149-e458b7acbca4 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:41.053599 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-254cf125-609d-4e74-b149-e458b7acbca4 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bebb9df0049b699bb30e7fea39dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628fc0d9593f4593835f41c45ecc4ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:55:41.061596 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-254cf125-609d-4e74-b149-e458b7acbca4 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] 10.222.0.46 "GET /compute/v2.1/servers/442ac6c6-0a92-4998-9641-222eed9500d3" status: 200 len: 1313 microversion: 2.1 time: 0.156861 Apr 08 11:55:41.062192 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1940/2876] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:55:40 2022] GET /compute/v2.1/servers/442ac6c6-0a92-4998-9641-222eed9500d3 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:55:42.078833 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d623c9d1-978d-463d-90cc-e62ab8180755 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:42.079527 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d623c9d1-978d-463d-90cc-e62ab8180755 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] [instance: 442ac6c6-0a92-4998-9641-222eed9500d3] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:42.085880 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d623c9d1-978d-463d-90cc-e62ab8180755 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:42.086340 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d623c9d1-978d-463d-90cc-e62ab8180755 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:42.087116 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d623c9d1-978d-463d-90cc-e62ab8180755 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:42.087559 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d623c9d1-978d-463d-90cc-e62ab8180755 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:42.218818 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d623c9d1-978d-463d-90cc-e62ab8180755 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bebb9df0049b699bb30e7fea39dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628fc0d9593f4593835f41c45ecc4ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:55:42.226370 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d623c9d1-978d-463d-90cc-e62ab8180755 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] 10.222.0.46 "GET /compute/v2.1/servers/442ac6c6-0a92-4998-9641-222eed9500d3" status: 200 len: 1313 microversion: 2.1 time: 0.151339 Apr 08 11:55:42.226935 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1941/2877] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:55:42 2022] GET /compute/v2.1/servers/442ac6c6-0a92-4998-9641-222eed9500d3 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:55:43.243112 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-58441d68-35c7-4cda-8fda-fbacf001bd12 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:43.243831 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-58441d68-35c7-4cda-8fda-fbacf001bd12 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] [instance: 442ac6c6-0a92-4998-9641-222eed9500d3] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:43.250383 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-58441d68-35c7-4cda-8fda-fbacf001bd12 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:43.250837 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-58441d68-35c7-4cda-8fda-fbacf001bd12 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:43.251608 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-58441d68-35c7-4cda-8fda-fbacf001bd12 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:43.252044 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-58441d68-35c7-4cda-8fda-fbacf001bd12 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:43.383239 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-58441d68-35c7-4cda-8fda-fbacf001bd12 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bebb9df0049b699bb30e7fea39dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628fc0d9593f4593835f41c45ecc4ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:55:43.391237 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-58441d68-35c7-4cda-8fda-fbacf001bd12 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] 10.222.0.46 "GET /compute/v2.1/servers/442ac6c6-0a92-4998-9641-222eed9500d3" status: 200 len: 1313 microversion: 2.1 time: 0.152114 Apr 08 11:55:43.392637 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1942/2878] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:55:43 2022] GET /compute/v2.1/servers/442ac6c6-0a92-4998-9641-222eed9500d3 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:55:44.409248 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-23b4580e-dd3a-4bcd-9bd2-1169bef3bf62 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:44.409930 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-23b4580e-dd3a-4bcd-9bd2-1169bef3bf62 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] [instance: 442ac6c6-0a92-4998-9641-222eed9500d3] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:44.416664 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-23b4580e-dd3a-4bcd-9bd2-1169bef3bf62 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:44.417201 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-23b4580e-dd3a-4bcd-9bd2-1169bef3bf62 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:44.418594 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-23b4580e-dd3a-4bcd-9bd2-1169bef3bf62 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:44.419039 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-23b4580e-dd3a-4bcd-9bd2-1169bef3bf62 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:44.553793 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-23b4580e-dd3a-4bcd-9bd2-1169bef3bf62 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bebb9df0049b699bb30e7fea39dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628fc0d9593f4593835f41c45ecc4ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:55:44.561121 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-23b4580e-dd3a-4bcd-9bd2-1169bef3bf62 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] 10.222.0.46 "GET /compute/v2.1/servers/442ac6c6-0a92-4998-9641-222eed9500d3" status: 200 len: 1313 microversion: 2.1 time: 0.155732 Apr 08 11:55:44.561690 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1943/2879] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:55:44 2022] GET /compute/v2.1/servers/442ac6c6-0a92-4998-9641-222eed9500d3 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:55:45.583262 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8f90b003-ace5-4293-b41e-30b12e58ff63 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:45.583924 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8f90b003-ace5-4293-b41e-30b12e58ff63 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] [instance: 442ac6c6-0a92-4998-9641-222eed9500d3] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:45.590186 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8f90b003-ace5-4293-b41e-30b12e58ff63 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:45.595004 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8f90b003-ace5-4293-b41e-30b12e58ff63 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:45.595004 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8f90b003-ace5-4293-b41e-30b12e58ff63 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:45.595004 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8f90b003-ace5-4293-b41e-30b12e58ff63 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:45.726416 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8f90b003-ace5-4293-b41e-30b12e58ff63 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bebb9df0049b699bb30e7fea39dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628fc0d9593f4593835f41c45ecc4ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:55:45.734393 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8f90b003-ace5-4293-b41e-30b12e58ff63 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] 10.222.0.46 "GET /compute/v2.1/servers/442ac6c6-0a92-4998-9641-222eed9500d3" status: 200 len: 1313 microversion: 2.1 time: 0.155092 Apr 08 11:55:45.734967 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1944/2880] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:55:45 2022] GET /compute/v2.1/servers/442ac6c6-0a92-4998-9641-222eed9500d3 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:55:46.559829 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-1f549f99-9f80-45a2-8671-5be6a80eb81f req-382b646c-a577-455b-a649-72e4816b7f68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "442ac6c6-0a92-4998-9641-222eed9500d3", "name": "network-vif-plugged", "status": "completed", "tag": "116d02d1-05d1-4718-a391-cd0ec9be6118"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:55:46.567944 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-1f549f99-9f80-45a2-8671-5be6a80eb81f req-382b646c-a577-455b-a649-72e4816b7f68 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:46.568388 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-1f549f99-9f80-45a2-8671-5be6a80eb81f req-382b646c-a577-455b-a649-72e4816b7f68 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:46.579946 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-1f549f99-9f80-45a2-8671-5be6a80eb81f req-382b646c-a577-455b-a649-72e4816b7f68 service nova] Creating event network-vif-plugged:116d02d1-05d1-4718-a391-cd0ec9be6118 for instance 442ac6c6-0a92-4998-9641-222eed9500d3 on hv-cinder-83607 Apr 08 11:55:46.585135 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-1f549f99-9f80-45a2-8671-5be6a80eb81f req-382b646c-a577-455b-a649-72e4816b7f68 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029498 Apr 08 11:55:46.585860 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1945/2881] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:55:46.752918 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d559d875-89f1-4a5c-9d8c-9952f6d3f08c tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:46.753625 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d559d875-89f1-4a5c-9d8c-9952f6d3f08c tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] [instance: 442ac6c6-0a92-4998-9641-222eed9500d3] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:46.759965 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d559d875-89f1-4a5c-9d8c-9952f6d3f08c tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:46.760414 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d559d875-89f1-4a5c-9d8c-9952f6d3f08c tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:46.761183 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d559d875-89f1-4a5c-9d8c-9952f6d3f08c tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:46.762297 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d559d875-89f1-4a5c-9d8c-9952f6d3f08c tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:46.900614 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d559d875-89f1-4a5c-9d8c-9952f6d3f08c tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bebb9df0049b699bb30e7fea39dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628fc0d9593f4593835f41c45ecc4ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:55:46.907904 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d559d875-89f1-4a5c-9d8c-9952f6d3f08c tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] 10.222.0.46 "GET /compute/v2.1/servers/442ac6c6-0a92-4998-9641-222eed9500d3" status: 200 len: 1313 microversion: 2.1 time: 0.159652 Apr 08 11:55:46.908900 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1946/2882] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:55:46 2022] GET /compute/v2.1/servers/442ac6c6-0a92-4998-9641-222eed9500d3 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:55:47.924946 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-648f5597-f4c1-45eb-9f40-a7d665e2acf0 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:47.925601 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-648f5597-f4c1-45eb-9f40-a7d665e2acf0 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] [instance: 442ac6c6-0a92-4998-9641-222eed9500d3] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:47.931967 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-648f5597-f4c1-45eb-9f40-a7d665e2acf0 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:47.932414 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-648f5597-f4c1-45eb-9f40-a7d665e2acf0 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:47.933703 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-648f5597-f4c1-45eb-9f40-a7d665e2acf0 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:47.934219 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-648f5597-f4c1-45eb-9f40-a7d665e2acf0 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:48.073354 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-648f5597-f4c1-45eb-9f40-a7d665e2acf0 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bebb9df0049b699bb30e7fea39dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628fc0d9593f4593835f41c45ecc4ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:55:48.081162 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-648f5597-f4c1-45eb-9f40-a7d665e2acf0 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] 10.222.0.46 "GET /compute/v2.1/servers/442ac6c6-0a92-4998-9641-222eed9500d3" status: 200 len: 1313 microversion: 2.1 time: 0.160242 Apr 08 11:55:48.081740 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1947/2883] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:55:47 2022] GET /compute/v2.1/servers/442ac6c6-0a92-4998-9641-222eed9500d3 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:55:49.097752 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7410d856-9a1d-48f5-b678-6440acc1d195 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:49.098434 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7410d856-9a1d-48f5-b678-6440acc1d195 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] [instance: 442ac6c6-0a92-4998-9641-222eed9500d3] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:49.104795 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7410d856-9a1d-48f5-b678-6440acc1d195 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:49.105272 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7410d856-9a1d-48f5-b678-6440acc1d195 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:49.106074 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7410d856-9a1d-48f5-b678-6440acc1d195 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:49.106528 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7410d856-9a1d-48f5-b678-6440acc1d195 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:49.243614 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7410d856-9a1d-48f5-b678-6440acc1d195 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bebb9df0049b699bb30e7fea39dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628fc0d9593f4593835f41c45ecc4ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:55:49.251087 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7410d856-9a1d-48f5-b678-6440acc1d195 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] 10.222.0.46 "GET /compute/v2.1/servers/442ac6c6-0a92-4998-9641-222eed9500d3" status: 200 len: 1498 microversion: 2.1 time: 0.157195 Apr 08 11:55:49.251671 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1948/2884] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:55:49 2022] GET /compute/v2.1/servers/442ac6c6-0a92-4998-9641-222eed9500d3 => generated 1498 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:55:50.251643 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1220ce3e-a640-41a3-a06f-0a27b0ba7790 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:50.252351 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1220ce3e-a640-41a3-a06f-0a27b0ba7790 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] [instance: 442ac6c6-0a92-4998-9641-222eed9500d3] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:50.258877 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1220ce3e-a640-41a3-a06f-0a27b0ba7790 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:50.259334 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1220ce3e-a640-41a3-a06f-0a27b0ba7790 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:50.260140 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1220ce3e-a640-41a3-a06f-0a27b0ba7790 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:50.260574 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1220ce3e-a640-41a3-a06f-0a27b0ba7790 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:50.292365 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1220ce3e-a640-41a3-a06f-0a27b0ba7790 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] [instance: 442ac6c6-0a92-4998-9641-222eed9500d3] Going to try to terminate instance {{(pid=117800) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 08 11:55:50.623603 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1220ce3e-a640-41a3-a06f-0a27b0ba7790 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] 10.222.0.46 "DELETE /compute/v2.1/servers/442ac6c6-0a92-4998-9641-222eed9500d3" status: 204 len: 0 microversion: 2.1 time: 0.375574 Apr 08 11:55:50.624232 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1949/2885] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 8 11:55:50 2022] DELETE /compute/v2.1/servers/442ac6c6-0a92-4998-9641-222eed9500d3 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 08 11:55:50.632994 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-cb077c64-d4fd-4d6b-83ac-6f0e524f368c tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:50.633714 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-cb077c64-d4fd-4d6b-83ac-6f0e524f368c tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] [instance: 442ac6c6-0a92-4998-9641-222eed9500d3] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:50.639928 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cb077c64-d4fd-4d6b-83ac-6f0e524f368c tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:50.640382 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cb077c64-d4fd-4d6b-83ac-6f0e524f368c tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:50.641167 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cb077c64-d4fd-4d6b-83ac-6f0e524f368c tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:50.641606 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cb077c64-d4fd-4d6b-83ac-6f0e524f368c tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:50.779011 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-cb077c64-d4fd-4d6b-83ac-6f0e524f368c tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bebb9df0049b699bb30e7fea39dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628fc0d9593f4593835f41c45ecc4ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:55:50.786706 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-cb077c64-d4fd-4d6b-83ac-6f0e524f368c tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] 10.222.0.46 "GET /compute/v2.1/servers/442ac6c6-0a92-4998-9641-222eed9500d3" status: 200 len: 1504 microversion: 2.1 time: 0.157941 Apr 08 11:55:50.787282 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1950/2886] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:55:50 2022] GET /compute/v2.1/servers/442ac6c6-0a92-4998-9641-222eed9500d3 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:55:51.804224 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a28233b4-9093-4429-bc55-e3ec4d6f3f61 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:51.804908 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a28233b4-9093-4429-bc55-e3ec4d6f3f61 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] [instance: 442ac6c6-0a92-4998-9641-222eed9500d3] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:51.811623 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a28233b4-9093-4429-bc55-e3ec4d6f3f61 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:51.812067 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a28233b4-9093-4429-bc55-e3ec4d6f3f61 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:51.812822 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a28233b4-9093-4429-bc55-e3ec4d6f3f61 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:51.813253 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a28233b4-9093-4429-bc55-e3ec4d6f3f61 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:51.950938 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a28233b4-9093-4429-bc55-e3ec4d6f3f61 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bebb9df0049b699bb30e7fea39dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628fc0d9593f4593835f41c45ecc4ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:55:51.958073 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a28233b4-9093-4429-bc55-e3ec4d6f3f61 tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] 10.222.0.46 "GET /compute/v2.1/servers/442ac6c6-0a92-4998-9641-222eed9500d3" status: 200 len: 1504 microversion: 2.1 time: 0.157630 Apr 08 11:55:51.958636 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1951/2887] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:55:51 2022] GET /compute/v2.1/servers/442ac6c6-0a92-4998-9641-222eed9500d3 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:55:52.974974 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-36a34c0c-b1b7-42ab-ba65-dca04f01774a tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:52.975724 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-36a34c0c-b1b7-42ab-ba65-dca04f01774a tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] [instance: 442ac6c6-0a92-4998-9641-222eed9500d3] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:52.981931 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-36a34c0c-b1b7-42ab-ba65-dca04f01774a tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:52.982381 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-36a34c0c-b1b7-42ab-ba65-dca04f01774a tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:52.983374 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-36a34c0c-b1b7-42ab-ba65-dca04f01774a tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:52.983803 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-36a34c0c-b1b7-42ab-ba65-dca04f01774a tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:53.048224 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-36a34c0c-b1b7-42ab-ba65-dca04f01774a tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bebb9df0049b699bb30e7fea39dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628fc0d9593f4593835f41c45ecc4ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:55:53.055631 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-36a34c0c-b1b7-42ab-ba65-dca04f01774a tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] 10.222.0.46 "GET /compute/v2.1/servers/442ac6c6-0a92-4998-9641-222eed9500d3" status: 200 len: 1462 microversion: 2.1 time: 0.084678 Apr 08 11:55:53.056205 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1952/2888] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:55:52 2022] GET /compute/v2.1/servers/442ac6c6-0a92-4998-9641-222eed9500d3 => generated 1462 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:55:53.060898 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-c767421e-e505-46bb-853f-22825265a7e5 req-3e0bd441-ba35-422d-a3fe-abe9dd250723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "442ac6c6-0a92-4998-9641-222eed9500d3", "name": "network-vif-deleted", "tag": "116d02d1-05d1-4718-a391-cd0ec9be6118"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:55:53.068932 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-c767421e-e505-46bb-853f-22825265a7e5 req-3e0bd441-ba35-422d-a3fe-abe9dd250723 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:53.069385 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-c767421e-e505-46bb-853f-22825265a7e5 req-3e0bd441-ba35-422d-a3fe-abe9dd250723 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:53.080984 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-c767421e-e505-46bb-853f-22825265a7e5 req-3e0bd441-ba35-422d-a3fe-abe9dd250723 service nova] Creating event network-vif-deleted:116d02d1-05d1-4718-a391-cd0ec9be6118 for instance 442ac6c6-0a92-4998-9641-222eed9500d3 on hv-cinder-83607 Apr 08 11:55:53.085854 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-c767421e-e505-46bb-853f-22825265a7e5 req-3e0bd441-ba35-422d-a3fe-abe9dd250723 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028533 Apr 08 11:55:53.086506 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1953/2889] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:55:54.073484 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-812d871b-633c-44ca-841f-01f29edef2ba tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:55:54.074285 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-812d871b-633c-44ca-841f-01f29edef2ba tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] [instance: 442ac6c6-0a92-4998-9641-222eed9500d3] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:55:54.080371 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-812d871b-633c-44ca-841f-01f29edef2ba tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:54.085610 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-812d871b-633c-44ca-841f-01f29edef2ba tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:54.085610 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-812d871b-633c-44ca-841f-01f29edef2ba tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:55:54.085610 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-812d871b-633c-44ca-841f-01f29edef2ba tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:55:54.095595 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-812d871b-633c-44ca-841f-01f29edef2ba tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] HTTP exception thrown: Instance 442ac6c6-0a92-4998-9641-222eed9500d3 could not be found. Apr 08 11:55:54.096191 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-812d871b-633c-44ca-841f-01f29edef2ba tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] Returning 404 to user: Instance 442ac6c6-0a92-4998-9641-222eed9500d3 could not be found. {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:55:54.097020 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-812d871b-633c-44ca-841f-01f29edef2ba tempest-VolumesActionsTest-1640257127 tempest-VolumesActionsTest-1640257127-project] 10.222.0.46 "GET /compute/v2.1/servers/442ac6c6-0a92-4998-9641-222eed9500d3" status: 404 len: 111 microversion: 2.1 time: 0.028287 Apr 08 11:55:54.097563 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1954/2890] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:55:54 2022] GET /compute/v2.1/servers/442ac6c6-0a92-4998-9641-222eed9500d3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 11:56:32.663405 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2293a8b2-1844-44fa-9ba7-cb5a52a43e6e tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:56:32.664964 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2293a8b2-1844-44fa-9ba7-cb5a52a43e6e tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: 75f28f3c-9647-4254-8b70-4b1f38be43eb] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:56:32.678152 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2293a8b2-1844-44fa-9ba7-cb5a52a43e6e tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:56:32.678631 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2293a8b2-1844-44fa-9ba7-cb5a52a43e6e tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:56:32.679509 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2293a8b2-1844-44fa-9ba7-cb5a52a43e6e tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:56:32.680574 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2293a8b2-1844-44fa-9ba7-cb5a52a43e6e tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:56:32.711324 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2293a8b2-1844-44fa-9ba7-cb5a52a43e6e tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb/ips" status: 200 len: 145 microversion: 2.1 time: 0.309192 Apr 08 11:56:32.712281 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1955/2891] 10.222.0.46 () {58 vars in 1247 bytes} [Fri Apr 8 11:56:32 2022] GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb/ips => generated 145 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:56:34.531136 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-968b0d34-3ab5-46b4-b2e3-cc0f8d90ab88 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ccf484b9-6b8c-43a6-8a25-b2c962f8a2a6"}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:56:34.532197 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-968b0d34-3ab5-46b4-b2e3-cc0f8d90ab88 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: 75f28f3c-9647-4254-8b70-4b1f38be43eb] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:56:34.538170 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-968b0d34-3ab5-46b4-b2e3-cc0f8d90ab88 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:56:34.539229 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-968b0d34-3ab5-46b4-b2e3-cc0f8d90ab88 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:56:34.540000 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-968b0d34-3ab5-46b4-b2e3-cc0f8d90ab88 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:56:34.540438 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-968b0d34-3ab5-46b4-b2e3-cc0f8d90ab88 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:56:35.223001 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-968b0d34-3ab5-46b4-b2e3-cc0f8d90ab88 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "POST /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.696742 Apr 08 11:56:35.229801 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1956/2892] 10.222.0.46 () {60 vars in 1322 bytes} [Fri Apr 8 11:56:34 2022] POST /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb/os-volume_attachments => generated 194 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:56:43.905754 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-564f7155-0c7f-4b4d-b3d3-451dd7f56a57 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:56:43.906804 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-564f7155-0c7f-4b4d-b3d3-451dd7f56a57 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: 75f28f3c-9647-4254-8b70-4b1f38be43eb] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:56:43.920436 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-564f7155-0c7f-4b4d-b3d3-451dd7f56a57 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:56:43.920894 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-564f7155-0c7f-4b4d-b3d3-451dd7f56a57 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:56:43.921684 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-564f7155-0c7f-4b4d-b3d3-451dd7f56a57 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:56:43.922159 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-564f7155-0c7f-4b4d-b3d3-451dd7f56a57 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:56:43.954325 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-564f7155-0c7f-4b4d-b3d3-451dd7f56a57 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053610 Apr 08 11:56:43.955508 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1957/2893] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:56:43 2022] GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:56:43.964814 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5d554dea-e3cd-47f0-90dd-5b941548729b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:56:43.965523 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5d554dea-e3cd-47f0-90dd-5b941548729b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: 75f28f3c-9647-4254-8b70-4b1f38be43eb] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:56:43.971701 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5d554dea-e3cd-47f0-90dd-5b941548729b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:56:43.973564 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5d554dea-e3cd-47f0-90dd-5b941548729b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:56:43.973564 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5d554dea-e3cd-47f0-90dd-5b941548729b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:56:43.973564 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5d554dea-e3cd-47f0-90dd-5b941548729b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:56:44.004291 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5d554dea-e3cd-47f0-90dd-5b941548729b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb/os-volume_attachments/ccf484b9-6b8c-43a6-8a25-b2c962f8a2a6" status: 200 len: 194 microversion: 2.1 time: 0.043179 Apr 08 11:56:44.004992 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1958/2894] 10.222.0.46 () {58 vars in 1412 bytes} [Fri Apr 8 11:56:43 2022] GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb/os-volume_attachments/ccf484b9-6b8c-43a6-8a25-b2c962f8a2a6 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:56:45.712376 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ca6457fb-953c-45e7-b726-6f4eaeed83ac tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8fdd16d0-d99b-4d32-9285-d7a72feeb6aa"}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:56:45.713460 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ca6457fb-953c-45e7-b726-6f4eaeed83ac tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: 75f28f3c-9647-4254-8b70-4b1f38be43eb] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:56:45.720751 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ca6457fb-953c-45e7-b726-6f4eaeed83ac tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:56:45.721243 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ca6457fb-953c-45e7-b726-6f4eaeed83ac tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:56:45.722065 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ca6457fb-953c-45e7-b726-6f4eaeed83ac tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:56:45.722508 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ca6457fb-953c-45e7-b726-6f4eaeed83ac tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:56:46.573636 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ca6457fb-953c-45e7-b726-6f4eaeed83ac tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "POST /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.865330 Apr 08 11:56:46.574335 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1959/2895] 10.222.0.46 () {60 vars in 1322 bytes} [Fri Apr 8 11:56:45 2022] POST /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb/os-volume_attachments => generated 194 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:56:46.579743 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-aaf47b82-d4de-4a47-9edb-a3211d1de78f tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Action: 'create', calling method: .version_select at 0x7f04285791f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-368253529"}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:56:46.595543 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-aaf47b82-d4de-4a47-9edb-a3211d1de78f tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Getting quotas for project 982950d21c8948d2af801885353a239d. Resources: {'key_pairs'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 11:56:46.599765 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-aaf47b82-d4de-4a47-9edb-a3211d1de78f tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Getting quotas for user 0ab051cc533642658f47c156e33575a0 and project 982950d21c8948d2af801885353a239d. Resources: {'key_pairs'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 11:56:46.968241 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-aaf47b82-d4de-4a47-9edb-a3211d1de78f tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Getting quotas for project 982950d21c8948d2af801885353a239d. Resources: {'key_pairs'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 11:56:46.972064 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-aaf47b82-d4de-4a47-9edb-a3211d1de78f tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Getting quotas for user 0ab051cc533642658f47c156e33575a0 and project 982950d21c8948d2af801885353a239d. Resources: {'key_pairs'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 11:56:46.984660 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-aaf47b82-d4de-4a47-9edb-a3211d1de78f tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.409217 Apr 08 11:56:46.985260 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1960/2896] 10.222.0.46 () {60 vars in 1157 bytes} [Fri Apr 8 11:56:46 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:56:47.033465 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c389a85b-7e42-4672-8300-2c6c24e7f7ac tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-982190074", "imageRef": "9cbac47d-66c2-4f18-a3c0-1c715aae7e67", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-368253529", "networks": [{"uuid": "92026b53-ab1e-49dc-91b4-c793409620d3"}]}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:56:47.083334 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.network.neutron [None req-c389a85b-7e42-4672-8300-2c6c24e7f7ac tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] validate_networks() for [('92026b53-ab1e-49dc-91b4-c793409620d3', None, None, None, None, None)] {{(pid=117800) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 08 11:56:47.732371 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-c389a85b-7e42-4672-8300-2c6c24e7f7ac tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Flavor limits 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 11:56:47.732843 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-c389a85b-7e42-4672-8300-2c6c24e7f7ac tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Image limits 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 11:56:47.733286 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-c389a85b-7e42-4672-8300-2c6c24e7f7ac tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Flavor pref 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 11:56:47.733699 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-c389a85b-7e42-4672-8300-2c6c24e7f7ac tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Image pref 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 11:56:47.734300 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-c389a85b-7e42-4672-8300-2c6c24e7f7ac tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 11:56:47.743991 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c389a85b-7e42-4672-8300-2c6c24e7f7ac tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:56:47.744208 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c389a85b-7e42-4672-8300-2c6c24e7f7ac tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:56:47.744988 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c389a85b-7e42-4672-8300-2c6c24e7f7ac tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:56:47.745431 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c389a85b-7e42-4672-8300-2c6c24e7f7ac tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:56:47.762443 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-c389a85b-7e42-4672-8300-2c6c24e7f7ac tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Getting quotas for project 982950d21c8948d2af801885353a239d. Resources: {'instances', 'ram', 'cores'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 11:56:47.766416 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-c389a85b-7e42-4672-8300-2c6c24e7f7ac tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Getting quotas for user 0ab051cc533642658f47c156e33575a0 and project 982950d21c8948d2af801885353a239d. Resources: {'instances', 'ram', 'cores'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 11:56:47.777630 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c389a85b-7e42-4672-8300-2c6c24e7f7ac tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Going to run 1 instances... {{(pid=117800) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 08 11:56:47.780287 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c389a85b-7e42-4672-8300-2c6c24e7f7ac tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9cbac47d-66c2-4f18-a3c0-1c715aae7e67',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 08 11:56:47.939269 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c389a85b-7e42-4672-8300-2c6c24e7f7ac tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.909765 Apr 08 11:56:47.939835 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1961/2897] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Apr 8 11:56:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 08 11:56:47.950271 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7c3e1ab9-3282-434c-a66c-822112019251 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:56:47.950916 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7c3e1ab9-3282-434c-a66c-822112019251 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:56:48.002990 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7c3e1ab9-3282-434c-a66c-822112019251 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:56:48.010204 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7c3e1ab9-3282-434c-a66c-822112019251 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1257 microversion: 2.1 time: 0.063757 Apr 08 11:56:48.010777 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1962/2898] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:56:47 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1257 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:56:49.027243 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-737ef8c6-3c0f-4894-8ccf-6e05ee9c281c tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:56:49.027912 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-737ef8c6-3c0f-4894-8ccf-6e05ee9c281c tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:56:49.080021 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-737ef8c6-3c0f-4894-8ccf-6e05ee9c281c tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:56:49.087199 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-737ef8c6-3c0f-4894-8ccf-6e05ee9c281c tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1257 microversion: 2.1 time: 0.063802 Apr 08 11:56:49.087846 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1963/2899] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:56:49 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1257 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:56:50.103958 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-558b76e5-994a-4ae2-b511-acbb5fcd26d7 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:56:50.104656 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-558b76e5-994a-4ae2-b511-acbb5fcd26d7 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:56:50.111982 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-558b76e5-994a-4ae2-b511-acbb5fcd26d7 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:56:50.121987 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-558b76e5-994a-4ae2-b511-acbb5fcd26d7 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:56:50.121987 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-558b76e5-994a-4ae2-b511-acbb5fcd26d7 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:56:50.121987 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-558b76e5-994a-4ae2-b511-acbb5fcd26d7 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:56:50.200430 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-558b76e5-994a-4ae2-b511-acbb5fcd26d7 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:56:50.208450 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-558b76e5-994a-4ae2-b511-acbb5fcd26d7 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1317 microversion: 2.1 time: 0.108868 Apr 08 11:56:50.209046 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1964/2900] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:56:50 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1317 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:56:51.225673 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-89dac637-e53a-4328-afd6-36c17a4ee3d9 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:56:51.227100 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-89dac637-e53a-4328-afd6-36c17a4ee3d9 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:56:51.234263 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-89dac637-e53a-4328-afd6-36c17a4ee3d9 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:56:51.235098 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-89dac637-e53a-4328-afd6-36c17a4ee3d9 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:56:51.236179 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-89dac637-e53a-4328-afd6-36c17a4ee3d9 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:56:51.236672 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-89dac637-e53a-4328-afd6-36c17a4ee3d9 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:56:51.404814 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-89dac637-e53a-4328-afd6-36c17a4ee3d9 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:56:51.413360 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-89dac637-e53a-4328-afd6-36c17a4ee3d9 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1357 microversion: 2.1 time: 0.191511 Apr 08 11:56:51.432714 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1965/2901] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:56:51 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1357 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:56:52.432449 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f1e298f8-9d39-4913-9dbd-7be1eb6103ff tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:56:52.433204 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f1e298f8-9d39-4913-9dbd-7be1eb6103ff tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:56:52.439538 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f1e298f8-9d39-4913-9dbd-7be1eb6103ff tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:56:52.439991 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f1e298f8-9d39-4913-9dbd-7be1eb6103ff tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:56:52.440762 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f1e298f8-9d39-4913-9dbd-7be1eb6103ff tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:56:52.441204 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f1e298f8-9d39-4913-9dbd-7be1eb6103ff tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:56:52.582343 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f1e298f8-9d39-4913-9dbd-7be1eb6103ff tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:56:52.590280 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f1e298f8-9d39-4913-9dbd-7be1eb6103ff tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1357 microversion: 2.1 time: 0.161612 Apr 08 11:56:52.590870 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1966/2902] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:56:52 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:56:53.609239 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c183ea4f-8600-4b63-a1c5-5057e62d979b tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:56:53.611084 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c183ea4f-8600-4b63-a1c5-5057e62d979b tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:56:53.618056 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c183ea4f-8600-4b63-a1c5-5057e62d979b tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:56:53.618538 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c183ea4f-8600-4b63-a1c5-5057e62d979b tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:56:53.619598 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c183ea4f-8600-4b63-a1c5-5057e62d979b tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:56:53.620048 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c183ea4f-8600-4b63-a1c5-5057e62d979b tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:56:53.756273 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c183ea4f-8600-4b63-a1c5-5057e62d979b tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:56:53.765472 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c183ea4f-8600-4b63-a1c5-5057e62d979b tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1357 microversion: 2.1 time: 0.161861 Apr 08 11:56:53.766526 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1967/2903] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:56:53 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:56:54.786096 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c085958f-9751-4396-8d79-3f8f15f85e43 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:56:54.786919 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c085958f-9751-4396-8d79-3f8f15f85e43 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:56:54.794105 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c085958f-9751-4396-8d79-3f8f15f85e43 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:56:54.794598 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c085958f-9751-4396-8d79-3f8f15f85e43 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:56:54.795396 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c085958f-9751-4396-8d79-3f8f15f85e43 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:56:54.795901 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c085958f-9751-4396-8d79-3f8f15f85e43 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:56:54.927084 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c085958f-9751-4396-8d79-3f8f15f85e43 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:56:54.934729 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c085958f-9751-4396-8d79-3f8f15f85e43 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1357 microversion: 2.1 time: 0.152670 Apr 08 11:56:54.935311 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1968/2904] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:56:54 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:56:55.953865 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-96a4c475-5213-4e87-aad3-4b123487b3ca tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:56:55.956291 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-96a4c475-5213-4e87-aad3-4b123487b3ca tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:56:55.963435 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-96a4c475-5213-4e87-aad3-4b123487b3ca tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:56:55.964118 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-96a4c475-5213-4e87-aad3-4b123487b3ca tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:56:55.964907 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-96a4c475-5213-4e87-aad3-4b123487b3ca tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:56:55.965346 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-96a4c475-5213-4e87-aad3-4b123487b3ca tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:56:56.121656 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-96a4c475-5213-4e87-aad3-4b123487b3ca tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:56:56.130248 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-96a4c475-5213-4e87-aad3-4b123487b3ca tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1357 microversion: 2.1 time: 0.181955 Apr 08 11:56:56.131060 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1969/2905] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:56:55 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:56:57.148576 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-954a4f55-38e3-4827-b4f9-56cbef2673f4 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:56:57.150623 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-954a4f55-38e3-4827-b4f9-56cbef2673f4 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:56:57.158782 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-954a4f55-38e3-4827-b4f9-56cbef2673f4 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:56:57.159345 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-954a4f55-38e3-4827-b4f9-56cbef2673f4 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:56:57.160212 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-954a4f55-38e3-4827-b4f9-56cbef2673f4 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:56:57.160856 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-954a4f55-38e3-4827-b4f9-56cbef2673f4 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:56:57.300563 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-954a4f55-38e3-4827-b4f9-56cbef2673f4 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:56:57.308719 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-954a4f55-38e3-4827-b4f9-56cbef2673f4 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1357 microversion: 2.1 time: 0.164943 Apr 08 11:56:57.309291 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1970/2906] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:56:57 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:56:58.325075 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b29344ca-a153-46c8-970b-e3848afa5773 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:56:58.325808 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b29344ca-a153-46c8-970b-e3848afa5773 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:56:58.331971 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b29344ca-a153-46c8-970b-e3848afa5773 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:56:58.332417 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b29344ca-a153-46c8-970b-e3848afa5773 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:56:58.333169 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b29344ca-a153-46c8-970b-e3848afa5773 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:56:58.333603 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b29344ca-a153-46c8-970b-e3848afa5773 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:56:58.476982 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b29344ca-a153-46c8-970b-e3848afa5773 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:56:58.485248 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b29344ca-a153-46c8-970b-e3848afa5773 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1357 microversion: 2.1 time: 0.164056 Apr 08 11:56:58.499499 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1971/2907] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:56:58 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:56:59.502165 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-43b179f8-08db-4bea-a155-c67089de69df tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:56:59.629942 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-43b179f8-08db-4bea-a155-c67089de69df tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:56:59.629942 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-43b179f8-08db-4bea-a155-c67089de69df tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:56:59.629942 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-43b179f8-08db-4bea-a155-c67089de69df tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:56:59.629942 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-43b179f8-08db-4bea-a155-c67089de69df tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:56:59.631107 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-43b179f8-08db-4bea-a155-c67089de69df tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:56:59.674172 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-43b179f8-08db-4bea-a155-c67089de69df tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:56:59.683195 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-43b179f8-08db-4bea-a155-c67089de69df tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1357 microversion: 2.1 time: 0.184951 Apr 08 11:56:59.683776 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1972/2908] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:56:59 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:57:00.700252 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e81a43a9-a9d6-477d-bf4e-c71dc0fe3c52 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:00.700935 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e81a43a9-a9d6-477d-bf4e-c71dc0fe3c52 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:00.707180 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e81a43a9-a9d6-477d-bf4e-c71dc0fe3c52 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:00.707637 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e81a43a9-a9d6-477d-bf4e-c71dc0fe3c52 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:00.708406 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e81a43a9-a9d6-477d-bf4e-c71dc0fe3c52 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:00.708846 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e81a43a9-a9d6-477d-bf4e-c71dc0fe3c52 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:00.842116 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e81a43a9-a9d6-477d-bf4e-c71dc0fe3c52 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:57:00.849343 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e81a43a9-a9d6-477d-bf4e-c71dc0fe3c52 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1357 microversion: 2.1 time: 0.153041 Apr 08 11:57:00.849943 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1973/2909] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:00 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:57:01.867199 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ca136c6e-01a7-4477-8b07-021eaadb9666 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:01.867881 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ca136c6e-01a7-4477-8b07-021eaadb9666 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:01.874169 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ca136c6e-01a7-4477-8b07-021eaadb9666 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:01.874620 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ca136c6e-01a7-4477-8b07-021eaadb9666 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:01.875389 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ca136c6e-01a7-4477-8b07-021eaadb9666 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:01.875831 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ca136c6e-01a7-4477-8b07-021eaadb9666 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:02.005579 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ca136c6e-01a7-4477-8b07-021eaadb9666 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:57:02.013336 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ca136c6e-01a7-4477-8b07-021eaadb9666 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1357 microversion: 2.1 time: 0.150615 Apr 08 11:57:02.014081 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1974/2910] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:01 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:57:03.031529 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8b53fb47-793c-4e60-aaf0-98ec3fde3796 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:03.032248 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8b53fb47-793c-4e60-aaf0-98ec3fde3796 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:03.038432 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8b53fb47-793c-4e60-aaf0-98ec3fde3796 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:03.038881 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8b53fb47-793c-4e60-aaf0-98ec3fde3796 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:03.039655 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8b53fb47-793c-4e60-aaf0-98ec3fde3796 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:03.040091 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8b53fb47-793c-4e60-aaf0-98ec3fde3796 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:03.168656 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8b53fb47-793c-4e60-aaf0-98ec3fde3796 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:57:03.175947 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8b53fb47-793c-4e60-aaf0-98ec3fde3796 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1357 microversion: 2.1 time: 0.148531 Apr 08 11:57:03.176519 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1975/2911] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:03 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:57:04.193424 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-afbb2042-858f-4e07-a0f3-08c4e1ca9186 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:04.194664 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-afbb2042-858f-4e07-a0f3-08c4e1ca9186 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:04.200974 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-afbb2042-858f-4e07-a0f3-08c4e1ca9186 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:04.201417 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-afbb2042-858f-4e07-a0f3-08c4e1ca9186 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:04.202230 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-afbb2042-858f-4e07-a0f3-08c4e1ca9186 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:04.202663 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-afbb2042-858f-4e07-a0f3-08c4e1ca9186 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:04.341294 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-afbb2042-858f-4e07-a0f3-08c4e1ca9186 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:57:04.344351 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-afbb2042-858f-4e07-a0f3-08c4e1ca9186 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1357 microversion: 2.1 time: 0.154888 Apr 08 11:57:04.344922 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1976/2912] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:04 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:57:05.360532 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-31caac46-3d24-4614-a69d-7881d84e27f1 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:05.361210 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-31caac46-3d24-4614-a69d-7881d84e27f1 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:05.367444 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-31caac46-3d24-4614-a69d-7881d84e27f1 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:05.367899 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-31caac46-3d24-4614-a69d-7881d84e27f1 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:05.368667 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-31caac46-3d24-4614-a69d-7881d84e27f1 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:05.369115 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-31caac46-3d24-4614-a69d-7881d84e27f1 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:05.506118 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-31caac46-3d24-4614-a69d-7881d84e27f1 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:57:05.514263 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-31caac46-3d24-4614-a69d-7881d84e27f1 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1357 microversion: 2.1 time: 0.157797 Apr 08 11:57:05.514843 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1977/2913] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:05 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:57:06.345626 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-c1d0fa9f-e1d1-4641-a606-bb0f5741ff7b req-a0538bf4-65ce-4cc0-884e-1e00826a4cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ecf987c-6d9b-471f-ad88-64ec198a5cbe", "tag": "0d0bf587-5284-4d8f-acb8-dac2d5db2401"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:57:06.354253 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-c1d0fa9f-e1d1-4641-a606-bb0f5741ff7b req-a0538bf4-65ce-4cc0-884e-1e00826a4cf2 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:06.354870 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-c1d0fa9f-e1d1-4641-a606-bb0f5741ff7b req-a0538bf4-65ce-4cc0-884e-1e00826a4cf2 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:06.366921 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-c1d0fa9f-e1d1-4641-a606-bb0f5741ff7b req-a0538bf4-65ce-4cc0-884e-1e00826a4cf2 service nova] Creating event network-changed:0d0bf587-5284-4d8f-acb8-dac2d5db2401 for instance 9ecf987c-6d9b-471f-ad88-64ec198a5cbe on hv-cinder-83607 Apr 08 11:57:06.372707 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-c1d0fa9f-e1d1-4641-a606-bb0f5741ff7b req-a0538bf4-65ce-4cc0-884e-1e00826a4cf2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031027 Apr 08 11:57:06.373530 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1978/2914] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:57:06.532216 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8bdf8ee7-da35-4182-b83e-740d261f930e tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:06.532916 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8bdf8ee7-da35-4182-b83e-740d261f930e tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:06.539039 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8bdf8ee7-da35-4182-b83e-740d261f930e tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:06.539492 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8bdf8ee7-da35-4182-b83e-740d261f930e tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:06.540260 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8bdf8ee7-da35-4182-b83e-740d261f930e tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:06.540695 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8bdf8ee7-da35-4182-b83e-740d261f930e tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:06.778383 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8bdf8ee7-da35-4182-b83e-740d261f930e tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:57:06.791276 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8bdf8ee7-da35-4182-b83e-740d261f930e tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1357 microversion: 2.1 time: 0.263394 Apr 08 11:57:06.792317 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1979/2915] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:06 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1357 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:57:07.808446 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-60460f09-0015-4b93-b53e-e943755bcf1b tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:07.809065 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-60460f09-0015-4b93-b53e-e943755bcf1b tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:07.815315 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-60460f09-0015-4b93-b53e-e943755bcf1b tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:07.815795 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-60460f09-0015-4b93-b53e-e943755bcf1b tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:07.816532 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-60460f09-0015-4b93-b53e-e943755bcf1b tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:07.816968 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-60460f09-0015-4b93-b53e-e943755bcf1b tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:07.948437 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-60460f09-0015-4b93-b53e-e943755bcf1b tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:57:07.956378 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-60460f09-0015-4b93-b53e-e943755bcf1b tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1357 microversion: 2.1 time: 0.151696 Apr 08 11:57:07.956979 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1980/2916] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:07 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:57:07.961826 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a383c0f2-3239-4586-a5e9-413f10631105 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:07.962797 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a383c0f2-3239-4586-a5e9-413f10631105 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: 75f28f3c-9647-4254-8b70-4b1f38be43eb] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:07.970185 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a383c0f2-3239-4586-a5e9-413f10631105 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:07.970643 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a383c0f2-3239-4586-a5e9-413f10631105 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:07.975403 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a383c0f2-3239-4586-a5e9-413f10631105 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:07.975871 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a383c0f2-3239-4586-a5e9-413f10631105 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:08.005609 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a383c0f2-3239-4586-a5e9-413f10631105 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047587 Apr 08 11:57:08.006784 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1981/2917] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:57:07 2022] GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:57:08.156404 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0b5aecaa-3668-410b-bde5-c4bfd81b7705 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:08.156874 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0b5aecaa-3668-410b-bde5-c4bfd81b7705 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: 75f28f3c-9647-4254-8b70-4b1f38be43eb] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:08.163678 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0b5aecaa-3668-410b-bde5-c4bfd81b7705 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:08.164124 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0b5aecaa-3668-410b-bde5-c4bfd81b7705 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:08.164883 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0b5aecaa-3668-410b-bde5-c4bfd81b7705 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:08.165321 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0b5aecaa-3668-410b-bde5-c4bfd81b7705 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:08.194235 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0b5aecaa-3668-410b-bde5-c4bfd81b7705 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb/os-volume_attachments/ccf484b9-6b8c-43a6-8a25-b2c962f8a2a6" status: 200 len: 194 microversion: 2.1 time: 0.042022 Apr 08 11:57:08.194819 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1982/2918] 10.222.0.46 () {58 vars in 1412 bytes} [Fri Apr 8 11:57:08 2022] GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb/os-volume_attachments/ccf484b9-6b8c-43a6-8a25-b2c962f8a2a6 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:57:08.204735 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e9c8202a-208d-493b-88f1-e8b74cd9677f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:08.205233 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e9c8202a-208d-493b-88f1-e8b74cd9677f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: 75f28f3c-9647-4254-8b70-4b1f38be43eb] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:08.211498 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e9c8202a-208d-493b-88f1-e8b74cd9677f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:08.211952 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e9c8202a-208d-493b-88f1-e8b74cd9677f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:08.212722 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e9c8202a-208d-493b-88f1-e8b74cd9677f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:08.213166 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e9c8202a-208d-493b-88f1-e8b74cd9677f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:08.313358 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-e9c8202a-208d-493b-88f1-e8b74cd9677f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lazy-loading 'services' on Instance uuid 75f28f3c-9647-4254-8b70-4b1f38be43eb {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 11:57:08.548533 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e9c8202a-208d-493b-88f1-e8b74cd9677f tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "DELETE /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb/os-volume_attachments/ccf484b9-6b8c-43a6-8a25-b2c962f8a2a6" status: 202 len: 0 microversion: 2.1 time: 0.347297 Apr 08 11:57:08.549142 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1983/2919] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Apr 8 11:57:08 2022] DELETE /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb/os-volume_attachments/ccf484b9-6b8c-43a6-8a25-b2c962f8a2a6 => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 08 11:57:08.978124 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-512ed2d0-1f68-46e8-a2e0-289740f713dd tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:08.978844 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-512ed2d0-1f68-46e8-a2e0-289740f713dd tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:08.984952 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-512ed2d0-1f68-46e8-a2e0-289740f713dd tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:08.985406 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-512ed2d0-1f68-46e8-a2e0-289740f713dd tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:08.986209 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-512ed2d0-1f68-46e8-a2e0-289740f713dd tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:08.986651 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-512ed2d0-1f68-46e8-a2e0-289740f713dd tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:09.120339 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-512ed2d0-1f68-46e8-a2e0-289740f713dd tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:57:09.127611 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-512ed2d0-1f68-46e8-a2e0-289740f713dd tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1357 microversion: 2.1 time: 0.154175 Apr 08 11:57:09.128186 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1984/2920] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:08 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:57:10.144632 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-499d837f-764c-46bf-962a-6d487ff3c908 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:10.145301 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-499d837f-764c-46bf-962a-6d487ff3c908 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:10.152220 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-499d837f-764c-46bf-962a-6d487ff3c908 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:10.152925 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-499d837f-764c-46bf-962a-6d487ff3c908 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:10.153699 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-499d837f-764c-46bf-962a-6d487ff3c908 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:10.154168 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-499d837f-764c-46bf-962a-6d487ff3c908 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:10.290574 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-499d837f-764c-46bf-962a-6d487ff3c908 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:57:10.297920 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-499d837f-764c-46bf-962a-6d487ff3c908 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1357 microversion: 2.1 time: 0.157302 Apr 08 11:57:10.298502 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1985/2921] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:10 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:57:11.314690 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-06e72d77-d9ba-479e-92fd-e09c17ef00fe tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:11.315303 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-06e72d77-d9ba-479e-92fd-e09c17ef00fe tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:11.322362 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-06e72d77-d9ba-479e-92fd-e09c17ef00fe tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:11.325902 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-06e72d77-d9ba-479e-92fd-e09c17ef00fe tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:11.325902 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-06e72d77-d9ba-479e-92fd-e09c17ef00fe tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:11.325902 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-06e72d77-d9ba-479e-92fd-e09c17ef00fe tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:11.457397 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-06e72d77-d9ba-479e-92fd-e09c17ef00fe tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:57:11.464655 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-06e72d77-d9ba-479e-92fd-e09c17ef00fe tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1357 microversion: 2.1 time: 0.153816 Apr 08 11:57:11.465226 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1986/2922] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:11 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:57:11.767067 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-14a43d17-61f1-4cb0-9a93-3ce2e47a414a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:11.767564 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-14a43d17-61f1-4cb0-9a93-3ce2e47a414a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: 75f28f3c-9647-4254-8b70-4b1f38be43eb] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:11.773991 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-14a43d17-61f1-4cb0-9a93-3ce2e47a414a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:11.774443 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-14a43d17-61f1-4cb0-9a93-3ce2e47a414a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:11.775202 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-14a43d17-61f1-4cb0-9a93-3ce2e47a414a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:11.775645 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-14a43d17-61f1-4cb0-9a93-3ce2e47a414a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:11.804517 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-14a43d17-61f1-4cb0-9a93-3ce2e47a414a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb/os-volume_attachments/8fdd16d0-d99b-4d32-9285-d7a72feeb6aa" status: 200 len: 194 microversion: 2.1 time: 0.041359 Apr 08 11:57:11.805099 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1987/2923] 10.222.0.46 () {58 vars in 1412 bytes} [Fri Apr 8 11:57:11 2022] GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb/os-volume_attachments/8fdd16d0-d99b-4d32-9285-d7a72feeb6aa => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:57:11.814534 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6af2b25c-6d01-4bfa-8ee3-fc45892f36ba tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:11.815038 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6af2b25c-6d01-4bfa-8ee3-fc45892f36ba tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: 75f28f3c-9647-4254-8b70-4b1f38be43eb] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:11.821441 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6af2b25c-6d01-4bfa-8ee3-fc45892f36ba tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:11.821929 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6af2b25c-6d01-4bfa-8ee3-fc45892f36ba tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:11.822703 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6af2b25c-6d01-4bfa-8ee3-fc45892f36ba tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:11.823167 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6af2b25c-6d01-4bfa-8ee3-fc45892f36ba tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:11.899917 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-6af2b25c-6d01-4bfa-8ee3-fc45892f36ba tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lazy-loading 'services' on Instance uuid 75f28f3c-9647-4254-8b70-4b1f38be43eb {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 11:57:12.085262 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6af2b25c-6d01-4bfa-8ee3-fc45892f36ba tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "DELETE /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb/os-volume_attachments/8fdd16d0-d99b-4d32-9285-d7a72feeb6aa" status: 202 len: 0 microversion: 2.1 time: 0.274371 Apr 08 11:57:12.085883 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1988/2924] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Apr 8 11:57:11 2022] DELETE /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb/os-volume_attachments/8fdd16d0-d99b-4d32-9285-d7a72feeb6aa => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 08 11:57:12.482795 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9cb7ef18-f985-4b41-a302-c365c2b99e9e tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:12.483510 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9cb7ef18-f985-4b41-a302-c365c2b99e9e tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:12.489696 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9cb7ef18-f985-4b41-a302-c365c2b99e9e tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:12.490201 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9cb7ef18-f985-4b41-a302-c365c2b99e9e tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:12.491010 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9cb7ef18-f985-4b41-a302-c365c2b99e9e tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:12.491451 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9cb7ef18-f985-4b41-a302-c365c2b99e9e tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:12.622412 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9cb7ef18-f985-4b41-a302-c365c2b99e9e tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:57:12.630301 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9cb7ef18-f985-4b41-a302-c365c2b99e9e tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1357 microversion: 2.1 time: 0.152153 Apr 08 11:57:12.630892 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1989/2925] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:12 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:57:13.281330 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1643835f-7902-43b5-8593-bbc62bdb8f5a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:13.282356 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1643835f-7902-43b5-8593-bbc62bdb8f5a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: 75f28f3c-9647-4254-8b70-4b1f38be43eb] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:13.289159 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1643835f-7902-43b5-8593-bbc62bdb8f5a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:13.289592 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1643835f-7902-43b5-8593-bbc62bdb8f5a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:13.290401 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1643835f-7902-43b5-8593-bbc62bdb8f5a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:13.290841 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1643835f-7902-43b5-8593-bbc62bdb8f5a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:13.320049 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1643835f-7902-43b5-8593-bbc62bdb8f5a tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047225 Apr 08 11:57:13.320617 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1990/2926] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:57:13 2022] GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 08 11:57:13.424857 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5e26e950-804e-450a-966b-4e80f4a3a8b3 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:13.430736 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5e26e950-804e-450a-966b-4e80f4a3a8b3 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: 75f28f3c-9647-4254-8b70-4b1f38be43eb] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:13.432190 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5e26e950-804e-450a-966b-4e80f4a3a8b3 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:13.432667 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5e26e950-804e-450a-966b-4e80f4a3a8b3 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:13.433426 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5e26e950-804e-450a-966b-4e80f4a3a8b3 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:13.433893 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5e26e950-804e-450a-966b-4e80f4a3a8b3 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:13.461345 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5e26e950-804e-450a-966b-4e80f4a3a8b3 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040542 Apr 08 11:57:13.461924 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1991/2927] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:57:13 2022] GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 11:57:13.529193 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7b564263-12b1-476e-ac31-82777bdae7c2 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:13.529884 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7b564263-12b1-476e-ac31-82777bdae7c2 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: 75f28f3c-9647-4254-8b70-4b1f38be43eb] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:13.536047 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7b564263-12b1-476e-ac31-82777bdae7c2 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:13.536498 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7b564263-12b1-476e-ac31-82777bdae7c2 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:13.537267 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7b564263-12b1-476e-ac31-82777bdae7c2 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:13.537704 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7b564263-12b1-476e-ac31-82777bdae7c2 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:13.561596 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7b564263-12b1-476e-ac31-82777bdae7c2 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: 75f28f3c-9647-4254-8b70-4b1f38be43eb] Going to try to terminate instance {{(pid=117800) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 08 11:57:13.859422 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7b564263-12b1-476e-ac31-82777bdae7c2 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "DELETE /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb" status: 204 len: 0 microversion: 2.1 time: 0.334030 Apr 08 11:57:13.860016 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1992/2928] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 8 11:57:13 2022] DELETE /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 08 11:57:13.866052 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8508cf55-dac4-4762-95ea-72a35300c9ea tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:13.867383 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8508cf55-dac4-4762-95ea-72a35300c9ea tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:13.873112 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8508cf55-dac4-4762-95ea-72a35300c9ea tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:13.873551 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8508cf55-dac4-4762-95ea-72a35300c9ea tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:13.874361 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8508cf55-dac4-4762-95ea-72a35300c9ea tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:13.874798 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8508cf55-dac4-4762-95ea-72a35300c9ea tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:14.005831 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8508cf55-dac4-4762-95ea-72a35300c9ea tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:57:14.013095 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8508cf55-dac4-4762-95ea-72a35300c9ea tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1357 microversion: 2.1 time: 0.151734 Apr 08 11:57:14.013671 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1993/2929] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:13 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:57:14.018060 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3eee75e9-8b8b-4532-b412-b9dd969a00fd tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:14.018673 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3eee75e9-8b8b-4532-b412-b9dd969a00fd tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: 75f28f3c-9647-4254-8b70-4b1f38be43eb] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:14.025087 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3eee75e9-8b8b-4532-b412-b9dd969a00fd tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:14.025541 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3eee75e9-8b8b-4532-b412-b9dd969a00fd tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:14.026475 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3eee75e9-8b8b-4532-b412-b9dd969a00fd tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:14.026919 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3eee75e9-8b8b-4532-b412-b9dd969a00fd tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:14.160894 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3eee75e9-8b8b-4532-b412-b9dd969a00fd tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:57:14.168804 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3eee75e9-8b8b-4532-b412-b9dd969a00fd tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb" status: 200 len: 1674 microversion: 2.1 time: 0.154165 Apr 08 11:57:14.169450 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1994/2930] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:14 2022] GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:57:14.318230 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-40a7bbb3-75ea-4ddc-becc-aefa0868c8eb req-2bcb1c62-9695-4f32-b0dc-6efc3f28664c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ecf987c-6d9b-471f-ad88-64ec198a5cbe", "name": "network-vif-plugged", "status": "completed", "tag": "0d0bf587-5284-4d8f-acb8-dac2d5db2401"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:57:14.326965 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-40a7bbb3-75ea-4ddc-becc-aefa0868c8eb req-2bcb1c62-9695-4f32-b0dc-6efc3f28664c service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:14.327413 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-40a7bbb3-75ea-4ddc-becc-aefa0868c8eb req-2bcb1c62-9695-4f32-b0dc-6efc3f28664c service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:14.339133 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-40a7bbb3-75ea-4ddc-becc-aefa0868c8eb req-2bcb1c62-9695-4f32-b0dc-6efc3f28664c service nova] Creating event network-vif-plugged:0d0bf587-5284-4d8f-acb8-dac2d5db2401 for instance 9ecf987c-6d9b-471f-ad88-64ec198a5cbe on hv-cinder-83607 Apr 08 11:57:14.344081 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-40a7bbb3-75ea-4ddc-becc-aefa0868c8eb req-2bcb1c62-9695-4f32-b0dc-6efc3f28664c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029555 Apr 08 11:57:14.344668 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1995/2931] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:57:15.030529 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-07317775-4ee1-4f8d-9752-6c10e660dadb tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:15.031220 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-07317775-4ee1-4f8d-9752-6c10e660dadb tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:15.037668 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-07317775-4ee1-4f8d-9752-6c10e660dadb tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:15.038714 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-07317775-4ee1-4f8d-9752-6c10e660dadb tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:15.039484 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-07317775-4ee1-4f8d-9752-6c10e660dadb tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:15.039919 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-07317775-4ee1-4f8d-9752-6c10e660dadb tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:15.170036 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-07317775-4ee1-4f8d-9752-6c10e660dadb tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:57:15.177227 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-07317775-4ee1-4f8d-9752-6c10e660dadb tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1357 microversion: 2.1 time: 0.151143 Apr 08 11:57:15.177815 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1996/2932] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:15 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:57:15.185509 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a0862cab-6462-40a8-abac-0d60207ab67d tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:15.186131 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a0862cab-6462-40a8-abac-0d60207ab67d tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: 75f28f3c-9647-4254-8b70-4b1f38be43eb] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:15.191870 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a0862cab-6462-40a8-abac-0d60207ab67d tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:15.192319 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a0862cab-6462-40a8-abac-0d60207ab67d tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:15.193081 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a0862cab-6462-40a8-abac-0d60207ab67d tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:15.193517 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a0862cab-6462-40a8-abac-0d60207ab67d tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:15.330915 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a0862cab-6462-40a8-abac-0d60207ab67d tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:57:15.338994 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a0862cab-6462-40a8-abac-0d60207ab67d tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb" status: 200 len: 1674 microversion: 2.1 time: 0.156962 Apr 08 11:57:15.341859 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1997/2933] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:15 2022] GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:57:16.194021 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a5271492-10ed-4871-bf79-970bd59898d9 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:16.194732 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a5271492-10ed-4871-bf79-970bd59898d9 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:16.201553 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a5271492-10ed-4871-bf79-970bd59898d9 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:16.202034 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a5271492-10ed-4871-bf79-970bd59898d9 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:16.202803 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a5271492-10ed-4871-bf79-970bd59898d9 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:16.203241 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a5271492-10ed-4871-bf79-970bd59898d9 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:16.332323 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a5271492-10ed-4871-bf79-970bd59898d9 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:57:16.342787 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a5271492-10ed-4871-bf79-970bd59898d9 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1357 microversion: 2.1 time: 0.149602 Apr 08 11:57:16.342787 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1998/2934] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:16 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:57:16.355924 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8ddee5fc-7f26-49c1-a281-e035ecb1e50c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:16.356520 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8ddee5fc-7f26-49c1-a281-e035ecb1e50c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: 75f28f3c-9647-4254-8b70-4b1f38be43eb] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:16.362209 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8ddee5fc-7f26-49c1-a281-e035ecb1e50c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:16.362653 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8ddee5fc-7f26-49c1-a281-e035ecb1e50c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:16.363415 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8ddee5fc-7f26-49c1-a281-e035ecb1e50c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:16.363843 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8ddee5fc-7f26-49c1-a281-e035ecb1e50c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:16.494752 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8ddee5fc-7f26-49c1-a281-e035ecb1e50c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:57:16.502325 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8ddee5fc-7f26-49c1-a281-e035ecb1e50c tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb" status: 200 len: 1674 microversion: 2.1 time: 0.149940 Apr 08 11:57:16.502906 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 1999/2935] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:16 2022] GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:57:17.356519 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4ce86378-e318-43e1-89b3-a27596223767 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:17.357188 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4ce86378-e318-43e1-89b3-a27596223767 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:17.363551 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4ce86378-e318-43e1-89b3-a27596223767 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:17.364029 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4ce86378-e318-43e1-89b3-a27596223767 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:17.364806 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4ce86378-e318-43e1-89b3-a27596223767 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:17.365250 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4ce86378-e318-43e1-89b3-a27596223767 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:17.506719 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4ce86378-e318-43e1-89b3-a27596223767 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:57:17.515060 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4ce86378-e318-43e1-89b3-a27596223767 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1357 microversion: 2.1 time: 0.162047 Apr 08 11:57:17.515646 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2000/2936] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:17 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:57:17.520205 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-cadf6e0d-b04a-4804-8219-36ee7f7f713b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:17.520813 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-cadf6e0d-b04a-4804-8219-36ee7f7f713b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: 75f28f3c-9647-4254-8b70-4b1f38be43eb] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:17.527480 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cadf6e0d-b04a-4804-8219-36ee7f7f713b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:17.527941 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cadf6e0d-b04a-4804-8219-36ee7f7f713b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:17.528713 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cadf6e0d-b04a-4804-8219-36ee7f7f713b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:17.529150 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cadf6e0d-b04a-4804-8219-36ee7f7f713b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:17.589627 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-cadf6e0d-b04a-4804-8219-36ee7f7f713b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:57:17.596874 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-cadf6e0d-b04a-4804-8219-36ee7f7f713b tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb" status: 200 len: 1606 microversion: 2.1 time: 0.080290 Apr 08 11:57:17.597442 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2001/2937] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:17 2022] GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb => generated 1606 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:57:17.703684 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-1058b308-596e-40bc-a916-d084ea9dbdb2 req-96fbce42-af49-4a18-bf61-2493794662b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75f28f3c-9647-4254-8b70-4b1f38be43eb", "name": "network-vif-deleted", "tag": "46820bbd-ab2e-4ce5-a8cb-5306f4130e88"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:57:17.711758 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-1058b308-596e-40bc-a916-d084ea9dbdb2 req-96fbce42-af49-4a18-bf61-2493794662b2 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:17.712410 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-1058b308-596e-40bc-a916-d084ea9dbdb2 req-96fbce42-af49-4a18-bf61-2493794662b2 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:17.724814 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-1058b308-596e-40bc-a916-d084ea9dbdb2 req-96fbce42-af49-4a18-bf61-2493794662b2 service nova] Creating event network-vif-deleted:46820bbd-ab2e-4ce5-a8cb-5306f4130e88 for instance 75f28f3c-9647-4254-8b70-4b1f38be43eb on hv-cinder-83607 Apr 08 11:57:17.732735 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-1058b308-596e-40bc-a916-d084ea9dbdb2 req-96fbce42-af49-4a18-bf61-2493794662b2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030235 Apr 08 11:57:17.732735 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2002/2938] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:57:18.534108 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-78501e17-99be-44d7-ba7a-047126d1bfa8 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:18.534968 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-78501e17-99be-44d7-ba7a-047126d1bfa8 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:18.541499 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-78501e17-99be-44d7-ba7a-047126d1bfa8 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:18.541983 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-78501e17-99be-44d7-ba7a-047126d1bfa8 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:18.542770 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-78501e17-99be-44d7-ba7a-047126d1bfa8 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:18.543213 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-78501e17-99be-44d7-ba7a-047126d1bfa8 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:18.698183 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-78501e17-99be-44d7-ba7a-047126d1bfa8 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:57:18.711347 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-78501e17-99be-44d7-ba7a-047126d1bfa8 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1545 microversion: 2.1 time: 0.181938 Apr 08 11:57:18.711940 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2003/2939] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:18 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1545 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:57:18.716616 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a194d147-398c-4f80-a86d-6b249abc6e10 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:18.720774 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a194d147-398c-4f80-a86d-6b249abc6e10 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: 75f28f3c-9647-4254-8b70-4b1f38be43eb] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:18.723552 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a194d147-398c-4f80-a86d-6b249abc6e10 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:18.723953 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a194d147-398c-4f80-a86d-6b249abc6e10 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:18.724735 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a194d147-398c-4f80-a86d-6b249abc6e10 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:18.725180 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a194d147-398c-4f80-a86d-6b249abc6e10 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:18.759608 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a194d147-398c-4f80-a86d-6b249abc6e10 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:18.760072 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a194d147-398c-4f80-a86d-6b249abc6e10 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:18.760536 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-a194d147-398c-4f80-a86d-6b249abc6e10 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lazy-loading 'fault' on Instance uuid 75f28f3c-9647-4254-8b70-4b1f38be43eb {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 11:57:18.802673 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a194d147-398c-4f80-a86d-6b249abc6e10 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7f5f8b5df94835ae32b80a106ede09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0811e055f46b98a70790223b64a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:57:18.810103 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a194d147-398c-4f80-a86d-6b249abc6e10 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb" status: 200 len: 1328 microversion: 2.1 time: 0.097171 Apr 08 11:57:18.810997 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2004/2940] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:18 2022] GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb => generated 1328 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:57:18.815539 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f5b5b47b-f880-4266-bf13-839176a520b1 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:18.816151 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f5b5b47b-f880-4266-bf13-839176a520b1 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:18.822293 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f5b5b47b-f880-4266-bf13-839176a520b1 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:18.822771 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f5b5b47b-f880-4266-bf13-839176a520b1 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:18.823549 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f5b5b47b-f880-4266-bf13-839176a520b1 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:18.824066 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f5b5b47b-f880-4266-bf13-839176a520b1 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:18.957698 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f5b5b47b-f880-4266-bf13-839176a520b1 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:57:18.965100 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f5b5b47b-f880-4266-bf13-839176a520b1 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1545 microversion: 2.1 time: 0.153075 Apr 08 11:57:18.965666 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2005/2941] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:18 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1545 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:57:18.980638 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a2dd68cf-d02a-4146-888b-914b033bf881 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:18.983934 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a2dd68cf-d02a-4146-888b-914b033bf881 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:57:18.984701 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a2dd68cf-d02a-4146-888b-914b033bf881 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Searching by: {'deleted': False, 'project_id': '982950d21c8948d2af801885353a239d'} {{(pid=117800) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 08 11:57:18.991333 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a2dd68cf-d02a-4146-888b-914b033bf881 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:18.991797 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a2dd68cf-d02a-4146-888b-914b033bf881 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:18.993154 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a2dd68cf-d02a-4146-888b-914b033bf881 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:18.993595 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a2dd68cf-d02a-4146-888b-914b033bf881 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:19.082830 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.multi_cell_list [None req-a2dd68cf-d02a-4146-888b-914b033bf881 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117800) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 08 11:57:19.174501 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a2dd68cf-d02a-4146-888b-914b033bf881 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.197839 Apr 08 11:57:19.175092 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2006/2942] 10.222.0.46 () {58 vars in 1124 bytes} [Fri Apr 8 11:57:18 2022] GET /compute/v2.1/servers => generated 342 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:57:19.184974 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-09589629-6131-4210-9242-3d15a830356c tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:19.185589 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-09589629-6131-4210-9242-3d15a830356c tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:19.191386 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-09589629-6131-4210-9242-3d15a830356c tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:19.191841 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-09589629-6131-4210-9242-3d15a830356c tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:19.192611 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-09589629-6131-4210-9242-3d15a830356c tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:19.193053 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-09589629-6131-4210-9242-3d15a830356c tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:19.332210 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-09589629-6131-4210-9242-3d15a830356c tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:57:19.340148 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-09589629-6131-4210-9242-3d15a830356c tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1545 microversion: 2.1 time: 0.158710 Apr 08 11:57:19.340840 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2007/2943] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:19 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1545 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:57:19.827282 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7e2f08a3-b1fc-4fa0-aa17-b8eb2b1b74a4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:19.831474 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7e2f08a3-b1fc-4fa0-aa17-b8eb2b1b74a4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: 75f28f3c-9647-4254-8b70-4b1f38be43eb] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:19.834160 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7e2f08a3-b1fc-4fa0-aa17-b8eb2b1b74a4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:19.834616 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7e2f08a3-b1fc-4fa0-aa17-b8eb2b1b74a4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:19.835394 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7e2f08a3-b1fc-4fa0-aa17-b8eb2b1b74a4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:19.836501 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7e2f08a3-b1fc-4fa0-aa17-b8eb2b1b74a4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:19.849443 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-7e2f08a3-b1fc-4fa0-aa17-b8eb2b1b74a4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] HTTP exception thrown: Instance 75f28f3c-9647-4254-8b70-4b1f38be43eb could not be found. Apr 08 11:57:19.850088 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7e2f08a3-b1fc-4fa0-aa17-b8eb2b1b74a4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Returning 404 to user: Instance 75f28f3c-9647-4254-8b70-4b1f38be43eb could not be found. {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:57:19.850913 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7e2f08a3-b1fc-4fa0-aa17-b8eb2b1b74a4 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb" status: 404 len: 111 microversion: 2.1 time: 0.027606 Apr 08 11:57:19.851515 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2008/2944] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:19 2022] GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 11:57:19.859639 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4fda828c-a4be-426f-bde9-fd6af42efbc3 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '.version_select at 0x7f0428666b80>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:19.922060 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4fda828c-a4be-426f-bde9-fd6af42efbc3 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1499975988" status: 202 len: 0 microversion: 2.1 time: 0.065804 Apr 08 11:57:19.923274 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2009/2945] 10.222.0.46 () {58 vars in 1220 bytes} [Fri Apr 8 11:57:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1499975988 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 08 11:57:21.180752 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-631509a5-d34f-4a75-b153-0017da371de8 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8426740d-0c7a-4e22-9d28-1ea616b12937"}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:57:21.181826 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-631509a5-d34f-4a75-b153-0017da371de8 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:21.191461 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-631509a5-d34f-4a75-b153-0017da371de8 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:21.191927 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-631509a5-d34f-4a75-b153-0017da371de8 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:21.192687 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-631509a5-d34f-4a75-b153-0017da371de8 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:21.193123 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-631509a5-d34f-4a75-b153-0017da371de8 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:21.862946 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-631509a5-d34f-4a75-b153-0017da371de8 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "POST /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.686513 Apr 08 11:57:21.863617 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2010/2946] 10.222.0.46 () {60 vars in 1322 bytes} [Fri Apr 8 11:57:21 2022] POST /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe/os-volume_attachments => generated 194 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:57:23.186800 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9d97cbf5-cd2f-4922-b345-2c56828328ac tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:23.187396 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9d97cbf5-cd2f-4922-b345-2c56828328ac tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: 75f28f3c-9647-4254-8b70-4b1f38be43eb] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:23.193723 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9d97cbf5-cd2f-4922-b345-2c56828328ac tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:23.194221 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9d97cbf5-cd2f-4922-b345-2c56828328ac tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:23.194999 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9d97cbf5-cd2f-4922-b345-2c56828328ac tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:23.195443 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9d97cbf5-cd2f-4922-b345-2c56828328ac tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:23.209048 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-9d97cbf5-cd2f-4922-b345-2c56828328ac tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] HTTP exception thrown: Instance 75f28f3c-9647-4254-8b70-4b1f38be43eb could not be found. Apr 08 11:57:23.209642 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9d97cbf5-cd2f-4922-b345-2c56828328ac tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Returning 404 to user: Instance 75f28f3c-9647-4254-8b70-4b1f38be43eb could not be found. {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:57:23.210518 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9d97cbf5-cd2f-4922-b345-2c56828328ac tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "DELETE /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb" status: 404 len: 111 microversion: 2.1 time: 0.029110 Apr 08 11:57:23.211060 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2011/2947] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 8 11:57:23 2022] DELETE /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 11:57:23.218555 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-472c733e-ad10-4ab9-bc37-1efb7a87c7d2 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:23.219169 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-472c733e-ad10-4ab9-bc37-1efb7a87c7d2 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: 75f28f3c-9647-4254-8b70-4b1f38be43eb] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:23.225021 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-472c733e-ad10-4ab9-bc37-1efb7a87c7d2 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:23.225471 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-472c733e-ad10-4ab9-bc37-1efb7a87c7d2 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:23.226264 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-472c733e-ad10-4ab9-bc37-1efb7a87c7d2 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:23.226702 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-472c733e-ad10-4ab9-bc37-1efb7a87c7d2 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:23.241690 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-472c733e-ad10-4ab9-bc37-1efb7a87c7d2 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] HTTP exception thrown: Instance 75f28f3c-9647-4254-8b70-4b1f38be43eb could not be found. Apr 08 11:57:23.241690 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-472c733e-ad10-4ab9-bc37-1efb7a87c7d2 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Returning 404 to user: Instance 75f28f3c-9647-4254-8b70-4b1f38be43eb could not be found. {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:57:23.243761 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-472c733e-ad10-4ab9-bc37-1efb7a87c7d2 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb" status: 404 len: 111 microversion: 2.1 time: 0.027047 Apr 08 11:57:23.243761 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2012/2948] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:23 2022] GET /compute/v2.1/servers/75f28f3c-9647-4254-8b70-4b1f38be43eb => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 11:57:24.524176 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a5d0c570-9902-4785-b6bc-ccdd80d10388 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:24.524784 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a5d0c570-9902-4785-b6bc-ccdd80d10388 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:24.531262 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a5d0c570-9902-4785-b6bc-ccdd80d10388 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:24.531659 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a5d0c570-9902-4785-b6bc-ccdd80d10388 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:24.532433 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a5d0c570-9902-4785-b6bc-ccdd80d10388 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:24.532876 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a5d0c570-9902-4785-b6bc-ccdd80d10388 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:24.546010 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-a5d0c570-9902-4785-b6bc-ccdd80d10388 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] HTTP exception thrown: Instance eff1b1a4-3738-43db-86ce-a17e2f08ffc0 could not be found. Apr 08 11:57:24.546594 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a5d0c570-9902-4785-b6bc-ccdd80d10388 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Returning 404 to user: Instance eff1b1a4-3738-43db-86ce-a17e2f08ffc0 could not be found. {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:57:24.547457 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a5d0c570-9902-4785-b6bc-ccdd80d10388 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "DELETE /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 404 len: 111 microversion: 2.1 time: 0.027078 Apr 08 11:57:24.547980 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2013/2949] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 8 11:57:24 2022] DELETE /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 11:57:24.555332 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-56b69cf6-58a4-4ae9-8aec-0fa3c5b60487 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:24.555942 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-56b69cf6-58a4-4ae9-8aec-0fa3c5b60487 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] [instance: eff1b1a4-3738-43db-86ce-a17e2f08ffc0] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:24.561962 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-56b69cf6-58a4-4ae9-8aec-0fa3c5b60487 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:24.562417 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-56b69cf6-58a4-4ae9-8aec-0fa3c5b60487 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:24.563183 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-56b69cf6-58a4-4ae9-8aec-0fa3c5b60487 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:24.563624 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-56b69cf6-58a4-4ae9-8aec-0fa3c5b60487 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:24.576917 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-56b69cf6-58a4-4ae9-8aec-0fa3c5b60487 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] HTTP exception thrown: Instance eff1b1a4-3738-43db-86ce-a17e2f08ffc0 could not be found. Apr 08 11:57:24.577499 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-56b69cf6-58a4-4ae9-8aec-0fa3c5b60487 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] Returning 404 to user: Instance eff1b1a4-3738-43db-86ce-a17e2f08ffc0 could not be found. {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:57:24.578341 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-56b69cf6-58a4-4ae9-8aec-0fa3c5b60487 tempest-AttachVolumeTestJSON-1183496243 tempest-AttachVolumeTestJSON-1183496243-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0" status: 404 len: 111 microversion: 2.1 time: 0.026500 Apr 08 11:57:24.578860 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2014/2950] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:24 2022] GET /compute/v2.1/servers/eff1b1a4-3738-43db-86ce-a17e2f08ffc0 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 11:57:30.479712 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-dc5670e5-3841-43a1-86e8-11039ff62bbb tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:30.480341 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-dc5670e5-3841-43a1-86e8-11039ff62bbb tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:30.486630 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dc5670e5-3841-43a1-86e8-11039ff62bbb tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:30.487082 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dc5670e5-3841-43a1-86e8-11039ff62bbb tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:30.487850 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dc5670e5-3841-43a1-86e8-11039ff62bbb tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:30.488282 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dc5670e5-3841-43a1-86e8-11039ff62bbb tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:30.634758 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-dc5670e5-3841-43a1-86e8-11039ff62bbb tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:57:30.642958 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-dc5670e5-3841-43a1-86e8-11039ff62bbb tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1591 microversion: 2.1 time: 0.166895 Apr 08 11:57:30.643825 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2015/2951] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:30 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1591 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:57:33.237407 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-03f62963-25dd-40fd-b13c-7b175122e928 req-7fc6705d-8ec1-4161-a3af-f77b0fb8258d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ecf987c-6d9b-471f-ad88-64ec198a5cbe", "tag": "0d0bf587-5284-4d8f-acb8-dac2d5db2401"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:57:33.255114 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-03f62963-25dd-40fd-b13c-7b175122e928 req-7fc6705d-8ec1-4161-a3af-f77b0fb8258d service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:33.255952 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-03f62963-25dd-40fd-b13c-7b175122e928 req-7fc6705d-8ec1-4161-a3af-f77b0fb8258d service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:33.270184 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-03f62963-25dd-40fd-b13c-7b175122e928 req-7fc6705d-8ec1-4161-a3af-f77b0fb8258d service nova] Creating event network-changed:0d0bf587-5284-4d8f-acb8-dac2d5db2401 for instance 9ecf987c-6d9b-471f-ad88-64ec198a5cbe on hv-cinder-83607 Apr 08 11:57:33.277592 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-03f62963-25dd-40fd-b13c-7b175122e928 req-7fc6705d-8ec1-4161-a3af-f77b0fb8258d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043931 Apr 08 11:57:33.278802 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2016/2952] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:57:36.229736 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4e9acdee-7a52-41df-9081-7d7607364f0e tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1060505730"}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:57:36.230482 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4e9acdee-7a52-41df-9081-7d7607364f0e tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:36.239036 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4e9acdee-7a52-41df-9081-7d7607364f0e tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:36.241965 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4e9acdee-7a52-41df-9081-7d7607364f0e tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:36.241965 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4e9acdee-7a52-41df-9081-7d7607364f0e tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:36.241965 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4e9acdee-7a52-41df-9081-7d7607364f0e tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:36.478367 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.network.security_group_api [None req-4e9acdee-7a52-41df-9081-7d7607364f0e tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Adding security group 0b646ee5-aab7-4c08-b120-04d382b64f60 to port 0d0bf587-5284-4d8f-acb8-dac2d5db2401 Apr 08 11:57:37.042139 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4e9acdee-7a52-41df-9081-7d7607364f0e tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "POST /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe/action" status: 202 len: 0 microversion: 2.1 time: 0.817852 Apr 08 11:57:37.043245 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2017/2953] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Apr 8 11:57:36 2022] POST /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe/action => generated 0 bytes in 820 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 11:57:37.198634 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d642ec02-aed9-4fef-a059-f1bf7028b8f8 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Action: 'create', calling method: .version_select at 0x7f04286669d0>, body: {"keypair": {"name": "tempest-keypair-415892961"}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:57:37.218553 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-d642ec02-aed9-4fef-a059-f1bf7028b8f8 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Getting quotas for project 64941c642e224d3f88408dabb16d87c6. Resources: {'key_pairs'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 11:57:37.223136 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-d642ec02-aed9-4fef-a059-f1bf7028b8f8 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Getting quotas for user 53044dbca5d24a1d9a67b158cede818a and project 64941c642e224d3f88408dabb16d87c6. Resources: {'key_pairs'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 11:57:37.616071 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-d642ec02-aed9-4fef-a059-f1bf7028b8f8 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Getting quotas for project 64941c642e224d3f88408dabb16d87c6. Resources: {'key_pairs'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 11:57:37.620414 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-d642ec02-aed9-4fef-a059-f1bf7028b8f8 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Getting quotas for user 53044dbca5d24a1d9a67b158cede818a and project 64941c642e224d3f88408dabb16d87c6. Resources: {'key_pairs'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 11:57:37.633692 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d642ec02-aed9-4fef-a059-f1bf7028b8f8 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.589200 Apr 08 11:57:37.639988 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2018/2954] 10.222.0.46 () {60 vars in 1157 bytes} [Fri Apr 8 11:57:37 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:57:37.642799 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a0b799a4-1d07-440d-936c-a4d2ac478ae9 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:37.644026 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a0b799a4-1d07-440d-936c-a4d2ac478ae9 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:37.658250 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a0b799a4-1d07-440d-936c-a4d2ac478ae9 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:37.658974 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a0b799a4-1d07-440d-936c-a4d2ac478ae9 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:37.662208 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a0b799a4-1d07-440d-936c-a4d2ac478ae9 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:37.662208 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a0b799a4-1d07-440d-936c-a4d2ac478ae9 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:37.850394 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a0b799a4-1d07-440d-936c-a4d2ac478ae9 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:57:37.858929 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a0b799a4-1d07-440d-936c-a4d2ac478ae9 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1757 microversion: 2.1 time: 0.223602 Apr 08 11:57:37.859513 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2019/2955] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:37 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1757 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:57:37.870483 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-a5aa3d0c-99b3-4ebe-bbc2-063598195765 req-13b13e6c-7710-4e9f-b736-b3cde78fc05d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ecf987c-6d9b-471f-ad88-64ec198a5cbe", "tag": "0d0bf587-5284-4d8f-acb8-dac2d5db2401"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:57:37.880695 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-a5aa3d0c-99b3-4ebe-bbc2-063598195765 req-13b13e6c-7710-4e9f-b736-b3cde78fc05d service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:37.885125 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-a5aa3d0c-99b3-4ebe-bbc2-063598195765 req-13b13e6c-7710-4e9f-b736-b3cde78fc05d service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:37.896553 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-a5aa3d0c-99b3-4ebe-bbc2-063598195765 req-13b13e6c-7710-4e9f-b736-b3cde78fc05d service nova] Creating event network-changed:0d0bf587-5284-4d8f-acb8-dac2d5db2401 for instance 9ecf987c-6d9b-471f-ad88-64ec198a5cbe on hv-cinder-83607 Apr 08 11:57:37.904499 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-a5aa3d0c-99b3-4ebe-bbc2-063598195765 req-13b13e6c-7710-4e9f-b736-b3cde78fc05d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037589 Apr 08 11:57:37.905288 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2020/2956] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:57:40.050266 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6fb7017b-f6bc-4e5c-bc17-b3fd8c191615 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1105881378", "imageRef": "35b8d8d2-a0e9-4c3e-8586-5e088dec27e6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bcb00e23-144e-490a-8c89-75aeca201213"}], "security_groups": [{"name": "tempest-securitygroup--1870747600"}], "key_name": "tempest-keypair-415892961", "user_data": "}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:57:40.158830 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.network.neutron [None req-6fb7017b-f6bc-4e5c-bc17-b3fd8c191615 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] validate_networks() for [('bcb00e23-144e-490a-8c89-75aeca201213', None, None, None, None, None)] {{(pid=117800) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 08 11:57:40.555170 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-6fb7017b-f6bc-4e5c-bc17-b3fd8c191615 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Flavor limits 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 11:57:40.555601 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-6fb7017b-f6bc-4e5c-bc17-b3fd8c191615 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Image limits 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 11:57:40.556079 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-6fb7017b-f6bc-4e5c-bc17-b3fd8c191615 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Flavor pref 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 11:57:40.556500 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-6fb7017b-f6bc-4e5c-bc17-b3fd8c191615 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Image pref 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 11:57:40.556912 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-6fb7017b-f6bc-4e5c-bc17-b3fd8c191615 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 11:57:40.565953 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6fb7017b-f6bc-4e5c-bc17-b3fd8c191615 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:40.566409 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6fb7017b-f6bc-4e5c-bc17-b3fd8c191615 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:40.567275 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6fb7017b-f6bc-4e5c-bc17-b3fd8c191615 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:40.567720 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6fb7017b-f6bc-4e5c-bc17-b3fd8c191615 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:40.585601 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-6fb7017b-f6bc-4e5c-bc17-b3fd8c191615 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Getting quotas for project 64941c642e224d3f88408dabb16d87c6. Resources: {'instances', 'ram', 'cores'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 11:57:40.589859 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-6fb7017b-f6bc-4e5c-bc17-b3fd8c191615 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Getting quotas for user 53044dbca5d24a1d9a67b158cede818a and project 64941c642e224d3f88408dabb16d87c6. Resources: {'instances', 'ram', 'cores'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 11:57:40.602269 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6fb7017b-f6bc-4e5c-bc17-b3fd8c191615 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Going to run 1 instances... {{(pid=117800) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 08 11:57:40.604681 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6fb7017b-f6bc-4e5c-bc17-b3fd8c191615 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: b18587f1-b868-4631-9e70-86c38739a780] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='35b8d8d2-a0e9-4c3e-8586-5e088dec27e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 08 11:57:40.746313 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6fb7017b-f6bc-4e5c-bc17-b3fd8c191615 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.700605 Apr 08 11:57:40.746973 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2021/2957] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Apr 8 11:57:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 11:57:40.756760 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-56d803ce-9c54-4294-859f-cbb16f849715 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:40.758154 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-56d803ce-9c54-4294-859f-cbb16f849715 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: b18587f1-b868-4631-9e70-86c38739a780] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:40.818688 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-56d803ce-9c54-4294-859f-cbb16f849715 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:57:40.827463 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-56d803ce-9c54-4294-859f-cbb16f849715 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780" status: 200 len: 1241 microversion: 2.1 time: 0.074390 Apr 08 11:57:40.828122 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2022/2958] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:40 2022] GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780 => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:57:41.844398 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-03a18828-6acb-47fd-a687-3e42441f2f24 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:41.845128 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-03a18828-6acb-47fd-a687-3e42441f2f24 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: b18587f1-b868-4631-9e70-86c38739a780] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:41.851667 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-03a18828-6acb-47fd-a687-3e42441f2f24 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:41.852152 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-03a18828-6acb-47fd-a687-3e42441f2f24 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:41.852955 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-03a18828-6acb-47fd-a687-3e42441f2f24 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:41.853389 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-03a18828-6acb-47fd-a687-3e42441f2f24 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:41.914387 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-03a18828-6acb-47fd-a687-3e42441f2f24 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:57:41.921881 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-03a18828-6acb-47fd-a687-3e42441f2f24 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780" status: 200 len: 1245 microversion: 2.1 time: 0.081248 Apr 08 11:57:41.922488 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2023/2959] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:41 2022] GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:57:42.939476 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7492f800-4cd9-4c2a-bcd4-6e9d6ed799e6 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:42.940139 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7492f800-4cd9-4c2a-bcd4-6e9d6ed799e6 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: b18587f1-b868-4631-9e70-86c38739a780] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:42.947187 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7492f800-4cd9-4c2a-bcd4-6e9d6ed799e6 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:42.947644 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7492f800-4cd9-4c2a-bcd4-6e9d6ed799e6 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:42.948425 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7492f800-4cd9-4c2a-bcd4-6e9d6ed799e6 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:42.948869 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7492f800-4cd9-4c2a-bcd4-6e9d6ed799e6 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:43.012143 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7492f800-4cd9-4c2a-bcd4-6e9d6ed799e6 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:57:43.019566 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7492f800-4cd9-4c2a-bcd4-6e9d6ed799e6 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780" status: 200 len: 1293 microversion: 2.1 time: 0.084187 Apr 08 11:57:43.020279 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2024/2960] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:42 2022] GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:57:44.037819 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f8a430fd-518b-4988-9f77-cb81bd66d1e7 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:44.039166 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f8a430fd-518b-4988-9f77-cb81bd66d1e7 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: b18587f1-b868-4631-9e70-86c38739a780] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:44.046680 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f8a430fd-518b-4988-9f77-cb81bd66d1e7 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:44.047157 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f8a430fd-518b-4988-9f77-cb81bd66d1e7 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:44.047945 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f8a430fd-518b-4988-9f77-cb81bd66d1e7 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:44.048391 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f8a430fd-518b-4988-9f77-cb81bd66d1e7 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:44.183921 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f8a430fd-518b-4988-9f77-cb81bd66d1e7 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:57:44.191754 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f8a430fd-518b-4988-9f77-cb81bd66d1e7 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780" status: 200 len: 1367 microversion: 2.1 time: 0.158000 Apr 08 11:57:44.192337 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2025/2961] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:44 2022] GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:57:44.898392 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-044ec450-a993-474b-b72d-d7a1edba1fc8 req-14aa6293-aba2-4915-8bfe-2ab90120b257 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b18587f1-b868-4631-9e70-86c38739a780", "tag": "8befa44b-4087-4b70-a387-58cdf6b2b777"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:57:44.907167 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-044ec450-a993-474b-b72d-d7a1edba1fc8 req-14aa6293-aba2-4915-8bfe-2ab90120b257 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:44.910279 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-044ec450-a993-474b-b72d-d7a1edba1fc8 req-14aa6293-aba2-4915-8bfe-2ab90120b257 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:44.926280 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-044ec450-a993-474b-b72d-d7a1edba1fc8 req-14aa6293-aba2-4915-8bfe-2ab90120b257 service nova] Creating event network-changed:8befa44b-4087-4b70-a387-58cdf6b2b777 for instance b18587f1-b868-4631-9e70-86c38739a780 on hv-cinder-83607 Apr 08 11:57:44.933140 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-044ec450-a993-474b-b72d-d7a1edba1fc8 req-14aa6293-aba2-4915-8bfe-2ab90120b257 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037432 Apr 08 11:57:44.933140 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2026/2962] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:57:45.209555 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-41d7b006-9199-4b70-89ec-97c2749f2197 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:45.210246 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-41d7b006-9199-4b70-89ec-97c2749f2197 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: b18587f1-b868-4631-9e70-86c38739a780] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:45.216210 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-41d7b006-9199-4b70-89ec-97c2749f2197 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:45.216660 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-41d7b006-9199-4b70-89ec-97c2749f2197 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:45.217433 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-41d7b006-9199-4b70-89ec-97c2749f2197 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:45.217899 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-41d7b006-9199-4b70-89ec-97c2749f2197 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:45.355257 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-41d7b006-9199-4b70-89ec-97c2749f2197 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:57:45.363124 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-41d7b006-9199-4b70-89ec-97c2749f2197 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780" status: 200 len: 1367 microversion: 2.1 time: 0.157742 Apr 08 11:57:45.363124 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2027/2963] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:45 2022] GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:57:46.379344 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4558290b-27d8-4bc5-8645-4cb0b7f52073 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:46.380037 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4558290b-27d8-4bc5-8645-4cb0b7f52073 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: b18587f1-b868-4631-9e70-86c38739a780] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:46.387065 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4558290b-27d8-4bc5-8645-4cb0b7f52073 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:46.387508 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4558290b-27d8-4bc5-8645-4cb0b7f52073 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:46.388263 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4558290b-27d8-4bc5-8645-4cb0b7f52073 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:46.388700 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4558290b-27d8-4bc5-8645-4cb0b7f52073 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:46.524037 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4558290b-27d8-4bc5-8645-4cb0b7f52073 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:57:46.531964 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4558290b-27d8-4bc5-8645-4cb0b7f52073 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780" status: 200 len: 1367 microversion: 2.1 time: 0.156417 Apr 08 11:57:46.532540 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2028/2964] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:46 2022] GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:57:47.549443 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-cf9ab653-41e7-4c17-b5b5-c463d08457fd tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:47.550198 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-cf9ab653-41e7-4c17-b5b5-c463d08457fd tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: b18587f1-b868-4631-9e70-86c38739a780] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:47.556424 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cf9ab653-41e7-4c17-b5b5-c463d08457fd tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:47.556869 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cf9ab653-41e7-4c17-b5b5-c463d08457fd tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:47.557631 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cf9ab653-41e7-4c17-b5b5-c463d08457fd tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:47.558104 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cf9ab653-41e7-4c17-b5b5-c463d08457fd tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:47.689920 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-cf9ab653-41e7-4c17-b5b5-c463d08457fd tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:57:47.697825 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-cf9ab653-41e7-4c17-b5b5-c463d08457fd tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780" status: 200 len: 1367 microversion: 2.1 time: 0.152254 Apr 08 11:57:47.698395 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2029/2965] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:47 2022] GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:57:48.715044 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c431d763-8a6a-4422-bf5c-d99e529ae95a tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:48.715698 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c431d763-8a6a-4422-bf5c-d99e529ae95a tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: b18587f1-b868-4631-9e70-86c38739a780] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:48.722063 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c431d763-8a6a-4422-bf5c-d99e529ae95a tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:48.722528 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c431d763-8a6a-4422-bf5c-d99e529ae95a tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:48.723302 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c431d763-8a6a-4422-bf5c-d99e529ae95a tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:48.723745 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c431d763-8a6a-4422-bf5c-d99e529ae95a tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:48.858863 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c431d763-8a6a-4422-bf5c-d99e529ae95a tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:57:48.866124 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c431d763-8a6a-4422-bf5c-d99e529ae95a tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780" status: 200 len: 1367 microversion: 2.1 time: 0.154996 Apr 08 11:57:48.866719 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2030/2966] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:48 2022] GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:57:49.882975 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-87c0fa3f-f6f5-49ca-a38e-262c5406baf5 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:49.883672 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-87c0fa3f-f6f5-49ca-a38e-262c5406baf5 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: b18587f1-b868-4631-9e70-86c38739a780] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:49.889969 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-87c0fa3f-f6f5-49ca-a38e-262c5406baf5 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:49.890426 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-87c0fa3f-f6f5-49ca-a38e-262c5406baf5 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:49.891191 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-87c0fa3f-f6f5-49ca-a38e-262c5406baf5 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:49.891631 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-87c0fa3f-f6f5-49ca-a38e-262c5406baf5 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:50.021248 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-87c0fa3f-f6f5-49ca-a38e-262c5406baf5 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:57:50.029309 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-87c0fa3f-f6f5-49ca-a38e-262c5406baf5 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780" status: 200 len: 1367 microversion: 2.1 time: 0.150219 Apr 08 11:57:50.029905 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2031/2967] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:49 2022] GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:57:51.046886 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c8637109-ad4a-4c6f-b428-78878eb3f2ac tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:51.047567 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c8637109-ad4a-4c6f-b428-78878eb3f2ac tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: b18587f1-b868-4631-9e70-86c38739a780] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:51.054571 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c8637109-ad4a-4c6f-b428-78878eb3f2ac tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:51.055032 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c8637109-ad4a-4c6f-b428-78878eb3f2ac tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:51.055796 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c8637109-ad4a-4c6f-b428-78878eb3f2ac tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:51.056234 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c8637109-ad4a-4c6f-b428-78878eb3f2ac tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:51.186352 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c8637109-ad4a-4c6f-b428-78878eb3f2ac tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:57:51.193609 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c8637109-ad4a-4c6f-b428-78878eb3f2ac tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780" status: 200 len: 1367 microversion: 2.1 time: 0.150579 Apr 08 11:57:51.194206 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2032/2968] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:51 2022] GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:57:52.210717 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-53e83a0e-c036-4142-aeba-9502781fefdb tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:52.211416 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-53e83a0e-c036-4142-aeba-9502781fefdb tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: b18587f1-b868-4631-9e70-86c38739a780] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:52.217781 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-53e83a0e-c036-4142-aeba-9502781fefdb tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:52.218245 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-53e83a0e-c036-4142-aeba-9502781fefdb tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:52.219016 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-53e83a0e-c036-4142-aeba-9502781fefdb tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:52.219462 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-53e83a0e-c036-4142-aeba-9502781fefdb tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:52.362613 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-53e83a0e-c036-4142-aeba-9502781fefdb tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:57:52.370428 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-53e83a0e-c036-4142-aeba-9502781fefdb tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780" status: 200 len: 1367 microversion: 2.1 time: 0.163659 Apr 08 11:57:52.370999 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2033/2969] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:52 2022] GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:57:52.619495 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-160d44cb-290a-4b90-a4ed-46a82983ceb6 req-a95ec31d-31b1-4614-b07f-82dc3298e023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b18587f1-b868-4631-9e70-86c38739a780", "name": "network-vif-plugged", "status": "completed", "tag": "8befa44b-4087-4b70-a387-58cdf6b2b777"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:57:52.627332 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-160d44cb-290a-4b90-a4ed-46a82983ceb6 req-a95ec31d-31b1-4614-b07f-82dc3298e023 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:52.627781 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-160d44cb-290a-4b90-a4ed-46a82983ceb6 req-a95ec31d-31b1-4614-b07f-82dc3298e023 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:52.638520 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-160d44cb-290a-4b90-a4ed-46a82983ceb6 req-a95ec31d-31b1-4614-b07f-82dc3298e023 service nova] Creating event network-vif-plugged:8befa44b-4087-4b70-a387-58cdf6b2b777 for instance b18587f1-b868-4631-9e70-86c38739a780 on hv-cinder-83607 Apr 08 11:57:52.643605 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-160d44cb-290a-4b90-a4ed-46a82983ceb6 req-a95ec31d-31b1-4614-b07f-82dc3298e023 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028358 Apr 08 11:57:52.644382 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2034/2970] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:57:53.388507 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-33ba91cc-a950-4f12-a40e-d3516daff224 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:53.389194 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-33ba91cc-a950-4f12-a40e-d3516daff224 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: b18587f1-b868-4631-9e70-86c38739a780] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:53.395480 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-33ba91cc-a950-4f12-a40e-d3516daff224 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:53.396001 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-33ba91cc-a950-4f12-a40e-d3516daff224 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:53.397347 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-33ba91cc-a950-4f12-a40e-d3516daff224 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:53.397813 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-33ba91cc-a950-4f12-a40e-d3516daff224 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:53.530196 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-33ba91cc-a950-4f12-a40e-d3516daff224 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:57:53.537444 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-33ba91cc-a950-4f12-a40e-d3516daff224 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780" status: 200 len: 1367 microversion: 2.1 time: 0.153594 Apr 08 11:57:53.538045 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2035/2971] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:53 2022] GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:57:54.554320 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3040a34c-d996-4a18-8ea6-1f8c817247f5 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:54.554939 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3040a34c-d996-4a18-8ea6-1f8c817247f5 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: b18587f1-b868-4631-9e70-86c38739a780] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:54.561224 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3040a34c-d996-4a18-8ea6-1f8c817247f5 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:54.561692 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3040a34c-d996-4a18-8ea6-1f8c817247f5 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:54.562482 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3040a34c-d996-4a18-8ea6-1f8c817247f5 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:54.562913 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3040a34c-d996-4a18-8ea6-1f8c817247f5 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:54.709591 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3040a34c-d996-4a18-8ea6-1f8c817247f5 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:57:54.718889 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3040a34c-d996-4a18-8ea6-1f8c817247f5 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780" status: 200 len: 1367 microversion: 2.1 time: 0.168430 Apr 08 11:57:54.719473 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2036/2972] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:54 2022] GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:57:55.736579 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-26f6e67d-cb06-4167-87f4-d6dc71e1b601 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:55.737269 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-26f6e67d-cb06-4167-87f4-d6dc71e1b601 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: b18587f1-b868-4631-9e70-86c38739a780] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:55.744247 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-26f6e67d-cb06-4167-87f4-d6dc71e1b601 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:55.744697 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-26f6e67d-cb06-4167-87f4-d6dc71e1b601 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:55.745461 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-26f6e67d-cb06-4167-87f4-d6dc71e1b601 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:55.745961 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-26f6e67d-cb06-4167-87f4-d6dc71e1b601 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:55.881451 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-26f6e67d-cb06-4167-87f4-d6dc71e1b601 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:57:55.888722 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-26f6e67d-cb06-4167-87f4-d6dc71e1b601 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780" status: 200 len: 1557 microversion: 2.1 time: 0.156105 Apr 08 11:57:55.889286 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2037/2973] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:57:55 2022] GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780 => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:57:55.905559 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-790f9fa9-d881-4b78-a765-b120b736bacd tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:57:55.906016 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-790f9fa9-d881-4b78-a765-b120b736bacd tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: b18587f1-b868-4631-9e70-86c38739a780] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:57:55.912527 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-790f9fa9-d881-4b78-a765-b120b736bacd tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:55.912988 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-790f9fa9-d881-4b78-a765-b120b736bacd tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:55.913760 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-790f9fa9-d881-4b78-a765-b120b736bacd tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:55.914224 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-790f9fa9-d881-4b78-a765-b120b736bacd tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:55.993682 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-790f9fa9-d881-4b78-a765-b120b736bacd tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091843 Apr 08 11:57:55.994328 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2038/2974] 10.222.0.46 () {58 vars in 1274 bytes} [Fri Apr 8 11:57:55 2022] GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:57:57.294856 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-b7d956f6-86f7-4228-bff4-48fbc414c5d6 req-b9654da7-0bf8-4c65-b73f-3ad8b89e43ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b18587f1-b868-4631-9e70-86c38739a780", "tag": "8befa44b-4087-4b70-a387-58cdf6b2b777"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:57:57.304093 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-b7d956f6-86f7-4228-bff4-48fbc414c5d6 req-b9654da7-0bf8-4c65-b73f-3ad8b89e43ad service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:57:57.304632 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-b7d956f6-86f7-4228-bff4-48fbc414c5d6 req-b9654da7-0bf8-4c65-b73f-3ad8b89e43ad service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:57:57.315503 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-b7d956f6-86f7-4228-bff4-48fbc414c5d6 req-b9654da7-0bf8-4c65-b73f-3ad8b89e43ad service nova] Creating event network-changed:8befa44b-4087-4b70-a387-58cdf6b2b777 for instance b18587f1-b868-4631-9e70-86c38739a780 on hv-cinder-83607 Apr 08 11:57:57.320420 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-b7d956f6-86f7-4228-bff4-48fbc414c5d6 req-b9654da7-0bf8-4c65-b73f-3ad8b89e43ad service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029704 Apr 08 11:57:57.321286 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2039/2975] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:58:35.287574 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1ea5594e-fdd6-4845-a1f2-3a0c50a04614 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:58:35.289146 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1ea5594e-fdd6-4845-a1f2-3a0c50a04614 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:58:35.295289 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ea5594e-fdd6-4845-a1f2-3a0c50a04614 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:58:35.295745 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ea5594e-fdd6-4845-a1f2-3a0c50a04614 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:58:35.296506 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ea5594e-fdd6-4845-a1f2-3a0c50a04614 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:58:35.297057 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ea5594e-fdd6-4845-a1f2-3a0c50a04614 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:58:35.499688 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1ea5594e-fdd6-4845-a1f2-3a0c50a04614 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "POST /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe/action" status: 202 len: 0 microversion: 2.1 time: 0.216525 Apr 08 11:58:35.501015 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2040/2976] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Apr 8 11:58:35 2022] POST /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 08 11:58:35.509434 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-cd777a8b-cab8-45c1-bd78-4919e3b2d651 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:58:35.510202 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-cd777a8b-cab8-45c1-bd78-4919e3b2d651 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:58:35.516177 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cd777a8b-cab8-45c1-bd78-4919e3b2d651 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:58:35.516628 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cd777a8b-cab8-45c1-bd78-4919e3b2d651 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:58:35.517405 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cd777a8b-cab8-45c1-bd78-4919e3b2d651 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:58:35.517963 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-cd777a8b-cab8-45c1-bd78-4919e3b2d651 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:58:35.671365 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-cd777a8b-cab8-45c1-bd78-4919e3b2d651 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:58:35.680137 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-cd777a8b-cab8-45c1-bd78-4919e3b2d651 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1749 microversion: 2.1 time: 0.175500 Apr 08 11:58:35.680717 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2041/2977] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:58:35 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1749 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:58:36.698737 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-53307fdb-eb9e-4d45-936a-cba467e6d52a tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:58:36.699417 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-53307fdb-eb9e-4d45-936a-cba467e6d52a tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:58:36.705627 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-53307fdb-eb9e-4d45-936a-cba467e6d52a tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:58:36.715051 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-53307fdb-eb9e-4d45-936a-cba467e6d52a tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:58:36.715051 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-53307fdb-eb9e-4d45-936a-cba467e6d52a tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:58:36.715051 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-53307fdb-eb9e-4d45-936a-cba467e6d52a tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:58:36.851582 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-53307fdb-eb9e-4d45-936a-cba467e6d52a tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:58:36.859403 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-53307fdb-eb9e-4d45-936a-cba467e6d52a tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1754 microversion: 2.1 time: 0.165099 Apr 08 11:58:36.859965 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2042/2978] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:58:36 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:58:37.876796 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-93eebfa3-56a4-48ea-8af4-f0e5ece346dd tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:58:37.877497 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-93eebfa3-56a4-48ea-8af4-f0e5ece346dd tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:58:37.883927 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-93eebfa3-56a4-48ea-8af4-f0e5ece346dd tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:58:37.884385 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-93eebfa3-56a4-48ea-8af4-f0e5ece346dd tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:58:37.885160 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-93eebfa3-56a4-48ea-8af4-f0e5ece346dd tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:58:37.885604 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-93eebfa3-56a4-48ea-8af4-f0e5ece346dd tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:58:38.034066 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-93eebfa3-56a4-48ea-8af4-f0e5ece346dd tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:58:38.041396 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-93eebfa3-56a4-48ea-8af4-f0e5ece346dd tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1754 microversion: 2.1 time: 0.168466 Apr 08 11:58:38.042006 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2043/2979] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:58:37 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:58:39.059144 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a2a5c03f-1535-42d0-944a-5a3b79c2bd68 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:58:39.059858 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a2a5c03f-1535-42d0-944a-5a3b79c2bd68 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:58:39.066109 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a2a5c03f-1535-42d0-944a-5a3b79c2bd68 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:58:39.066567 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a2a5c03f-1535-42d0-944a-5a3b79c2bd68 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:58:39.067341 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a2a5c03f-1535-42d0-944a-5a3b79c2bd68 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:58:39.067784 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a2a5c03f-1535-42d0-944a-5a3b79c2bd68 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:58:39.210436 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a2a5c03f-1535-42d0-944a-5a3b79c2bd68 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:58:39.218323 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a2a5c03f-1535-42d0-944a-5a3b79c2bd68 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1754 microversion: 2.1 time: 0.163017 Apr 08 11:58:39.218898 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2044/2980] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:58:39 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:58:40.235795 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2098345f-8adf-41b4-8066-71e1b1cbd55b tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:58:40.236536 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2098345f-8adf-41b4-8066-71e1b1cbd55b tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:58:40.242854 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2098345f-8adf-41b4-8066-71e1b1cbd55b tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:58:40.243309 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2098345f-8adf-41b4-8066-71e1b1cbd55b tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:58:40.244090 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2098345f-8adf-41b4-8066-71e1b1cbd55b tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:58:40.244535 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2098345f-8adf-41b4-8066-71e1b1cbd55b tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:58:40.391394 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2098345f-8adf-41b4-8066-71e1b1cbd55b tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:58:40.400058 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2098345f-8adf-41b4-8066-71e1b1cbd55b tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1754 microversion: 2.1 time: 0.168140 Apr 08 11:58:40.400640 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2045/2981] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:58:40 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:58:41.417095 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-21747b6e-78cf-46f8-8ab3-f009afba0aa7 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:58:41.417778 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-21747b6e-78cf-46f8-8ab3-f009afba0aa7 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:58:41.424231 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-21747b6e-78cf-46f8-8ab3-f009afba0aa7 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:58:41.424688 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-21747b6e-78cf-46f8-8ab3-f009afba0aa7 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:58:41.425477 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-21747b6e-78cf-46f8-8ab3-f009afba0aa7 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:58:41.425955 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-21747b6e-78cf-46f8-8ab3-f009afba0aa7 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:58:41.574339 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-21747b6e-78cf-46f8-8ab3-f009afba0aa7 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:58:41.582314 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-21747b6e-78cf-46f8-8ab3-f009afba0aa7 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1754 microversion: 2.1 time: 0.169066 Apr 08 11:58:41.582879 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2046/2982] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:58:41 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:58:42.606814 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-917af2fb-667f-4a98-9dad-5952d9df2083 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:58:42.607489 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-917af2fb-667f-4a98-9dad-5952d9df2083 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:58:42.613658 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-917af2fb-667f-4a98-9dad-5952d9df2083 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:58:42.614137 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-917af2fb-667f-4a98-9dad-5952d9df2083 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:58:42.614909 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-917af2fb-667f-4a98-9dad-5952d9df2083 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:58:42.616017 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-917af2fb-667f-4a98-9dad-5952d9df2083 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:58:42.761202 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-917af2fb-667f-4a98-9dad-5952d9df2083 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:58:42.770120 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-917af2fb-667f-4a98-9dad-5952d9df2083 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1754 microversion: 2.1 time: 0.167134 Apr 08 11:58:42.770713 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2047/2983] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:58:42 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:58:43.787623 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3e9cacb9-344a-4c32-94c7-821a4fade8d3 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:58:43.788309 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3e9cacb9-344a-4c32-94c7-821a4fade8d3 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:58:43.794763 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3e9cacb9-344a-4c32-94c7-821a4fade8d3 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:58:43.795309 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3e9cacb9-344a-4c32-94c7-821a4fade8d3 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:58:43.796116 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3e9cacb9-344a-4c32-94c7-821a4fade8d3 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:58:43.796550 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3e9cacb9-344a-4c32-94c7-821a4fade8d3 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:58:43.945354 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3e9cacb9-344a-4c32-94c7-821a4fade8d3 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:58:43.953115 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3e9cacb9-344a-4c32-94c7-821a4fade8d3 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1754 microversion: 2.1 time: 0.169495 Apr 08 11:58:43.953680 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2048/2984] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:58:43 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:58:44.970290 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bc39ca97-c371-4cbb-9e1c-7fd91af590c2 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:58:44.970949 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-bc39ca97-c371-4cbb-9e1c-7fd91af590c2 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:58:44.977715 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bc39ca97-c371-4cbb-9e1c-7fd91af590c2 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:58:44.978192 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bc39ca97-c371-4cbb-9e1c-7fd91af590c2 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:58:44.978959 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bc39ca97-c371-4cbb-9e1c-7fd91af590c2 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:58:44.979398 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bc39ca97-c371-4cbb-9e1c-7fd91af590c2 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:58:45.123568 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-bc39ca97-c371-4cbb-9e1c-7fd91af590c2 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:58:45.131355 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-bc39ca97-c371-4cbb-9e1c-7fd91af590c2 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1754 microversion: 2.1 time: 0.164994 Apr 08 11:58:45.131928 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2049/2985] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:58:44 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:58:46.148476 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-735a37ed-754c-4e86-bb92-65d6d0738050 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:58:46.149166 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-735a37ed-754c-4e86-bb92-65d6d0738050 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:58:46.155400 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-735a37ed-754c-4e86-bb92-65d6d0738050 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:58:46.155854 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-735a37ed-754c-4e86-bb92-65d6d0738050 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:58:46.156625 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-735a37ed-754c-4e86-bb92-65d6d0738050 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:58:46.157059 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-735a37ed-754c-4e86-bb92-65d6d0738050 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:58:46.304930 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-735a37ed-754c-4e86-bb92-65d6d0738050 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:58:46.312669 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-735a37ed-754c-4e86-bb92-65d6d0738050 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1754 microversion: 2.1 time: 0.168301 Apr 08 11:58:46.313240 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2050/2986] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:58:46 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:58:47.330656 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a072b367-98c2-4d9a-8983-f1ad87ecb216 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:58:47.331354 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a072b367-98c2-4d9a-8983-f1ad87ecb216 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:58:47.338465 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a072b367-98c2-4d9a-8983-f1ad87ecb216 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:58:47.338918 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a072b367-98c2-4d9a-8983-f1ad87ecb216 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:58:47.339693 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a072b367-98c2-4d9a-8983-f1ad87ecb216 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:58:47.340133 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a072b367-98c2-4d9a-8983-f1ad87ecb216 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:58:47.483639 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a072b367-98c2-4d9a-8983-f1ad87ecb216 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:58:47.491968 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a072b367-98c2-4d9a-8983-f1ad87ecb216 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1757 microversion: 2.1 time: 0.165208 Apr 08 11:58:47.492555 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2051/2987] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:58:47 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:59:12.440262 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c38f4f19-b609-41c1-be69-3f0a8dae4f9c tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:59:12.440981 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c38f4f19-b609-41c1-be69-3f0a8dae4f9c tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: b18587f1-b868-4631-9e70-86c38739a780] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:59:12.446885 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c38f4f19-b609-41c1-be69-3f0a8dae4f9c tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:12.447342 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c38f4f19-b609-41c1-be69-3f0a8dae4f9c tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:12.448113 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c38f4f19-b609-41c1-be69-3f0a8dae4f9c tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:12.448558 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c38f4f19-b609-41c1-be69-3f0a8dae4f9c tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:12.471031 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c38f4f19-b609-41c1-be69-3f0a8dae4f9c tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780/ips" status: 200 len: 150 microversion: 2.1 time: 0.034650 Apr 08 11:59:12.471606 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2052/2988] 10.222.0.46 () {58 vars in 1247 bytes} [Fri Apr 8 11:59:12 2022] GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780/ips => generated 150 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:59:15.310690 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4637f5a3-9cb9-4d7c-bbb9-69b37d599690 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60702440-2066-41d6-a289-688a925e3c5c"}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:59:15.312123 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4637f5a3-9cb9-4d7c-bbb9-69b37d599690 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: b18587f1-b868-4631-9e70-86c38739a780] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:59:15.318750 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4637f5a3-9cb9-4d7c-bbb9-69b37d599690 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:15.319205 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4637f5a3-9cb9-4d7c-bbb9-69b37d599690 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:15.319978 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4637f5a3-9cb9-4d7c-bbb9-69b37d599690 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:15.320422 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4637f5a3-9cb9-4d7c-bbb9-69b37d599690 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:16.087901 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4637f5a3-9cb9-4d7c-bbb9-69b37d599690 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "POST /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.780715 Apr 08 11:59:16.088536 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2053/2989] 10.222.0.46 () {60 vars in 1322 bytes} [Fri Apr 8 11:59:15 2022] POST /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780/os-volume_attachments => generated 194 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:59:24.609603 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0a8e7a96-cc86-46aa-9282-ead273376e0c tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Action: 'create', calling method: .version_select at 0x7f041f6c11f0>, body: {"keypair": {"name": "tempest-keypair-454168631"}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:59:24.624394 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-0a8e7a96-cc86-46aa-9282-ead273376e0c tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Getting quotas for project 64941c642e224d3f88408dabb16d87c6. Resources: {'key_pairs'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 11:59:24.628189 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-0a8e7a96-cc86-46aa-9282-ead273376e0c tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Getting quotas for user 53044dbca5d24a1d9a67b158cede818a and project 64941c642e224d3f88408dabb16d87c6. Resources: {'key_pairs'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 11:59:24.910364 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-0a8e7a96-cc86-46aa-9282-ead273376e0c tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Getting quotas for project 64941c642e224d3f88408dabb16d87c6. Resources: {'key_pairs'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 11:59:24.914047 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-0a8e7a96-cc86-46aa-9282-ead273376e0c tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Getting quotas for user 53044dbca5d24a1d9a67b158cede818a and project 64941c642e224d3f88408dabb16d87c6. Resources: {'key_pairs'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 11:59:24.927617 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0a8e7a96-cc86-46aa-9282-ead273376e0c tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.322316 Apr 08 11:59:24.928372 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2054/2990] 10.222.0.46 () {60 vars in 1157 bytes} [Fri Apr 8 11:59:24 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:59:27.173390 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-056f24f1-feb5-4d3c-87ec-e0f859fbdb03 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-70803709", "imageRef": "35b8d8d2-a0e9-4c3e-8586-5e088dec27e6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bcb00e23-144e-490a-8c89-75aeca201213"}], "security_groups": [{"name": "tempest-securitygroup--1971036840"}], "key_name": "tempest-keypair-454168631", "user_data": "}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:59:27.274354 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.network.neutron [None req-056f24f1-feb5-4d3c-87ec-e0f859fbdb03 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] validate_networks() for [('bcb00e23-144e-490a-8c89-75aeca201213', None, None, None, None, None)] {{(pid=117800) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 08 11:59:27.645585 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-056f24f1-feb5-4d3c-87ec-e0f859fbdb03 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Flavor limits 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 11:59:27.646138 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-056f24f1-feb5-4d3c-87ec-e0f859fbdb03 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Image limits 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 11:59:27.646693 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-056f24f1-feb5-4d3c-87ec-e0f859fbdb03 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Flavor pref 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 11:59:27.647179 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-056f24f1-feb5-4d3c-87ec-e0f859fbdb03 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Image pref 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 11:59:27.647664 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-056f24f1-feb5-4d3c-87ec-e0f859fbdb03 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 11:59:27.657037 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-056f24f1-feb5-4d3c-87ec-e0f859fbdb03 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:27.657486 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-056f24f1-feb5-4d3c-87ec-e0f859fbdb03 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:27.658315 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-056f24f1-feb5-4d3c-87ec-e0f859fbdb03 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:27.658751 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-056f24f1-feb5-4d3c-87ec-e0f859fbdb03 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:27.675463 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-056f24f1-feb5-4d3c-87ec-e0f859fbdb03 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Getting quotas for project 64941c642e224d3f88408dabb16d87c6. Resources: {'instances', 'ram', 'cores'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 11:59:27.679364 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-056f24f1-feb5-4d3c-87ec-e0f859fbdb03 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Getting quotas for user 53044dbca5d24a1d9a67b158cede818a and project 64941c642e224d3f88408dabb16d87c6. Resources: {'instances', 'ram', 'cores'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 11:59:27.694104 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-056f24f1-feb5-4d3c-87ec-e0f859fbdb03 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Going to run 1 instances... {{(pid=117800) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 08 11:59:27.696565 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-056f24f1-feb5-4d3c-87ec-e0f859fbdb03 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d4219023-ecd9-413c-a7a1-12c02d9a08c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='35b8d8d2-a0e9-4c3e-8586-5e088dec27e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 08 11:59:27.842112 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-056f24f1-feb5-4d3c-87ec-e0f859fbdb03 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.672865 Apr 08 11:59:27.842757 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2055/2991] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Apr 8 11:59:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 08 11:59:27.852981 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-956da232-b24b-4c6a-88f3-e2c70d594ee1 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:59:27.853577 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-956da232-b24b-4c6a-88f3-e2c70d594ee1 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d4219023-ecd9-413c-a7a1-12c02d9a08c1] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:59:27.910278 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-956da232-b24b-4c6a-88f3-e2c70d594ee1 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:59:27.917421 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-956da232-b24b-4c6a-88f3-e2c70d594ee1 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1" status: 200 len: 1239 microversion: 2.1 time: 0.068744 Apr 08 11:59:27.918184 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2056/2992] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:59:27 2022] GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1 => generated 1239 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:59:28.934349 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6a7dc16c-9008-480f-9ea1-b0c941b6decf tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:59:28.935038 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6a7dc16c-9008-480f-9ea1-b0c941b6decf tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d4219023-ecd9-413c-a7a1-12c02d9a08c1] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:59:28.941505 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6a7dc16c-9008-480f-9ea1-b0c941b6decf tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:28.941988 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6a7dc16c-9008-480f-9ea1-b0c941b6decf tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:28.942765 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6a7dc16c-9008-480f-9ea1-b0c941b6decf tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:28.943208 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6a7dc16c-9008-480f-9ea1-b0c941b6decf tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:29.010921 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6a7dc16c-9008-480f-9ea1-b0c941b6decf tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:59:29.018726 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6a7dc16c-9008-480f-9ea1-b0c941b6decf tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1" status: 200 len: 1243 microversion: 2.1 time: 0.088011 Apr 08 11:59:29.019504 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2057/2993] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:59:28 2022] GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1 => generated 1243 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:59:30.036390 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-23cf1f6e-5f59-4e2b-b4e7-07ef43e4e6ff tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:59:30.037118 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-23cf1f6e-5f59-4e2b-b4e7-07ef43e4e6ff tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d4219023-ecd9-413c-a7a1-12c02d9a08c1] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:59:30.044310 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-23cf1f6e-5f59-4e2b-b4e7-07ef43e4e6ff tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:30.044864 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-23cf1f6e-5f59-4e2b-b4e7-07ef43e4e6ff tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:30.045712 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-23cf1f6e-5f59-4e2b-b4e7-07ef43e4e6ff tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:30.046259 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-23cf1f6e-5f59-4e2b-b4e7-07ef43e4e6ff tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:30.113518 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-23cf1f6e-5f59-4e2b-b4e7-07ef43e4e6ff tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:59:30.121634 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-23cf1f6e-5f59-4e2b-b4e7-07ef43e4e6ff tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1" status: 200 len: 1309 microversion: 2.1 time: 0.089029 Apr 08 11:59:30.122324 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2058/2994] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:59:30 2022] GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1 => generated 1309 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:59:31.139575 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-de0e430f-73ba-4bef-8894-e5c08ee223d6 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:59:31.140270 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-de0e430f-73ba-4bef-8894-e5c08ee223d6 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d4219023-ecd9-413c-a7a1-12c02d9a08c1] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:59:31.146768 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-de0e430f-73ba-4bef-8894-e5c08ee223d6 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:31.147214 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-de0e430f-73ba-4bef-8894-e5c08ee223d6 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:31.147988 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-de0e430f-73ba-4bef-8894-e5c08ee223d6 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:31.148424 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-de0e430f-73ba-4bef-8894-e5c08ee223d6 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:31.317238 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-de0e430f-73ba-4bef-8894-e5c08ee223d6 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:59:31.324834 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-de0e430f-73ba-4bef-8894-e5c08ee223d6 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1" status: 200 len: 1365 microversion: 2.1 time: 0.189013 Apr 08 11:59:31.325699 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2059/2995] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:59:31 2022] GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1 => generated 1365 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:59:31.497247 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-c2cd3c45-65bb-4529-9fa2-551296ff8ba7 req-92415f97-ff2a-4233-80bc-9d53ec53de9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4219023-ecd9-413c-a7a1-12c02d9a08c1", "tag": "71b99202-730e-407f-991f-6d73778819c3"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:59:31.505821 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-c2cd3c45-65bb-4529-9fa2-551296ff8ba7 req-92415f97-ff2a-4233-80bc-9d53ec53de9b service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:31.511257 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-c2cd3c45-65bb-4529-9fa2-551296ff8ba7 req-92415f97-ff2a-4233-80bc-9d53ec53de9b service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:31.520061 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-c2cd3c45-65bb-4529-9fa2-551296ff8ba7 req-92415f97-ff2a-4233-80bc-9d53ec53de9b service nova] Creating event network-changed:71b99202-730e-407f-991f-6d73778819c3 for instance d4219023-ecd9-413c-a7a1-12c02d9a08c1 on hv-cinder-83607 Apr 08 11:59:31.529147 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-c2cd3c45-65bb-4529-9fa2-551296ff8ba7 req-92415f97-ff2a-4233-80bc-9d53ec53de9b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034232 Apr 08 11:59:31.529147 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2060/2996] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:59:32.342886 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6a37b328-160e-424f-b552-74cb778271fb tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:59:32.343623 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6a37b328-160e-424f-b552-74cb778271fb tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d4219023-ecd9-413c-a7a1-12c02d9a08c1] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:59:32.350585 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6a37b328-160e-424f-b552-74cb778271fb tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:32.357236 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6a37b328-160e-424f-b552-74cb778271fb tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:32.357236 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6a37b328-160e-424f-b552-74cb778271fb tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:32.357236 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6a37b328-160e-424f-b552-74cb778271fb tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:32.487909 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-6a37b328-160e-424f-b552-74cb778271fb tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:59:32.495155 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6a37b328-160e-424f-b552-74cb778271fb tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1" status: 200 len: 1365 microversion: 2.1 time: 0.156509 Apr 08 11:59:32.495728 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2061/2997] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:59:32 2022] GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:59:33.511863 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d7f44e3d-c6cc-496b-b175-fb4d44f247c1 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:59:33.512510 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d7f44e3d-c6cc-496b-b175-fb4d44f247c1 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d4219023-ecd9-413c-a7a1-12c02d9a08c1] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:59:33.519153 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d7f44e3d-c6cc-496b-b175-fb4d44f247c1 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:33.519610 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d7f44e3d-c6cc-496b-b175-fb4d44f247c1 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:33.520381 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d7f44e3d-c6cc-496b-b175-fb4d44f247c1 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:33.520823 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d7f44e3d-c6cc-496b-b175-fb4d44f247c1 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:33.650906 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d7f44e3d-c6cc-496b-b175-fb4d44f247c1 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:59:33.658271 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d7f44e3d-c6cc-496b-b175-fb4d44f247c1 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1" status: 200 len: 1365 microversion: 2.1 time: 0.150322 Apr 08 11:59:33.658828 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2062/2998] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:59:33 2022] GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:59:34.675566 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e6f00468-29f3-412a-a756-1d4de0d70228 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:59:34.676265 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e6f00468-29f3-412a-a756-1d4de0d70228 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d4219023-ecd9-413c-a7a1-12c02d9a08c1] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:59:34.683091 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e6f00468-29f3-412a-a756-1d4de0d70228 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:34.683545 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e6f00468-29f3-412a-a756-1d4de0d70228 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:34.684321 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e6f00468-29f3-412a-a756-1d4de0d70228 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:34.684765 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e6f00468-29f3-412a-a756-1d4de0d70228 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:34.819700 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e6f00468-29f3-412a-a756-1d4de0d70228 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:59:34.827828 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e6f00468-29f3-412a-a756-1d4de0d70228 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1" status: 200 len: 1365 microversion: 2.1 time: 0.156108 Apr 08 11:59:34.828408 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2063/2999] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:59:34 2022] GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 11:59:35.844563 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1c67b3ab-f665-4c4f-8bcf-61a4f5066faa tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:59:35.845246 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1c67b3ab-f665-4c4f-8bcf-61a4f5066faa tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d4219023-ecd9-413c-a7a1-12c02d9a08c1] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:59:35.851979 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1c67b3ab-f665-4c4f-8bcf-61a4f5066faa tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:35.852435 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1c67b3ab-f665-4c4f-8bcf-61a4f5066faa tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:35.853213 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1c67b3ab-f665-4c4f-8bcf-61a4f5066faa tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:35.853651 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1c67b3ab-f665-4c4f-8bcf-61a4f5066faa tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:35.984816 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1c67b3ab-f665-4c4f-8bcf-61a4f5066faa tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:59:35.992622 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1c67b3ab-f665-4c4f-8bcf-61a4f5066faa tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1" status: 200 len: 1365 microversion: 2.1 time: 0.151440 Apr 08 11:59:35.993185 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2064/3000] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:59:35 2022] GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:59:37.009154 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7cb9a089-fe73-4e97-9639-8b671cb9dbe9 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:59:37.009918 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7cb9a089-fe73-4e97-9639-8b671cb9dbe9 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d4219023-ecd9-413c-a7a1-12c02d9a08c1] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:59:37.016486 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7cb9a089-fe73-4e97-9639-8b671cb9dbe9 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:37.016938 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7cb9a089-fe73-4e97-9639-8b671cb9dbe9 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:37.017726 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7cb9a089-fe73-4e97-9639-8b671cb9dbe9 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:37.018454 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7cb9a089-fe73-4e97-9639-8b671cb9dbe9 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:37.155917 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7cb9a089-fe73-4e97-9639-8b671cb9dbe9 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:59:37.163437 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7cb9a089-fe73-4e97-9639-8b671cb9dbe9 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1" status: 200 len: 1365 microversion: 2.1 time: 0.158715 Apr 08 11:59:37.164740 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2065/3001] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:59:37 2022] GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:59:38.180810 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-889e23d9-9cbb-46a2-b034-5a3a16f4e3cc tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:59:38.181503 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-889e23d9-9cbb-46a2-b034-5a3a16f4e3cc tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d4219023-ecd9-413c-a7a1-12c02d9a08c1] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:59:38.187766 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-889e23d9-9cbb-46a2-b034-5a3a16f4e3cc tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:38.188214 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-889e23d9-9cbb-46a2-b034-5a3a16f4e3cc tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:38.188982 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-889e23d9-9cbb-46a2-b034-5a3a16f4e3cc tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:38.189415 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-889e23d9-9cbb-46a2-b034-5a3a16f4e3cc tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:38.326277 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-889e23d9-9cbb-46a2-b034-5a3a16f4e3cc tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:59:38.333490 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-889e23d9-9cbb-46a2-b034-5a3a16f4e3cc tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1" status: 200 len: 1365 microversion: 2.1 time: 0.157124 Apr 08 11:59:38.334084 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2066/3002] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:59:38 2022] GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:59:39.131190 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-70313091-55ec-4d51-83eb-204e83cae3d0 req-53da8bf5-6ddb-43d6-91df-56475b9fdff5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4219023-ecd9-413c-a7a1-12c02d9a08c1", "name": "network-vif-plugged", "status": "completed", "tag": "71b99202-730e-407f-991f-6d73778819c3"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:59:39.139440 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-70313091-55ec-4d51-83eb-204e83cae3d0 req-53da8bf5-6ddb-43d6-91df-56475b9fdff5 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:39.139890 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-70313091-55ec-4d51-83eb-204e83cae3d0 req-53da8bf5-6ddb-43d6-91df-56475b9fdff5 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:39.151589 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-70313091-55ec-4d51-83eb-204e83cae3d0 req-53da8bf5-6ddb-43d6-91df-56475b9fdff5 service nova] Creating event network-vif-plugged:71b99202-730e-407f-991f-6d73778819c3 for instance d4219023-ecd9-413c-a7a1-12c02d9a08c1 on hv-cinder-83607 Apr 08 11:59:39.156732 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-70313091-55ec-4d51-83eb-204e83cae3d0 req-53da8bf5-6ddb-43d6-91df-56475b9fdff5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029261 Apr 08 11:59:39.157314 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2067/3003] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:59:39.351646 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4c4e6893-0334-4a2c-9e61-1fc85ebaa020 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:59:39.353004 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4c4e6893-0334-4a2c-9e61-1fc85ebaa020 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d4219023-ecd9-413c-a7a1-12c02d9a08c1] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:59:39.359521 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4c4e6893-0334-4a2c-9e61-1fc85ebaa020 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:39.359976 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4c4e6893-0334-4a2c-9e61-1fc85ebaa020 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:39.360750 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4c4e6893-0334-4a2c-9e61-1fc85ebaa020 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:39.361196 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4c4e6893-0334-4a2c-9e61-1fc85ebaa020 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:39.497235 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4c4e6893-0334-4a2c-9e61-1fc85ebaa020 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:59:39.504672 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4c4e6893-0334-4a2c-9e61-1fc85ebaa020 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1" status: 200 len: 1365 microversion: 2.1 time: 0.157598 Apr 08 11:59:39.505258 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2068/3004] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:59:39 2022] GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:59:40.522240 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-18a4273f-7aec-472d-a06a-313abea11f6e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:59:40.522968 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-18a4273f-7aec-472d-a06a-313abea11f6e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d4219023-ecd9-413c-a7a1-12c02d9a08c1] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:59:40.529680 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-18a4273f-7aec-472d-a06a-313abea11f6e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:40.530169 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-18a4273f-7aec-472d-a06a-313abea11f6e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:40.530975 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-18a4273f-7aec-472d-a06a-313abea11f6e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:40.531412 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-18a4273f-7aec-472d-a06a-313abea11f6e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:40.665146 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-18a4273f-7aec-472d-a06a-313abea11f6e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:59:40.674402 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-18a4273f-7aec-472d-a06a-313abea11f6e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1" status: 200 len: 1365 microversion: 2.1 time: 0.154854 Apr 08 11:59:40.674402 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2069/3005] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:59:40 2022] GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:59:41.690982 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ecd02a23-491f-4dc9-8230-5969f39c12a8 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:59:41.691693 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ecd02a23-491f-4dc9-8230-5969f39c12a8 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d4219023-ecd9-413c-a7a1-12c02d9a08c1] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:59:41.698524 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ecd02a23-491f-4dc9-8230-5969f39c12a8 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:41.699079 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ecd02a23-491f-4dc9-8230-5969f39c12a8 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:41.699777 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ecd02a23-491f-4dc9-8230-5969f39c12a8 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:41.700218 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ecd02a23-491f-4dc9-8230-5969f39c12a8 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:41.841217 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ecd02a23-491f-4dc9-8230-5969f39c12a8 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:59:41.848920 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ecd02a23-491f-4dc9-8230-5969f39c12a8 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1" status: 200 len: 1554 microversion: 2.1 time: 0.161891 Apr 08 11:59:41.849514 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2070/3006] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:59:41 2022] GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:59:41.867948 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-163c3264-887a-45b5-84fa-e1334c9bcb60 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:59:41.868473 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-163c3264-887a-45b5-84fa-e1334c9bcb60 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d4219023-ecd9-413c-a7a1-12c02d9a08c1] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:59:41.874443 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-163c3264-887a-45b5-84fa-e1334c9bcb60 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:41.874901 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-163c3264-887a-45b5-84fa-e1334c9bcb60 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:41.875678 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-163c3264-887a-45b5-84fa-e1334c9bcb60 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:41.876121 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-163c3264-887a-45b5-84fa-e1334c9bcb60 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:41.959819 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-163c3264-887a-45b5-84fa-e1334c9bcb60 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096001 Apr 08 11:59:41.960429 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2071/3007] 10.222.0.46 () {58 vars in 1274 bytes} [Fri Apr 8 11:59:41 2022] GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:59:43.376161 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-3f026880-edd1-485c-a0be-5b6ba77ded8b req-9c06e9d8-fbb6-4ae0-8e56-cb5e8d003adc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4219023-ecd9-413c-a7a1-12c02d9a08c1", "tag": "71b99202-730e-407f-991f-6d73778819c3"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:59:43.381898 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-3f026880-edd1-485c-a0be-5b6ba77ded8b req-9c06e9d8-fbb6-4ae0-8e56-cb5e8d003adc service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:43.382778 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-3f026880-edd1-485c-a0be-5b6ba77ded8b req-9c06e9d8-fbb6-4ae0-8e56-cb5e8d003adc service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:43.394230 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-3f026880-edd1-485c-a0be-5b6ba77ded8b req-9c06e9d8-fbb6-4ae0-8e56-cb5e8d003adc service nova] Creating event network-changed:71b99202-730e-407f-991f-6d73778819c3 for instance d4219023-ecd9-413c-a7a1-12c02d9a08c1 on hv-cinder-83607 Apr 08 11:59:43.399237 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-3f026880-edd1-485c-a0be-5b6ba77ded8b req-9c06e9d8-fbb6-4ae0-8e56-cb5e8d003adc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115639 Apr 08 11:59:43.399924 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2072/3008] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:59:51.103429 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-da2f3493-84d4-450f-92b4-291a1f459541 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1060505730"}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:59:51.104153 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-da2f3493-84d4-450f-92b4-291a1f459541 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:59:51.110247 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-da2f3493-84d4-450f-92b4-291a1f459541 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:51.110692 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-da2f3493-84d4-450f-92b4-291a1f459541 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:51.111460 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-da2f3493-84d4-450f-92b4-291a1f459541 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:51.111896 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-da2f3493-84d4-450f-92b4-291a1f459541 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:51.240648 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.network.security_group_api [None req-da2f3493-84d4-450f-92b4-291a1f459541 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Removing security group 0b646ee5-aab7-4c08-b120-04d382b64f60 from port 0d0bf587-5284-4d8f-acb8-dac2d5db2401 Apr 08 11:59:51.619926 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-da2f3493-84d4-450f-92b4-291a1f459541 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "POST /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe/action" status: 202 len: 0 microversion: 2.1 time: 0.521111 Apr 08 11:59:51.624514 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2073/3009] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Apr 8 11:59:51 2022] POST /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe/action => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 08 11:59:51.628985 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-66f038ba-7b97-4c25-9783-2703f067b78b req-1de7628b-ce87-4ed8-92b4-3524e982dd87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ecf987c-6d9b-471f-ad88-64ec198a5cbe", "tag": "0d0bf587-5284-4d8f-acb8-dac2d5db2401"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:59:51.637401 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-66f038ba-7b97-4c25-9783-2703f067b78b req-1de7628b-ce87-4ed8-92b4-3524e982dd87 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:51.643194 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-66f038ba-7b97-4c25-9783-2703f067b78b req-1de7628b-ce87-4ed8-92b4-3524e982dd87 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:51.659188 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-66f038ba-7b97-4c25-9783-2703f067b78b req-1de7628b-ce87-4ed8-92b4-3524e982dd87 service nova] Creating event network-changed:0d0bf587-5284-4d8f-acb8-dac2d5db2401 for instance 9ecf987c-6d9b-471f-ad88-64ec198a5cbe on hv-cinder-83607 Apr 08 11:59:51.665393 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-66f038ba-7b97-4c25-9783-2703f067b78b req-1de7628b-ce87-4ed8-92b4-3524e982dd87 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039954 Apr 08 11:59:51.666106 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2074/3010] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:59:53.058203 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1724e223-e750-40c0-abb4-d2534b26d07c tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:59:53.058860 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1724e223-e750-40c0-abb4-d2534b26d07c tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:59:53.065287 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1724e223-e750-40c0-abb4-d2534b26d07c tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:53.065836 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1724e223-e750-40c0-abb4-d2534b26d07c tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:53.066678 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1724e223-e750-40c0-abb4-d2534b26d07c tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:53.067186 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1724e223-e750-40c0-abb4-d2534b26d07c tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:53.147893 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-1724e223-e750-40c0-abb4-d2534b26d07c tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lazy-loading 'services' on Instance uuid 9ecf987c-6d9b-471f-ad88-64ec198a5cbe {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 11:59:53.408555 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1724e223-e750-40c0-abb4-d2534b26d07c tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe/os-volume_attachments/8426740d-0c7a-4e22-9d28-1ea616b12937" status: 202 len: 0 microversion: 2.1 time: 0.355717 Apr 08 11:59:53.412612 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2075/3011] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Apr 8 11:59:53 2022] DELETE /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe/os-volume_attachments/8426740d-0c7a-4e22-9d28-1ea616b12937 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 08 11:59:53.419891 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2975d280-76e0-4a6f-8e34-1a830eebc4d3 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:59:53.421238 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2975d280-76e0-4a6f-8e34-1a830eebc4d3 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:59:53.427511 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2975d280-76e0-4a6f-8e34-1a830eebc4d3 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:53.432022 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2975d280-76e0-4a6f-8e34-1a830eebc4d3 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:53.432022 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2975d280-76e0-4a6f-8e34-1a830eebc4d3 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:53.432022 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2975d280-76e0-4a6f-8e34-1a830eebc4d3 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:53.458130 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2975d280-76e0-4a6f-8e34-1a830eebc4d3 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043447 Apr 08 11:59:53.458696 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2076/3012] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:59:53 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 11:59:53.681999 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-a8ee3250-f48a-485e-9b7b-b63441e5b276 req-39ef852c-b7fc-4f6b-8b86-43093757b0dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ecf987c-6d9b-471f-ad88-64ec198a5cbe", "tag": "0d0bf587-5284-4d8f-acb8-dac2d5db2401"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 11:59:53.690500 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-a8ee3250-f48a-485e-9b7b-b63441e5b276 req-39ef852c-b7fc-4f6b-8b86-43093757b0dd service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:53.690887 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-a8ee3250-f48a-485e-9b7b-b63441e5b276 req-39ef852c-b7fc-4f6b-8b86-43093757b0dd service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:53.702913 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-a8ee3250-f48a-485e-9b7b-b63441e5b276 req-39ef852c-b7fc-4f6b-8b86-43093757b0dd service nova] Creating event network-changed:0d0bf587-5284-4d8f-acb8-dac2d5db2401 for instance 9ecf987c-6d9b-471f-ad88-64ec198a5cbe on hv-cinder-83607 Apr 08 11:59:53.707919 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-a8ee3250-f48a-485e-9b7b-b63441e5b276 req-39ef852c-b7fc-4f6b-8b86-43093757b0dd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029804 Apr 08 11:59:53.708532 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2077/3013] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 11:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:59:54.470860 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ad6e383e-946a-4ef6-83c8-6fc5983faa6b tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:59:54.471783 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ad6e383e-946a-4ef6-83c8-6fc5983faa6b tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:59:54.478833 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ad6e383e-946a-4ef6-83c8-6fc5983faa6b tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:54.479278 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ad6e383e-946a-4ef6-83c8-6fc5983faa6b tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:54.480047 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ad6e383e-946a-4ef6-83c8-6fc5983faa6b tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:54.480482 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ad6e383e-946a-4ef6-83c8-6fc5983faa6b tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:54.509707 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ad6e383e-946a-4ef6-83c8-6fc5983faa6b tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043269 Apr 08 11:59:54.510320 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2078/3014] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:59:54 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 11:59:55.521585 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4b6e5fab-3f23-45a4-94ed-4e6e0e3ddaa6 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:59:55.522574 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4b6e5fab-3f23-45a4-94ed-4e6e0e3ddaa6 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:59:55.528828 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4b6e5fab-3f23-45a4-94ed-4e6e0e3ddaa6 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:55.529287 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4b6e5fab-3f23-45a4-94ed-4e6e0e3ddaa6 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:55.530092 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4b6e5fab-3f23-45a4-94ed-4e6e0e3ddaa6 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:55.530535 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4b6e5fab-3f23-45a4-94ed-4e6e0e3ddaa6 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:55.558806 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4b6e5fab-3f23-45a4-94ed-4e6e0e3ddaa6 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041084 Apr 08 11:59:55.559373 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2079/3015] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 11:59:55 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 08 11:59:55.576498 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d0c8b263-63fe-4631-9e17-7a2d76aa8d01 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:59:55.576994 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d0c8b263-63fe-4631-9e17-7a2d76aa8d01 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:59:55.582923 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d0c8b263-63fe-4631-9e17-7a2d76aa8d01 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:55.583381 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d0c8b263-63fe-4631-9e17-7a2d76aa8d01 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:55.584155 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d0c8b263-63fe-4631-9e17-7a2d76aa8d01 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:55.584599 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d0c8b263-63fe-4631-9e17-7a2d76aa8d01 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:55.659959 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-d0c8b263-63fe-4631-9e17-7a2d76aa8d01 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] HTTP exception thrown: Instance 9ecf987c-6d9b-471f-ad88-64ec198a5cbe is not attached to volume 8426740d-0c7a-4e22-9d28-1ea616b12937 Apr 08 11:59:55.660596 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d0c8b263-63fe-4631-9e17-7a2d76aa8d01 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Returning 404 to user: Instance 9ecf987c-6d9b-471f-ad88-64ec198a5cbe is not attached to volume 8426740d-0c7a-4e22-9d28-1ea616b12937 {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 11:59:55.661445 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d0c8b263-63fe-4631-9e17-7a2d76aa8d01 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe/os-volume_attachments/8426740d-0c7a-4e22-9d28-1ea616b12937" status: 404 len: 154 microversion: 2.1 time: 0.088824 Apr 08 11:59:55.662039 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2080/3016] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Apr 8 11:59:55 2022] DELETE /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe/os-volume_attachments/8426740d-0c7a-4e22-9d28-1ea616b12937 => generated 154 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 11:59:56.962614 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c439008e-1457-48b0-bf1f-829266ce278f tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:59:56.963298 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c439008e-1457-48b0-bf1f-829266ce278f tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:59:56.969253 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c439008e-1457-48b0-bf1f-829266ce278f tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:56.969706 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c439008e-1457-48b0-bf1f-829266ce278f tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:56.970502 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c439008e-1457-48b0-bf1f-829266ce278f tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:56.970941 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c439008e-1457-48b0-bf1f-829266ce278f tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:56.995689 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c439008e-1457-48b0-bf1f-829266ce278f tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Going to try to terminate instance {{(pid=117800) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 08 11:59:57.254772 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c439008e-1457-48b0-bf1f-829266ce278f tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 204 len: 0 microversion: 2.1 time: 0.295614 Apr 08 11:59:57.255290 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2081/3017] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 8 11:59:56 2022] DELETE /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 08 11:59:57.264015 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-69f9d22c-7850-4c56-8ae8-d048888a0a65 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:59:57.264753 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-69f9d22c-7850-4c56-8ae8-d048888a0a65 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:59:57.271267 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-69f9d22c-7850-4c56-8ae8-d048888a0a65 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:57.273045 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-69f9d22c-7850-4c56-8ae8-d048888a0a65 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:57.273045 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-69f9d22c-7850-4c56-8ae8-d048888a0a65 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:57.273540 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-69f9d22c-7850-4c56-8ae8-d048888a0a65 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:57.426032 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-69f9d22c-7850-4c56-8ae8-d048888a0a65 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:59:57.433497 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-69f9d22c-7850-4c56-8ae8-d048888a0a65 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1551 microversion: 2.1 time: 0.173641 Apr 08 11:59:57.434101 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2082/3018] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:59:57 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1551 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:59:58.450711 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-74b22fa5-e51c-4d1e-97be-511e7c0bf352 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:59:58.451458 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-74b22fa5-e51c-4d1e-97be-511e7c0bf352 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:59:58.457757 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-74b22fa5-e51c-4d1e-97be-511e7c0bf352 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:58.458265 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-74b22fa5-e51c-4d1e-97be-511e7c0bf352 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:58.459020 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-74b22fa5-e51c-4d1e-97be-511e7c0bf352 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:58.459483 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-74b22fa5-e51c-4d1e-97be-511e7c0bf352 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:58.590751 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-74b22fa5-e51c-4d1e-97be-511e7c0bf352 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:59:58.598286 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-74b22fa5-e51c-4d1e-97be-511e7c0bf352 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1551 microversion: 2.1 time: 0.151403 Apr 08 11:59:58.599051 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2083/3019] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:59:58 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1551 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 11:59:59.615217 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8d30b1e7-015a-4b09-84d3-2309866c1a72 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 11:59:59.616420 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8d30b1e7-015a-4b09-84d3-2309866c1a72 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 11:59:59.622896 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8d30b1e7-015a-4b09-84d3-2309866c1a72 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:59.623436 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8d30b1e7-015a-4b09-84d3-2309866c1a72 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:59.624229 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8d30b1e7-015a-4b09-84d3-2309866c1a72 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 11:59:59.624676 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8d30b1e7-015a-4b09-84d3-2309866c1a72 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 11:59:59.788001 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-8d30b1e7-015a-4b09-84d3-2309866c1a72 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 11:59:59.798554 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8d30b1e7-015a-4b09-84d3-2309866c1a72 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1551 microversion: 2.1 time: 0.187173 Apr 08 11:59:59.799436 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2084/3020] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 11:59:59 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1551 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:00:00.294264 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-83a0092d-4769-465f-84bf-8395fd7b1de8 req-02d5a2c5-98e5-4028-8a79-30ac06f80309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ecf987c-6d9b-471f-ad88-64ec198a5cbe", "name": "network-vif-deleted", "tag": "0d0bf587-5284-4d8f-acb8-dac2d5db2401"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:00:00.303864 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-83a0092d-4769-465f-84bf-8395fd7b1de8 req-02d5a2c5-98e5-4028-8a79-30ac06f80309 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:00:00.304310 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-83a0092d-4769-465f-84bf-8395fd7b1de8 req-02d5a2c5-98e5-4028-8a79-30ac06f80309 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:00:00.315530 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-83a0092d-4769-465f-84bf-8395fd7b1de8 req-02d5a2c5-98e5-4028-8a79-30ac06f80309 service nova] Creating event network-vif-deleted:0d0bf587-5284-4d8f-acb8-dac2d5db2401 for instance 9ecf987c-6d9b-471f-ad88-64ec198a5cbe on hv-cinder-83607 Apr 08 12:00:00.320719 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-83a0092d-4769-465f-84bf-8395fd7b1de8 req-02d5a2c5-98e5-4028-8a79-30ac06f80309 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030043 Apr 08 12:00:00.321681 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2085/3021] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 12:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 12:00:00.824098 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-82179873-47d9-4db8-b125-21c2b4b2a123 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:00:00.824796 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-82179873-47d9-4db8-b125-21c2b4b2a123 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:00:00.830884 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-82179873-47d9-4db8-b125-21c2b4b2a123 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:00:00.831332 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-82179873-47d9-4db8-b125-21c2b4b2a123 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:00:00.832094 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-82179873-47d9-4db8-b125-21c2b4b2a123 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:00:00.832527 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-82179873-47d9-4db8-b125-21c2b4b2a123 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:00:00.862182 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-82179873-47d9-4db8-b125-21c2b4b2a123 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:00:00.862630 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-82179873-47d9-4db8-b125-21c2b4b2a123 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:00:00.863076 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-82179873-47d9-4db8-b125-21c2b4b2a123 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lazy-loading 'fault' on Instance uuid 9ecf987c-6d9b-471f-ad88-64ec198a5cbe {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 12:00:00.907885 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-82179873-47d9-4db8-b125-21c2b4b2a123 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab051cc533642658f47c156e33575a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982950d21c8948d2af801885353a239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:00:00.915349 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-82179873-47d9-4db8-b125-21c2b4b2a123 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 200 len: 1347 microversion: 2.1 time: 0.096611 Apr 08 12:00:00.915921 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2086/3022] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:00:00 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 1347 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:00:01.932455 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d5f6b9c3-e34f-4a08-beca-610598c632fe tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:00:01.933123 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d5f6b9c3-e34f-4a08-beca-610598c632fe tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] [instance: 9ecf987c-6d9b-471f-ad88-64ec198a5cbe] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:00:01.939435 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d5f6b9c3-e34f-4a08-beca-610598c632fe tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:00:01.939892 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d5f6b9c3-e34f-4a08-beca-610598c632fe tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:00:01.940668 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d5f6b9c3-e34f-4a08-beca-610598c632fe tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:00:01.941112 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d5f6b9c3-e34f-4a08-beca-610598c632fe tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:00:01.954919 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-d5f6b9c3-e34f-4a08-beca-610598c632fe tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] HTTP exception thrown: Instance 9ecf987c-6d9b-471f-ad88-64ec198a5cbe could not be found. Apr 08 12:00:01.955542 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d5f6b9c3-e34f-4a08-beca-610598c632fe tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Returning 404 to user: Instance 9ecf987c-6d9b-471f-ad88-64ec198a5cbe could not be found. {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 12:00:01.956421 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d5f6b9c3-e34f-4a08-beca-610598c632fe tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe" status: 404 len: 111 microversion: 2.1 time: 0.027934 Apr 08 12:00:01.956966 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2087/3023] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:00:01 2022] GET /compute/v2.1/servers/9ecf987c-6d9b-471f-ad88-64ec198a5cbe => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 12:00:01.965402 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1f7a794e-b9f9-4f3e-96cf-d31ccb5c6a95 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] Calling method '.version_select at 0x7f04287260d0>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:00:02.086911 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1f7a794e-b9f9-4f3e-96cf-d31ccb5c6a95 tempest-TestMinimumBasicScenario-1518723417 tempest-TestMinimumBasicScenario-1518723417-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-368253529" status: 202 len: 0 microversion: 2.1 time: 0.124972 Apr 08 12:00:02.087501 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2088/3024] 10.222.0.46 () {58 vars in 1268 bytes} [Fri Apr 8 12:00:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-368253529 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 08 12:00:58.176435 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5969e0f5-3f3b-400e-b4f4-ceb98394f0b3 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:00:58.177171 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5969e0f5-3f3b-400e-b4f4-ceb98394f0b3 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d4219023-ecd9-413c-a7a1-12c02d9a08c1] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:00:58.182908 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5969e0f5-3f3b-400e-b4f4-ceb98394f0b3 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:00:58.183359 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5969e0f5-3f3b-400e-b4f4-ceb98394f0b3 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:00:58.184127 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5969e0f5-3f3b-400e-b4f4-ceb98394f0b3 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:00:58.184568 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5969e0f5-3f3b-400e-b4f4-ceb98394f0b3 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:00:58.208314 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5969e0f5-3f3b-400e-b4f4-ceb98394f0b3 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1/ips" status: 200 len: 148 microversion: 2.1 time: 0.036596 Apr 08 12:00:58.208887 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2089/3025] 10.222.0.46 () {58 vars in 1247 bytes} [Fri Apr 8 12:00:58 2022] GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1/ips => generated 148 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:00:58.218962 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2a05b4a3-23e7-4721-99a9-2c578ff3378d tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60702440-2066-41d6-a289-688a925e3c5c"}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:00:58.220020 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2a05b4a3-23e7-4721-99a9-2c578ff3378d tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d4219023-ecd9-413c-a7a1-12c02d9a08c1] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:00:58.226011 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2a05b4a3-23e7-4721-99a9-2c578ff3378d tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:00:58.226470 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2a05b4a3-23e7-4721-99a9-2c578ff3378d tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:00:58.227251 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2a05b4a3-23e7-4721-99a9-2c578ff3378d tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:00:58.227680 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2a05b4a3-23e7-4721-99a9-2c578ff3378d tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:00:58.303721 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-2a05b4a3-23e7-4721-99a9-2c578ff3378d tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] HTTP exception thrown: Invalid volume: volume 60702440-2066-41d6-a289-688a925e3c5c is already attached to instances: b18587f1-b868-4631-9e70-86c38739a780 Apr 08 12:00:58.304333 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2a05b4a3-23e7-4721-99a9-2c578ff3378d tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Returning 400 to user: Invalid volume: volume 60702440-2066-41d6-a289-688a925e3c5c is already attached to instances: b18587f1-b868-4631-9e70-86c38739a780 {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 12:00:58.305211 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2a05b4a3-23e7-4721-99a9-2c578ff3378d tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "POST /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.090002 Apr 08 12:00:58.305789 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2090/3026] 10.222.0.46 () {60 vars in 1322 bytes} [Fri Apr 8 12:00:58 2022] POST /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1/os-volume_attachments => generated 174 bytes in 91 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 08 12:00:58.313663 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-daf4d29b-38d8-4d8a-8450-68ea59bfeb5b tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:00:58.314192 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-daf4d29b-38d8-4d8a-8450-68ea59bfeb5b tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d4219023-ecd9-413c-a7a1-12c02d9a08c1] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:00:58.320331 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-daf4d29b-38d8-4d8a-8450-68ea59bfeb5b tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:00:58.320786 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-daf4d29b-38d8-4d8a-8450-68ea59bfeb5b tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:00:58.321561 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-daf4d29b-38d8-4d8a-8450-68ea59bfeb5b tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:00:58.322055 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-daf4d29b-38d8-4d8a-8450-68ea59bfeb5b tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:00:58.346461 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-daf4d29b-38d8-4d8a-8450-68ea59bfeb5b tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d4219023-ecd9-413c-a7a1-12c02d9a08c1] Going to try to terminate instance {{(pid=117800) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 08 12:00:58.678962 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-daf4d29b-38d8-4d8a-8450-68ea59bfeb5b tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1" status: 204 len: 0 microversion: 2.1 time: 0.368574 Apr 08 12:00:58.679553 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2091/3027] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 8 12:00:58 2022] DELETE /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 08 12:00:58.688036 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-b9d6d532-7fb8-4778-ae80-ed515a68deff tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:00:58.688726 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-b9d6d532-7fb8-4778-ae80-ed515a68deff tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d4219023-ecd9-413c-a7a1-12c02d9a08c1] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:00:58.695758 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b9d6d532-7fb8-4778-ae80-ed515a68deff tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:00:58.697240 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b9d6d532-7fb8-4778-ae80-ed515a68deff tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:00:58.698245 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b9d6d532-7fb8-4778-ae80-ed515a68deff tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:00:58.698908 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-b9d6d532-7fb8-4778-ae80-ed515a68deff tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:00:58.846927 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-b9d6d532-7fb8-4778-ae80-ed515a68deff tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:00:58.854896 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-b9d6d532-7fb8-4778-ae80-ed515a68deff tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1" status: 200 len: 1678 microversion: 2.1 time: 0.170814 Apr 08 12:00:58.855468 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2092/3028] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:00:58 2022] GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:00:59.873169 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-128cab0c-3ae4-49bc-b0f2-57e115c7d727 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:00:59.873903 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-128cab0c-3ae4-49bc-b0f2-57e115c7d727 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d4219023-ecd9-413c-a7a1-12c02d9a08c1] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:00:59.880647 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-128cab0c-3ae4-49bc-b0f2-57e115c7d727 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:00:59.881098 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-128cab0c-3ae4-49bc-b0f2-57e115c7d727 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:00:59.881887 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-128cab0c-3ae4-49bc-b0f2-57e115c7d727 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:00:59.882330 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-128cab0c-3ae4-49bc-b0f2-57e115c7d727 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:00.017904 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-128cab0c-3ae4-49bc-b0f2-57e115c7d727 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:01:00.025121 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-128cab0c-3ae4-49bc-b0f2-57e115c7d727 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1" status: 200 len: 1678 microversion: 2.1 time: 0.155838 Apr 08 12:01:00.025688 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2093/3029] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:00:59 2022] GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:01:01.042507 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e9dc4aad-e55b-4232-af0d-6d8f56e56569 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:01:01.043399 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e9dc4aad-e55b-4232-af0d-6d8f56e56569 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d4219023-ecd9-413c-a7a1-12c02d9a08c1] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:01:01.077331 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e9dc4aad-e55b-4232-af0d-6d8f56e56569 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:01.077331 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e9dc4aad-e55b-4232-af0d-6d8f56e56569 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:01.077331 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e9dc4aad-e55b-4232-af0d-6d8f56e56569 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:01.077331 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e9dc4aad-e55b-4232-af0d-6d8f56e56569 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:01.115286 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e9dc4aad-e55b-4232-af0d-6d8f56e56569 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:01:01.125830 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e9dc4aad-e55b-4232-af0d-6d8f56e56569 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1" status: 200 len: 1610 microversion: 2.1 time: 0.087072 Apr 08 12:01:01.126665 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2094/3030] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:01:01 2022] GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1 => generated 1610 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:01:01.771839 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-9afe231d-b17b-418c-b988-21d619655517 req-bff49413-239f-4a0a-9841-41f15cfebfb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4219023-ecd9-413c-a7a1-12c02d9a08c1", "name": "network-vif-deleted", "tag": "71b99202-730e-407f-991f-6d73778819c3"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:01:01.781096 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-9afe231d-b17b-418c-b988-21d619655517 req-bff49413-239f-4a0a-9841-41f15cfebfb2 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:01.782130 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-9afe231d-b17b-418c-b988-21d619655517 req-bff49413-239f-4a0a-9841-41f15cfebfb2 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:01.794118 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-9afe231d-b17b-418c-b988-21d619655517 req-bff49413-239f-4a0a-9841-41f15cfebfb2 service nova] Creating event network-vif-deleted:71b99202-730e-407f-991f-6d73778819c3 for instance d4219023-ecd9-413c-a7a1-12c02d9a08c1 on hv-cinder-83607 Apr 08 12:01:01.799026 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-9afe231d-b17b-418c-b988-21d619655517 req-bff49413-239f-4a0a-9841-41f15cfebfb2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.222192 Apr 08 12:01:01.799913 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2095/3031] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 12:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 12:01:02.149900 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d83f7cfe-4d4e-41f0-ac6a-4475b968f62a tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:01:02.150629 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d83f7cfe-4d4e-41f0-ac6a-4475b968f62a tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d4219023-ecd9-413c-a7a1-12c02d9a08c1] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:01:02.156595 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d83f7cfe-4d4e-41f0-ac6a-4475b968f62a tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:02.157050 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d83f7cfe-4d4e-41f0-ac6a-4475b968f62a tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:02.157835 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d83f7cfe-4d4e-41f0-ac6a-4475b968f62a tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:02.158276 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d83f7cfe-4d4e-41f0-ac6a-4475b968f62a tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:02.195242 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d83f7cfe-4d4e-41f0-ac6a-4475b968f62a tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:02.195597 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d83f7cfe-4d4e-41f0-ac6a-4475b968f62a tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:02.196054 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-d83f7cfe-4d4e-41f0-ac6a-4475b968f62a tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lazy-loading 'fault' on Instance uuid d4219023-ecd9-413c-a7a1-12c02d9a08c1 {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 12:01:02.239116 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d83f7cfe-4d4e-41f0-ac6a-4475b968f62a tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:01:02.246812 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d83f7cfe-4d4e-41f0-ac6a-4475b968f62a tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1" status: 200 len: 1329 microversion: 2.1 time: 0.102094 Apr 08 12:01:02.248171 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2096/3032] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:01:02 2022] GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1 => generated 1329 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:01:03.265639 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a4cc50e9-8f2e-4d61-8b79-57d02997b39e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:01:03.266387 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a4cc50e9-8f2e-4d61-8b79-57d02997b39e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d4219023-ecd9-413c-a7a1-12c02d9a08c1] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:01:03.273201 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a4cc50e9-8f2e-4d61-8b79-57d02997b39e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:03.273651 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a4cc50e9-8f2e-4d61-8b79-57d02997b39e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:03.274445 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a4cc50e9-8f2e-4d61-8b79-57d02997b39e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:03.274879 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a4cc50e9-8f2e-4d61-8b79-57d02997b39e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:03.288416 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-a4cc50e9-8f2e-4d61-8b79-57d02997b39e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] HTTP exception thrown: Instance d4219023-ecd9-413c-a7a1-12c02d9a08c1 could not be found. Apr 08 12:01:03.289002 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a4cc50e9-8f2e-4d61-8b79-57d02997b39e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Returning 404 to user: Instance d4219023-ecd9-413c-a7a1-12c02d9a08c1 could not be found. {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 12:01:03.289845 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a4cc50e9-8f2e-4d61-8b79-57d02997b39e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1" status: 404 len: 111 microversion: 2.1 time: 0.028350 Apr 08 12:01:03.290418 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2097/3033] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:01:03 2022] GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 12:01:03.298326 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d9bce281-5ab9-469d-8f7c-13f84bdb14a7 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '.version_select at 0x7f04252e0b80>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:01:03.378984 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d9bce281-5ab9-469d-8f7c-13f84bdb14a7 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-454168631" status: 202 len: 0 microversion: 2.1 time: 0.084205 Apr 08 12:01:03.379564 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2098/3034] 10.222.0.46 () {58 vars in 1217 bytes} [Fri Apr 8 12:01:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-454168631 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 08 12:01:04.193513 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8f44a57e-198d-4960-a5cf-ab1dac5a99a8 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:01:04.194053 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8f44a57e-198d-4960-a5cf-ab1dac5a99a8 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: b18587f1-b868-4631-9e70-86c38739a780] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:01:04.199957 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8f44a57e-198d-4960-a5cf-ab1dac5a99a8 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:04.200405 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8f44a57e-198d-4960-a5cf-ab1dac5a99a8 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:04.201172 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8f44a57e-198d-4960-a5cf-ab1dac5a99a8 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:04.201614 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8f44a57e-198d-4960-a5cf-ab1dac5a99a8 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:04.279836 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-8f44a57e-198d-4960-a5cf-ab1dac5a99a8 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lazy-loading 'services' on Instance uuid b18587f1-b868-4631-9e70-86c38739a780 {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 12:01:04.481086 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8f44a57e-198d-4960-a5cf-ab1dac5a99a8 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780/os-volume_attachments/60702440-2066-41d6-a289-688a925e3c5c" status: 202 len: 0 microversion: 2.1 time: 0.291312 Apr 08 12:01:04.481718 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2099/3035] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Apr 8 12:01:04 2022] DELETE /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780/os-volume_attachments/60702440-2066-41d6-a289-688a925e3c5c => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 08 12:01:04.490446 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1216bbc0-5520-4c38-83ec-1fcd02d084ad tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:01:04.491498 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1216bbc0-5520-4c38-83ec-1fcd02d084ad tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: b18587f1-b868-4631-9e70-86c38739a780] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:01:04.497678 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1216bbc0-5520-4c38-83ec-1fcd02d084ad tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:04.498168 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1216bbc0-5520-4c38-83ec-1fcd02d084ad tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:04.498974 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1216bbc0-5520-4c38-83ec-1fcd02d084ad tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:04.499415 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1216bbc0-5520-4c38-83ec-1fcd02d084ad tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:04.531629 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1216bbc0-5520-4c38-83ec-1fcd02d084ad tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045153 Apr 08 12:01:04.532149 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2100/3036] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 12:01:04 2022] GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 12:01:05.543455 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0ef85fbc-9d90-46d9-b8b2-cff0e8d5a145 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:01:05.544414 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0ef85fbc-9d90-46d9-b8b2-cff0e8d5a145 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: b18587f1-b868-4631-9e70-86c38739a780] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:01:05.550482 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0ef85fbc-9d90-46d9-b8b2-cff0e8d5a145 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:05.550936 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0ef85fbc-9d90-46d9-b8b2-cff0e8d5a145 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:05.551722 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0ef85fbc-9d90-46d9-b8b2-cff0e8d5a145 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:05.552164 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0ef85fbc-9d90-46d9-b8b2-cff0e8d5a145 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:05.582304 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0ef85fbc-9d90-46d9-b8b2-cff0e8d5a145 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042670 Apr 08 12:01:05.582900 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2101/3037] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 12:01:05 2022] GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 12:01:06.594939 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-846b354d-43ee-4ba0-ac1f-79a24a30cab1 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:01:06.595890 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-846b354d-43ee-4ba0-ac1f-79a24a30cab1 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: b18587f1-b868-4631-9e70-86c38739a780] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:01:06.602894 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-846b354d-43ee-4ba0-ac1f-79a24a30cab1 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:06.603351 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-846b354d-43ee-4ba0-ac1f-79a24a30cab1 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:06.604131 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-846b354d-43ee-4ba0-ac1f-79a24a30cab1 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:06.604578 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-846b354d-43ee-4ba0-ac1f-79a24a30cab1 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:06.633220 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-846b354d-43ee-4ba0-ac1f-79a24a30cab1 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042242 Apr 08 12:01:06.633809 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2102/3038] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 12:01:06 2022] GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 08 12:01:06.689751 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-86af1341-8d24-4c12-9d36-d7f85652575b tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:01:06.690269 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-86af1341-8d24-4c12-9d36-d7f85652575b tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: b18587f1-b868-4631-9e70-86c38739a780] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:01:06.696782 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-86af1341-8d24-4c12-9d36-d7f85652575b tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:06.697227 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-86af1341-8d24-4c12-9d36-d7f85652575b tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:06.698023 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-86af1341-8d24-4c12-9d36-d7f85652575b tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:06.698463 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-86af1341-8d24-4c12-9d36-d7f85652575b tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:06.721960 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-86af1341-8d24-4c12-9d36-d7f85652575b tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: b18587f1-b868-4631-9e70-86c38739a780] Going to try to terminate instance {{(pid=117800) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 08 12:01:07.009173 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-86af1341-8d24-4c12-9d36-d7f85652575b tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780" status: 204 len: 0 microversion: 2.1 time: 0.322911 Apr 08 12:01:07.009774 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2103/3039] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 8 12:01:06 2022] DELETE /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 08 12:01:07.018545 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a77fe25b-826c-4b9c-9375-986d0d3383e1 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:01:07.019293 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a77fe25b-826c-4b9c-9375-986d0d3383e1 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: b18587f1-b868-4631-9e70-86c38739a780] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:01:07.026087 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a77fe25b-826c-4b9c-9375-986d0d3383e1 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:07.029860 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a77fe25b-826c-4b9c-9375-986d0d3383e1 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:07.029860 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a77fe25b-826c-4b9c-9375-986d0d3383e1 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:07.029860 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a77fe25b-826c-4b9c-9375-986d0d3383e1 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:07.164719 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a77fe25b-826c-4b9c-9375-986d0d3383e1 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:01:07.172016 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a77fe25b-826c-4b9c-9375-986d0d3383e1 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780" status: 200 len: 1682 microversion: 2.1 time: 0.157535 Apr 08 12:01:07.172584 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2104/3040] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:01:07 2022] GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:01:08.189757 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c338ef1e-c45b-416b-9f20-98639f0d4587 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:01:08.190471 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c338ef1e-c45b-416b-9f20-98639f0d4587 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: b18587f1-b868-4631-9e70-86c38739a780] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:01:08.197425 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c338ef1e-c45b-416b-9f20-98639f0d4587 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:08.197904 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c338ef1e-c45b-416b-9f20-98639f0d4587 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:08.198730 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c338ef1e-c45b-416b-9f20-98639f0d4587 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:08.199155 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c338ef1e-c45b-416b-9f20-98639f0d4587 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:08.330808 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c338ef1e-c45b-416b-9f20-98639f0d4587 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:01:08.338167 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c338ef1e-c45b-416b-9f20-98639f0d4587 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780" status: 200 len: 1682 microversion: 2.1 time: 0.152230 Apr 08 12:01:08.338753 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2105/3041] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:01:08 2022] GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:01:09.355624 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2ed74624-71d9-4c31-b485-daeda5a159ee tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:01:09.356340 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2ed74624-71d9-4c31-b485-daeda5a159ee tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: b18587f1-b868-4631-9e70-86c38739a780] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:01:09.363046 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2ed74624-71d9-4c31-b485-daeda5a159ee tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:09.363500 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2ed74624-71d9-4c31-b485-daeda5a159ee tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:09.364339 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2ed74624-71d9-4c31-b485-daeda5a159ee tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:09.364777 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2ed74624-71d9-4c31-b485-daeda5a159ee tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:09.496892 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2ed74624-71d9-4c31-b485-daeda5a159ee tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:01:09.504354 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2ed74624-71d9-4c31-b485-daeda5a159ee tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780" status: 200 len: 1682 microversion: 2.1 time: 0.152549 Apr 08 12:01:09.504939 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2106/3042] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:01:09 2022] GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:01:10.097870 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-9e52a5f0-f0e9-4ca5-af9f-2464058b240d req-559b61c4-26dd-4b56-9926-05b51e464121 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b18587f1-b868-4631-9e70-86c38739a780", "name": "network-vif-deleted", "tag": "8befa44b-4087-4b70-a387-58cdf6b2b777"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:01:10.106283 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-9e52a5f0-f0e9-4ca5-af9f-2464058b240d req-559b61c4-26dd-4b56-9926-05b51e464121 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:10.111166 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-9e52a5f0-f0e9-4ca5-af9f-2464058b240d req-559b61c4-26dd-4b56-9926-05b51e464121 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:10.118304 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-9e52a5f0-f0e9-4ca5-af9f-2464058b240d req-559b61c4-26dd-4b56-9926-05b51e464121 service nova] Creating event network-vif-deleted:8befa44b-4087-4b70-a387-58cdf6b2b777 for instance b18587f1-b868-4631-9e70-86c38739a780 on hv-cinder-83607 Apr 08 12:01:10.123105 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-9e52a5f0-f0e9-4ca5-af9f-2464058b240d req-559b61c4-26dd-4b56-9926-05b51e464121 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029267 Apr 08 12:01:10.123724 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2107/3043] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 12:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 12:01:10.524057 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-dc7dfe10-537b-4bc6-9621-07415eef17fc tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:01:10.524859 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-dc7dfe10-537b-4bc6-9621-07415eef17fc tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: b18587f1-b868-4631-9e70-86c38739a780] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:01:10.531324 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dc7dfe10-537b-4bc6-9621-07415eef17fc tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:10.531905 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dc7dfe10-537b-4bc6-9621-07415eef17fc tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:10.532629 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dc7dfe10-537b-4bc6-9621-07415eef17fc tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:10.533068 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dc7dfe10-537b-4bc6-9621-07415eef17fc tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:10.564951 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dc7dfe10-537b-4bc6-9621-07415eef17fc tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:10.565321 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dc7dfe10-537b-4bc6-9621-07415eef17fc tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:10.565788 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-dc7dfe10-537b-4bc6-9621-07415eef17fc tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lazy-loading 'fault' on Instance uuid b18587f1-b868-4631-9e70-86c38739a780 {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 12:01:10.610193 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-dc7dfe10-537b-4bc6-9621-07415eef17fc tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:01:10.618178 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-dc7dfe10-537b-4bc6-9621-07415eef17fc tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780" status: 200 len: 1331 microversion: 2.1 time: 0.099373 Apr 08 12:01:10.618931 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2108/3044] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:01:10 2022] GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780 => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:01:11.635882 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0310a4f2-5a9e-40e8-a81f-ce3aaa4fc221 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:01:11.636569 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0310a4f2-5a9e-40e8-a81f-ce3aaa4fc221 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: b18587f1-b868-4631-9e70-86c38739a780] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:01:11.643101 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0310a4f2-5a9e-40e8-a81f-ce3aaa4fc221 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:11.643554 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0310a4f2-5a9e-40e8-a81f-ce3aaa4fc221 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:11.644330 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0310a4f2-5a9e-40e8-a81f-ce3aaa4fc221 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:11.644864 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0310a4f2-5a9e-40e8-a81f-ce3aaa4fc221 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:11.659039 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-0310a4f2-5a9e-40e8-a81f-ce3aaa4fc221 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] HTTP exception thrown: Instance b18587f1-b868-4631-9e70-86c38739a780 could not be found. Apr 08 12:01:11.659627 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0310a4f2-5a9e-40e8-a81f-ce3aaa4fc221 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Returning 404 to user: Instance b18587f1-b868-4631-9e70-86c38739a780 could not be found. {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 12:01:11.660496 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0310a4f2-5a9e-40e8-a81f-ce3aaa4fc221 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780" status: 404 len: 111 microversion: 2.1 time: 0.029011 Apr 08 12:01:11.661041 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2109/3045] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:01:11 2022] GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 12:01:11.668940 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-05d61613-f3ba-42cd-b44d-c7f9996e9bc6 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '.version_select at 0x7f041f65f3a0>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:01:11.781196 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-05d61613-f3ba-42cd-b44d-c7f9996e9bc6 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-415892961" status: 202 len: 0 microversion: 2.1 time: 0.115654 Apr 08 12:01:11.781803 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2110/3046] 10.222.0.46 () {58 vars in 1217 bytes} [Fri Apr 8 12:01:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-415892961 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 08 12:01:12.551929 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6fbdfbac-ddd1-406e-8a04-ec79c46b8ec4 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Action: 'create', calling method: .version_select at 0x7f042870b0d0>, body: {"keypair": {"name": "tempest-keypair-2015245681"}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:01:12.566429 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-6fbdfbac-ddd1-406e-8a04-ec79c46b8ec4 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Getting quotas for project 64941c642e224d3f88408dabb16d87c6. Resources: {'key_pairs'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 12:01:12.570211 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-6fbdfbac-ddd1-406e-8a04-ec79c46b8ec4 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Getting quotas for user 53044dbca5d24a1d9a67b158cede818a and project 64941c642e224d3f88408dabb16d87c6. Resources: {'key_pairs'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 12:01:12.861676 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-6fbdfbac-ddd1-406e-8a04-ec79c46b8ec4 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Getting quotas for project 64941c642e224d3f88408dabb16d87c6. Resources: {'key_pairs'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 12:01:12.865816 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-6fbdfbac-ddd1-406e-8a04-ec79c46b8ec4 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Getting quotas for user 53044dbca5d24a1d9a67b158cede818a and project 64941c642e224d3f88408dabb16d87c6. Resources: {'key_pairs'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 12:01:12.879477 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6fbdfbac-ddd1-406e-8a04-ec79c46b8ec4 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.331429 Apr 08 12:01:12.880085 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2111/3047] 10.222.0.46 () {60 vars in 1157 bytes} [Fri Apr 8 12:01:12 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:01:15.118343 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-55f1ca22-a5c5-46ee-b063-fd9d3e8868fd tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1364775672", "imageRef": "35b8d8d2-a0e9-4c3e-8586-5e088dec27e6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bcb00e23-144e-490a-8c89-75aeca201213"}], "security_groups": [{"name": "tempest-securitygroup--1467859309"}], "key_name": "tempest-keypair-2015245681", "user_data": "}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:01:15.220264 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.network.neutron [None req-55f1ca22-a5c5-46ee-b063-fd9d3e8868fd tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] validate_networks() for [('bcb00e23-144e-490a-8c89-75aeca201213', None, None, None, None, None)] {{(pid=117800) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 08 12:01:15.682909 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-55f1ca22-a5c5-46ee-b063-fd9d3e8868fd tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Flavor limits 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 12:01:15.683338 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-55f1ca22-a5c5-46ee-b063-fd9d3e8868fd tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Image limits 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 12:01:15.683833 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-55f1ca22-a5c5-46ee-b063-fd9d3e8868fd tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Flavor pref 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 12:01:15.684234 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-55f1ca22-a5c5-46ee-b063-fd9d3e8868fd tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Image pref 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 12:01:15.684652 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-55f1ca22-a5c5-46ee-b063-fd9d3e8868fd tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 12:01:15.693195 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-55f1ca22-a5c5-46ee-b063-fd9d3e8868fd tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:15.693645 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-55f1ca22-a5c5-46ee-b063-fd9d3e8868fd tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:15.694488 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-55f1ca22-a5c5-46ee-b063-fd9d3e8868fd tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:15.694928 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-55f1ca22-a5c5-46ee-b063-fd9d3e8868fd tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:15.712264 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-55f1ca22-a5c5-46ee-b063-fd9d3e8868fd tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Getting quotas for project 64941c642e224d3f88408dabb16d87c6. Resources: {'instances', 'ram', 'cores'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 12:01:15.716238 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-55f1ca22-a5c5-46ee-b063-fd9d3e8868fd tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Getting quotas for user 53044dbca5d24a1d9a67b158cede818a and project 64941c642e224d3f88408dabb16d87c6. Resources: {'instances', 'ram', 'cores'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 12:01:15.730010 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-55f1ca22-a5c5-46ee-b063-fd9d3e8868fd tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Going to run 1 instances... {{(pid=117800) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 08 12:01:15.732314 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-55f1ca22-a5c5-46ee-b063-fd9d3e8868fd tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d0d236e7-c2c0-4574-a6d7-c7351092ab7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='35b8d8d2-a0e9-4c3e-8586-5e088dec27e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 08 12:01:15.854314 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-55f1ca22-a5c5-46ee-b063-fd9d3e8868fd tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.740461 Apr 08 12:01:15.855125 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2112/3048] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Apr 8 12:01:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 08 12:01:15.866874 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e5840dc3-c173-45ab-9418-1ed3400a289b tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:01:15.867499 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e5840dc3-c173-45ab-9418-1ed3400a289b tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d0d236e7-c2c0-4574-a6d7-c7351092ab7e] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:01:15.920043 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e5840dc3-c173-45ab-9418-1ed3400a289b tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:01:15.926645 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e5840dc3-c173-45ab-9418-1ed3400a289b tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e" status: 200 len: 1242 microversion: 2.1 time: 0.064947 Apr 08 12:01:15.927219 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2113/3049] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:01:15 2022] GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e => generated 1242 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:01:16.943070 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e234408a-450e-41b6-8dab-2598eee5559b tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:01:16.943798 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e234408a-450e-41b6-8dab-2598eee5559b tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d0d236e7-c2c0-4574-a6d7-c7351092ab7e] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:01:16.951207 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e234408a-450e-41b6-8dab-2598eee5559b tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:16.951664 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e234408a-450e-41b6-8dab-2598eee5559b tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:16.952455 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e234408a-450e-41b6-8dab-2598eee5559b tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:16.952899 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e234408a-450e-41b6-8dab-2598eee5559b tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:17.015165 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e234408a-450e-41b6-8dab-2598eee5559b tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:01:17.023039 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e234408a-450e-41b6-8dab-2598eee5559b tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e" status: 200 len: 1246 microversion: 2.1 time: 0.083277 Apr 08 12:01:17.023616 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2114/3050] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:01:16 2022] GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:01:18.039179 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ab378efd-8bbb-4aaa-ba2d-15cf5905c86a tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:01:18.039823 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ab378efd-8bbb-4aaa-ba2d-15cf5905c86a tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d0d236e7-c2c0-4574-a6d7-c7351092ab7e] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:01:18.046822 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ab378efd-8bbb-4aaa-ba2d-15cf5905c86a tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:18.049078 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ab378efd-8bbb-4aaa-ba2d-15cf5905c86a tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:18.049078 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ab378efd-8bbb-4aaa-ba2d-15cf5905c86a tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:18.049078 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ab378efd-8bbb-4aaa-ba2d-15cf5905c86a tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:18.107835 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ab378efd-8bbb-4aaa-ba2d-15cf5905c86a tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:01:18.115346 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ab378efd-8bbb-4aaa-ba2d-15cf5905c86a tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e" status: 200 len: 1302 microversion: 2.1 time: 0.080091 Apr 08 12:01:18.116478 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2115/3051] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:01:18 2022] GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e => generated 1302 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:01:19.132851 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a72fe716-cdf1-4535-a6bf-32bd1e2ccb5f tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:01:19.133484 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a72fe716-cdf1-4535-a6bf-32bd1e2ccb5f tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d0d236e7-c2c0-4574-a6d7-c7351092ab7e] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:01:19.139990 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a72fe716-cdf1-4535-a6bf-32bd1e2ccb5f tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:19.140437 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a72fe716-cdf1-4535-a6bf-32bd1e2ccb5f tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:19.141207 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a72fe716-cdf1-4535-a6bf-32bd1e2ccb5f tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:19.141639 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a72fe716-cdf1-4535-a6bf-32bd1e2ccb5f tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:19.276463 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a72fe716-cdf1-4535-a6bf-32bd1e2ccb5f tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:01:19.283824 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a72fe716-cdf1-4535-a6bf-32bd1e2ccb5f tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e" status: 200 len: 1368 microversion: 2.1 time: 0.154880 Apr 08 12:01:19.284639 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2116/3052] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:01:19 2022] GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:01:19.739741 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-24b4c127-c277-4710-a549-16b20e369f4c req-889f2984-1694-424b-aa13-432fdc5b24aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0d236e7-c2c0-4574-a6d7-c7351092ab7e", "tag": "07fa8d8b-e57f-493c-b67e-40d884022e8a"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:01:19.748986 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-24b4c127-c277-4710-a549-16b20e369f4c req-889f2984-1694-424b-aa13-432fdc5b24aa service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:19.753227 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-24b4c127-c277-4710-a549-16b20e369f4c req-889f2984-1694-424b-aa13-432fdc5b24aa service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:19.761327 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-24b4c127-c277-4710-a549-16b20e369f4c req-889f2984-1694-424b-aa13-432fdc5b24aa service nova] Creating event network-changed:07fa8d8b-e57f-493c-b67e-40d884022e8a for instance d0d236e7-c2c0-4574-a6d7-c7351092ab7e on hv-cinder-83607 Apr 08 12:01:19.767762 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-24b4c127-c277-4710-a549-16b20e369f4c req-889f2984-1694-424b-aa13-432fdc5b24aa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032140 Apr 08 12:01:19.768790 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2117/3053] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 12:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:01:20.302969 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1602b4c6-dfdb-417e-8827-ffa18624dfc6 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:01:20.304296 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1602b4c6-dfdb-417e-8827-ffa18624dfc6 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d0d236e7-c2c0-4574-a6d7-c7351092ab7e] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:01:20.310365 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1602b4c6-dfdb-417e-8827-ffa18624dfc6 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:20.310835 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1602b4c6-dfdb-417e-8827-ffa18624dfc6 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:20.311595 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1602b4c6-dfdb-417e-8827-ffa18624dfc6 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:20.312034 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1602b4c6-dfdb-417e-8827-ffa18624dfc6 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:20.449850 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1602b4c6-dfdb-417e-8827-ffa18624dfc6 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:01:20.457065 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1602b4c6-dfdb-417e-8827-ffa18624dfc6 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e" status: 200 len: 1368 microversion: 2.1 time: 0.158723 Apr 08 12:01:20.457632 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2118/3054] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:01:20 2022] GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:01:21.474017 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-3169430d-e95c-478c-91c9-24a6058f02a4 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:01:21.474659 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-3169430d-e95c-478c-91c9-24a6058f02a4 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d0d236e7-c2c0-4574-a6d7-c7351092ab7e] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:01:21.481474 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3169430d-e95c-478c-91c9-24a6058f02a4 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:21.481949 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3169430d-e95c-478c-91c9-24a6058f02a4 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:21.482707 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3169430d-e95c-478c-91c9-24a6058f02a4 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:21.483202 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-3169430d-e95c-478c-91c9-24a6058f02a4 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:21.614174 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-3169430d-e95c-478c-91c9-24a6058f02a4 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:01:21.621471 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-3169430d-e95c-478c-91c9-24a6058f02a4 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e" status: 200 len: 1368 microversion: 2.1 time: 0.151464 Apr 08 12:01:21.622081 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2119/3055] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:01:21 2022] GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:01:22.638494 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-dbbf78f0-290a-4b1d-b37b-857ff3805e80 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:01:22.639172 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-dbbf78f0-290a-4b1d-b37b-857ff3805e80 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d0d236e7-c2c0-4574-a6d7-c7351092ab7e] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:01:22.645545 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dbbf78f0-290a-4b1d-b37b-857ff3805e80 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:22.646026 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dbbf78f0-290a-4b1d-b37b-857ff3805e80 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:22.646806 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dbbf78f0-290a-4b1d-b37b-857ff3805e80 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:22.647246 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dbbf78f0-290a-4b1d-b37b-857ff3805e80 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:22.778412 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-dbbf78f0-290a-4b1d-b37b-857ff3805e80 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:01:22.785671 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-dbbf78f0-290a-4b1d-b37b-857ff3805e80 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e" status: 200 len: 1368 microversion: 2.1 time: 0.151284 Apr 08 12:01:22.786283 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2120/3056] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:01:22 2022] GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:01:23.803707 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c81042a0-ca95-4614-8219-af930fe688d9 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:01:23.804396 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c81042a0-ca95-4614-8219-af930fe688d9 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d0d236e7-c2c0-4574-a6d7-c7351092ab7e] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:01:23.810778 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c81042a0-ca95-4614-8219-af930fe688d9 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:23.811231 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c81042a0-ca95-4614-8219-af930fe688d9 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:23.812044 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c81042a0-ca95-4614-8219-af930fe688d9 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:23.812483 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c81042a0-ca95-4614-8219-af930fe688d9 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:23.945671 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-c81042a0-ca95-4614-8219-af930fe688d9 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:01:23.952913 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c81042a0-ca95-4614-8219-af930fe688d9 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e" status: 200 len: 1368 microversion: 2.1 time: 0.153865 Apr 08 12:01:23.953488 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2121/3057] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:01:23 2022] GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:01:24.970390 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-db9bb2db-cf9d-4902-9527-05b9cfc1ce02 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:01:24.971029 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-db9bb2db-cf9d-4902-9527-05b9cfc1ce02 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d0d236e7-c2c0-4574-a6d7-c7351092ab7e] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:01:24.977932 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-db9bb2db-cf9d-4902-9527-05b9cfc1ce02 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:24.978456 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-db9bb2db-cf9d-4902-9527-05b9cfc1ce02 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:24.979276 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-db9bb2db-cf9d-4902-9527-05b9cfc1ce02 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:24.979755 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-db9bb2db-cf9d-4902-9527-05b9cfc1ce02 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:25.111801 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-db9bb2db-cf9d-4902-9527-05b9cfc1ce02 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:01:25.119827 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-db9bb2db-cf9d-4902-9527-05b9cfc1ce02 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e" status: 200 len: 1368 microversion: 2.1 time: 0.153405 Apr 08 12:01:25.120399 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2122/3058] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:01:24 2022] GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:01:26.136674 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-be5f5788-4697-4f6d-bf07-fcffc51096d5 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:01:26.137366 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-be5f5788-4697-4f6d-bf07-fcffc51096d5 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d0d236e7-c2c0-4574-a6d7-c7351092ab7e] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:01:26.143725 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-be5f5788-4697-4f6d-bf07-fcffc51096d5 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:26.144198 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-be5f5788-4697-4f6d-bf07-fcffc51096d5 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:26.144958 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-be5f5788-4697-4f6d-bf07-fcffc51096d5 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:26.145392 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-be5f5788-4697-4f6d-bf07-fcffc51096d5 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:26.284455 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-be5f5788-4697-4f6d-bf07-fcffc51096d5 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:01:26.294348 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-be5f5788-4697-4f6d-bf07-fcffc51096d5 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e" status: 200 len: 1368 microversion: 2.1 time: 0.161344 Apr 08 12:01:26.294933 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2123/3059] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:01:26 2022] GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:01:27.311575 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f9dad7bd-71e3-473c-9dca-98043a0ac4f2 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:01:27.312272 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f9dad7bd-71e3-473c-9dca-98043a0ac4f2 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d0d236e7-c2c0-4574-a6d7-c7351092ab7e] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:01:27.318664 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f9dad7bd-71e3-473c-9dca-98043a0ac4f2 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:27.319119 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f9dad7bd-71e3-473c-9dca-98043a0ac4f2 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:27.319892 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f9dad7bd-71e3-473c-9dca-98043a0ac4f2 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:27.320336 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f9dad7bd-71e3-473c-9dca-98043a0ac4f2 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:27.456635 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f9dad7bd-71e3-473c-9dca-98043a0ac4f2 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:01:27.463392 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f9dad7bd-71e3-473c-9dca-98043a0ac4f2 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e" status: 200 len: 1368 microversion: 2.1 time: 0.155715 Apr 08 12:01:27.463965 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2124/3060] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:01:27 2022] GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:01:27.539318 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-47b27f1e-2529-47de-bcb6-e1dbc92a12c7 req-0691d754-451b-4cc8-a3ff-801ca804bbbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0d236e7-c2c0-4574-a6d7-c7351092ab7e", "name": "network-vif-plugged", "status": "completed", "tag": "07fa8d8b-e57f-493c-b67e-40d884022e8a"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:01:27.547084 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-47b27f1e-2529-47de-bcb6-e1dbc92a12c7 req-0691d754-451b-4cc8-a3ff-801ca804bbbb service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:27.557301 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-47b27f1e-2529-47de-bcb6-e1dbc92a12c7 req-0691d754-451b-4cc8-a3ff-801ca804bbbb service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:27.558666 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-47b27f1e-2529-47de-bcb6-e1dbc92a12c7 req-0691d754-451b-4cc8-a3ff-801ca804bbbb service nova] Creating event network-vif-plugged:07fa8d8b-e57f-493c-b67e-40d884022e8a for instance d0d236e7-c2c0-4574-a6d7-c7351092ab7e on hv-cinder-83607 Apr 08 12:01:27.563632 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-47b27f1e-2529-47de-bcb6-e1dbc92a12c7 req-0691d754-451b-4cc8-a3ff-801ca804bbbb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098575 Apr 08 12:01:27.564238 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2125/3061] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 12:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:01:28.481600 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9f5a4d39-9252-4037-8f7d-615d85e526c4 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:01:28.482338 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9f5a4d39-9252-4037-8f7d-615d85e526c4 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d0d236e7-c2c0-4574-a6d7-c7351092ab7e] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:01:28.488608 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9f5a4d39-9252-4037-8f7d-615d85e526c4 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:28.489061 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9f5a4d39-9252-4037-8f7d-615d85e526c4 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:28.490365 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9f5a4d39-9252-4037-8f7d-615d85e526c4 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:28.490805 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9f5a4d39-9252-4037-8f7d-615d85e526c4 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:28.634272 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9f5a4d39-9252-4037-8f7d-615d85e526c4 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:01:28.646415 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9f5a4d39-9252-4037-8f7d-615d85e526c4 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e" status: 200 len: 1368 microversion: 2.1 time: 0.169396 Apr 08 12:01:28.647000 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2126/3062] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:01:28 2022] GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:01:29.663181 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1e60df96-8efe-4372-a104-11a88186db55 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:01:29.668022 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1e60df96-8efe-4372-a104-11a88186db55 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d0d236e7-c2c0-4574-a6d7-c7351092ab7e] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:01:29.670349 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1e60df96-8efe-4372-a104-11a88186db55 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:29.670796 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1e60df96-8efe-4372-a104-11a88186db55 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:29.671562 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1e60df96-8efe-4372-a104-11a88186db55 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:29.671995 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1e60df96-8efe-4372-a104-11a88186db55 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:29.810995 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1e60df96-8efe-4372-a104-11a88186db55 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:01:29.819152 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1e60df96-8efe-4372-a104-11a88186db55 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e" status: 200 len: 1368 microversion: 2.1 time: 0.159946 Apr 08 12:01:29.819718 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2127/3063] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:01:29 2022] GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:01:30.836665 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-192a6734-b3ca-4dcf-a275-be65935ed611 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:01:30.837372 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-192a6734-b3ca-4dcf-a275-be65935ed611 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d0d236e7-c2c0-4574-a6d7-c7351092ab7e] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:01:30.843833 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-192a6734-b3ca-4dcf-a275-be65935ed611 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:30.844379 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-192a6734-b3ca-4dcf-a275-be65935ed611 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:30.845165 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-192a6734-b3ca-4dcf-a275-be65935ed611 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:30.845609 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-192a6734-b3ca-4dcf-a275-be65935ed611 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:30.989597 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-192a6734-b3ca-4dcf-a275-be65935ed611 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:01:30.997236 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-192a6734-b3ca-4dcf-a275-be65935ed611 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e" status: 200 len: 1558 microversion: 2.1 time: 0.165015 Apr 08 12:01:30.997825 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2128/3064] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:01:30 2022] GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:01:31.013731 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-01765e5c-412d-46a3-a2ad-fa4fbf0f1c3c tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:01:31.014250 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-01765e5c-412d-46a3-a2ad-fa4fbf0f1c3c tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d0d236e7-c2c0-4574-a6d7-c7351092ab7e] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:01:31.019906 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-01765e5c-412d-46a3-a2ad-fa4fbf0f1c3c tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:31.020365 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-01765e5c-412d-46a3-a2ad-fa4fbf0f1c3c tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:31.021820 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-01765e5c-412d-46a3-a2ad-fa4fbf0f1c3c tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:31.022269 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-01765e5c-412d-46a3-a2ad-fa4fbf0f1c3c tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:31.105623 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-01765e5c-412d-46a3-a2ad-fa4fbf0f1c3c tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095710 Apr 08 12:01:31.106264 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2129/3065] 10.222.0.46 () {58 vars in 1274 bytes} [Fri Apr 8 12:01:31 2022] GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 12:01:32.442332 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-58e0bcd1-4e1d-4a42-878a-5a445a4705d3 req-be114231-7900-4359-904f-8dd84f9d9ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0d236e7-c2c0-4574-a6d7-c7351092ab7e", "tag": "07fa8d8b-e57f-493c-b67e-40d884022e8a"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:01:32.451620 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-58e0bcd1-4e1d-4a42-878a-5a445a4705d3 req-be114231-7900-4359-904f-8dd84f9d9ef7 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:01:32.452068 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-58e0bcd1-4e1d-4a42-878a-5a445a4705d3 req-be114231-7900-4359-904f-8dd84f9d9ef7 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:01:32.463470 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-58e0bcd1-4e1d-4a42-878a-5a445a4705d3 req-be114231-7900-4359-904f-8dd84f9d9ef7 service nova] Creating event network-changed:07fa8d8b-e57f-493c-b67e-40d884022e8a for instance d0d236e7-c2c0-4574-a6d7-c7351092ab7e on hv-cinder-83607 Apr 08 12:01:32.468305 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-58e0bcd1-4e1d-4a42-878a-5a445a4705d3 req-be114231-7900-4359-904f-8dd84f9d9ef7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030256 Apr 08 12:01:32.468892 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2130/3066] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 12:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:02:45.393881 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ddc9f9d1-0c6b-48b9-9f2d-c7ce0fda401f tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:02:45.395083 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ddc9f9d1-0c6b-48b9-9f2d-c7ce0fda401f tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d0d236e7-c2c0-4574-a6d7-c7351092ab7e] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:02:45.401002 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ddc9f9d1-0c6b-48b9-9f2d-c7ce0fda401f tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:02:45.401451 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ddc9f9d1-0c6b-48b9-9f2d-c7ce0fda401f tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:02:45.402235 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ddc9f9d1-0c6b-48b9-9f2d-c7ce0fda401f tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:02:45.402673 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ddc9f9d1-0c6b-48b9-9f2d-c7ce0fda401f tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:02:45.424128 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ddc9f9d1-0c6b-48b9-9f2d-c7ce0fda401f tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e/ips" status: 200 len: 150 microversion: 2.1 time: 0.083277 Apr 08 12:02:45.424676 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2131/3067] 10.222.0.46 () {58 vars in 1247 bytes} [Fri Apr 8 12:02:45 2022] GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e/ips => generated 150 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 12:02:48.100925 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-dc8beb16-c240-473f-8a84-c2923e44ffff tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eddf9d87-2156-4765-89b1-b9820590c2fc"}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:02:48.102041 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-dc8beb16-c240-473f-8a84-c2923e44ffff tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d0d236e7-c2c0-4574-a6d7-c7351092ab7e] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:02:48.108363 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dc8beb16-c240-473f-8a84-c2923e44ffff tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:02:48.108818 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dc8beb16-c240-473f-8a84-c2923e44ffff tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:02:48.109589 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dc8beb16-c240-473f-8a84-c2923e44ffff tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:02:48.110059 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-dc8beb16-c240-473f-8a84-c2923e44ffff tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:02:48.875854 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-dc8beb16-c240-473f-8a84-c2923e44ffff tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "POST /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.779252 Apr 08 12:02:48.876585 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2132/3068] 10.222.0.46 () {60 vars in 1322 bytes} [Fri Apr 8 12:02:48 2022] POST /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e/os-volume_attachments => generated 194 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 12:02:56.344288 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c4a46b6b-e852-4d17-a912-efb32672e110 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eddf9d87-2156-4765-89b1-b9820590c2fc"}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:02:56.349075 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c4a46b6b-e852-4d17-a912-efb32672e110 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d0d236e7-c2c0-4574-a6d7-c7351092ab7e] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:02:56.352146 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c4a46b6b-e852-4d17-a912-efb32672e110 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:02:56.352589 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c4a46b6b-e852-4d17-a912-efb32672e110 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:02:56.353361 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c4a46b6b-e852-4d17-a912-efb32672e110 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:02:56.353866 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c4a46b6b-e852-4d17-a912-efb32672e110 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:02:56.430011 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-c4a46b6b-e852-4d17-a912-efb32672e110 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] HTTP exception thrown: Invalid volume: volume eddf9d87-2156-4765-89b1-b9820590c2fc is already attached to instances: d0d236e7-c2c0-4574-a6d7-c7351092ab7e Apr 08 12:02:56.430620 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c4a46b6b-e852-4d17-a912-efb32672e110 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Returning 400 to user: Invalid volume: volume eddf9d87-2156-4765-89b1-b9820590c2fc is already attached to instances: d0d236e7-c2c0-4574-a6d7-c7351092ab7e {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 12:02:56.431468 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c4a46b6b-e852-4d17-a912-efb32672e110 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "POST /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.092108 Apr 08 12:02:56.432014 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2133/3069] 10.222.0.46 () {60 vars in 1322 bytes} [Fri Apr 8 12:02:56 2022] POST /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e/os-volume_attachments => generated 174 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 08 12:02:56.495706 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2f62805c-4b0f-41f7-9d70-15f70ec7efe0 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:02:56.496210 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2f62805c-4b0f-41f7-9d70-15f70ec7efe0 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d0d236e7-c2c0-4574-a6d7-c7351092ab7e] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:02:56.502120 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2f62805c-4b0f-41f7-9d70-15f70ec7efe0 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:02:56.502578 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2f62805c-4b0f-41f7-9d70-15f70ec7efe0 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:02:56.503382 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2f62805c-4b0f-41f7-9d70-15f70ec7efe0 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:02:56.503827 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2f62805c-4b0f-41f7-9d70-15f70ec7efe0 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:02:56.583479 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-2f62805c-4b0f-41f7-9d70-15f70ec7efe0 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lazy-loading 'services' on Instance uuid d0d236e7-c2c0-4574-a6d7-c7351092ab7e {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 12:02:56.841298 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2f62805c-4b0f-41f7-9d70-15f70ec7efe0 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e/os-volume_attachments/eddf9d87-2156-4765-89b1-b9820590c2fc" status: 202 len: 0 microversion: 2.1 time: 0.349217 Apr 08 12:02:56.841842 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2134/3070] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Apr 8 12:02:56 2022] DELETE /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e/os-volume_attachments/eddf9d87-2156-4765-89b1-b9820590c2fc => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 08 12:02:56.850831 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bbb55803-c827-4a07-beef-82f9b4a851e3 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:02:56.855904 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-bbb55803-c827-4a07-beef-82f9b4a851e3 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d0d236e7-c2c0-4574-a6d7-c7351092ab7e] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:02:56.858330 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bbb55803-c827-4a07-beef-82f9b4a851e3 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:02:56.858779 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bbb55803-c827-4a07-beef-82f9b4a851e3 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:02:56.859580 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bbb55803-c827-4a07-beef-82f9b4a851e3 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:02:56.860020 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-bbb55803-c827-4a07-beef-82f9b4a851e3 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:02:56.889174 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-bbb55803-c827-4a07-beef-82f9b4a851e3 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042953 Apr 08 12:02:56.889918 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2135/3071] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 12:02:56 2022] GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 12:02:57.900754 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c5f18cd6-0053-49f3-828f-a74ae2f2fbdc tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:02:57.901698 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c5f18cd6-0053-49f3-828f-a74ae2f2fbdc tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d0d236e7-c2c0-4574-a6d7-c7351092ab7e] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:02:57.908024 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c5f18cd6-0053-49f3-828f-a74ae2f2fbdc tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:02:57.908477 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c5f18cd6-0053-49f3-828f-a74ae2f2fbdc tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:02:57.909745 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c5f18cd6-0053-49f3-828f-a74ae2f2fbdc tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:02:57.910212 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c5f18cd6-0053-49f3-828f-a74ae2f2fbdc tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:02:57.938646 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c5f18cd6-0053-49f3-828f-a74ae2f2fbdc tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041923 Apr 08 12:02:57.939200 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2136/3072] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 12:02:57 2022] GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 12:02:58.950258 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-42051dfd-6d99-418c-bd65-ea49fb7aa6ce tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:02:58.951281 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-42051dfd-6d99-418c-bd65-ea49fb7aa6ce tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d0d236e7-c2c0-4574-a6d7-c7351092ab7e] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:02:58.958215 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-42051dfd-6d99-418c-bd65-ea49fb7aa6ce tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:02:58.958673 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-42051dfd-6d99-418c-bd65-ea49fb7aa6ce tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:02:58.959639 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-42051dfd-6d99-418c-bd65-ea49fb7aa6ce tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:02:58.960093 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-42051dfd-6d99-418c-bd65-ea49fb7aa6ce tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:02:58.988013 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-42051dfd-6d99-418c-bd65-ea49fb7aa6ce tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041952 Apr 08 12:02:58.988565 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2137/3073] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 12:02:58 2022] GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 08 12:02:59.043662 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-aced69cb-0246-483a-9656-a07b50afe74c tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:02:59.044170 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-aced69cb-0246-483a-9656-a07b50afe74c tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d0d236e7-c2c0-4574-a6d7-c7351092ab7e] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:02:59.049968 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aced69cb-0246-483a-9656-a07b50afe74c tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:02:59.050430 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aced69cb-0246-483a-9656-a07b50afe74c tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:02:59.051203 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aced69cb-0246-483a-9656-a07b50afe74c tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:02:59.051648 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-aced69cb-0246-483a-9656-a07b50afe74c tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:02:59.075020 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-aced69cb-0246-483a-9656-a07b50afe74c tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d0d236e7-c2c0-4574-a6d7-c7351092ab7e] Going to try to terminate instance {{(pid=117800) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 08 12:02:59.302906 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-aced69cb-0246-483a-9656-a07b50afe74c tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e" status: 204 len: 0 microversion: 2.1 time: 0.262696 Apr 08 12:02:59.303506 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2138/3074] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 8 12:02:59 2022] DELETE /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 08 12:02:59.311683 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-879f3a2f-b756-4ae9-9b6d-df8204a70593 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:02:59.312382 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-879f3a2f-b756-4ae9-9b6d-df8204a70593 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d0d236e7-c2c0-4574-a6d7-c7351092ab7e] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:02:59.318882 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-879f3a2f-b756-4ae9-9b6d-df8204a70593 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:02:59.319387 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-879f3a2f-b756-4ae9-9b6d-df8204a70593 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:02:59.320163 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-879f3a2f-b756-4ae9-9b6d-df8204a70593 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:02:59.320598 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-879f3a2f-b756-4ae9-9b6d-df8204a70593 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:02:59.450141 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-879f3a2f-b756-4ae9-9b6d-df8204a70593 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:02:59.458050 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-879f3a2f-b756-4ae9-9b6d-df8204a70593 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e" status: 200 len: 1683 microversion: 2.1 time: 0.150266 Apr 08 12:02:59.458622 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2139/3075] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:02:59 2022] GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:03:00.475588 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e6803e44-19da-49a6-a80b-406cebf3dd87 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:03:00.476251 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e6803e44-19da-49a6-a80b-406cebf3dd87 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d0d236e7-c2c0-4574-a6d7-c7351092ab7e] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:03:00.482593 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e6803e44-19da-49a6-a80b-406cebf3dd87 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:03:00.483052 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e6803e44-19da-49a6-a80b-406cebf3dd87 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:03:00.483822 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e6803e44-19da-49a6-a80b-406cebf3dd87 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:03:00.484267 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e6803e44-19da-49a6-a80b-406cebf3dd87 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:03:00.615792 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-e6803e44-19da-49a6-a80b-406cebf3dd87 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:03:00.623140 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e6803e44-19da-49a6-a80b-406cebf3dd87 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e" status: 200 len: 1683 microversion: 2.1 time: 0.151970 Apr 08 12:03:00.623709 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2140/3076] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:03:00 2022] GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:03:01.641244 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d6560d0b-fcd7-4567-b762-d563395958c0 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:03:01.642006 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-d6560d0b-fcd7-4567-b762-d563395958c0 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d0d236e7-c2c0-4574-a6d7-c7351092ab7e] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:03:01.648006 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d6560d0b-fcd7-4567-b762-d563395958c0 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:03:01.648733 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d6560d0b-fcd7-4567-b762-d563395958c0 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:03:01.649231 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d6560d0b-fcd7-4567-b762-d563395958c0 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:03:01.649669 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-d6560d0b-fcd7-4567-b762-d563395958c0 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:03:01.778880 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-d6560d0b-fcd7-4567-b762-d563395958c0 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:03:01.787009 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d6560d0b-fcd7-4567-b762-d563395958c0 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e" status: 200 len: 1683 microversion: 2.1 time: 0.150208 Apr 08 12:03:01.787630 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2141/3077] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:03:01 2022] GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:03:02.238740 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-98ac45c2-d5a0-4222-b536-853a190fed9e req-86cdf576-7934-4273-a836-5cba2d43a17c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0d236e7-c2c0-4574-a6d7-c7351092ab7e", "name": "network-vif-deleted", "tag": "07fa8d8b-e57f-493c-b67e-40d884022e8a"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:03:02.246717 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-98ac45c2-d5a0-4222-b536-853a190fed9e req-86cdf576-7934-4273-a836-5cba2d43a17c service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:03:02.248461 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-98ac45c2-d5a0-4222-b536-853a190fed9e req-86cdf576-7934-4273-a836-5cba2d43a17c service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:03:02.257852 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-98ac45c2-d5a0-4222-b536-853a190fed9e req-86cdf576-7934-4273-a836-5cba2d43a17c service nova] Creating event network-vif-deleted:07fa8d8b-e57f-493c-b67e-40d884022e8a for instance d0d236e7-c2c0-4574-a6d7-c7351092ab7e on hv-cinder-83607 Apr 08 12:03:02.262994 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-98ac45c2-d5a0-4222-b536-853a190fed9e req-86cdf576-7934-4273-a836-5cba2d43a17c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027986 Apr 08 12:03:02.263605 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2142/3078] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 12:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 12:03:02.810428 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-a019327e-bbca-4ef4-9eef-7bd5a573cce1 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:03:02.811137 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-a019327e-bbca-4ef4-9eef-7bd5a573cce1 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d0d236e7-c2c0-4574-a6d7-c7351092ab7e] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:03:02.817668 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a019327e-bbca-4ef4-9eef-7bd5a573cce1 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:03:02.818148 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a019327e-bbca-4ef4-9eef-7bd5a573cce1 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:03:02.818912 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a019327e-bbca-4ef4-9eef-7bd5a573cce1 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:03:02.819344 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a019327e-bbca-4ef4-9eef-7bd5a573cce1 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:03:02.850975 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a019327e-bbca-4ef4-9eef-7bd5a573cce1 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:03:02.856062 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-a019327e-bbca-4ef4-9eef-7bd5a573cce1 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:03:02.856062 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-a019327e-bbca-4ef4-9eef-7bd5a573cce1 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lazy-loading 'fault' on Instance uuid d0d236e7-c2c0-4574-a6d7-c7351092ab7e {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 12:03:02.893994 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-a019327e-bbca-4ef4-9eef-7bd5a573cce1 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:03:02.901739 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-a019327e-bbca-4ef4-9eef-7bd5a573cce1 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e" status: 200 len: 1332 microversion: 2.1 time: 0.096706 Apr 08 12:03:02.902507 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2143/3079] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:03:02 2022] GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e => generated 1332 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:03:03.921196 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c9b11f33-b4aa-4629-9dcd-4c1c018733a5 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:03:03.921854 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-c9b11f33-b4aa-4629-9dcd-4c1c018733a5 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d0d236e7-c2c0-4574-a6d7-c7351092ab7e] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:03:03.928686 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c9b11f33-b4aa-4629-9dcd-4c1c018733a5 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:03:03.929141 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c9b11f33-b4aa-4629-9dcd-4c1c018733a5 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:03:03.929937 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c9b11f33-b4aa-4629-9dcd-4c1c018733a5 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:03:03.930378 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-c9b11f33-b4aa-4629-9dcd-4c1c018733a5 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:03:03.943015 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-c9b11f33-b4aa-4629-9dcd-4c1c018733a5 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] HTTP exception thrown: Instance d0d236e7-c2c0-4574-a6d7-c7351092ab7e could not be found. Apr 08 12:03:03.943591 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-c9b11f33-b4aa-4629-9dcd-4c1c018733a5 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Returning 404 to user: Instance d0d236e7-c2c0-4574-a6d7-c7351092ab7e could not be found. {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 12:03:03.944469 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-c9b11f33-b4aa-4629-9dcd-4c1c018733a5 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e" status: 404 len: 111 microversion: 2.1 time: 0.027194 Apr 08 12:03:03.944977 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2144/3080] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:03:03 2022] GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 12:03:03.952615 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1d5e95c9-20d6-4477-8c34-d5c4fdb65370 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '.version_select at 0x7f041f6fc0d0>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:03:04.030973 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1d5e95c9-20d6-4477-8c34-d5c4fdb65370 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2015245681" status: 202 len: 0 microversion: 2.1 time: 0.081742 Apr 08 12:03:04.031527 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2145/3081] 10.222.0.46 () {58 vars in 1220 bytes} [Fri Apr 8 12:03:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2015245681 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 08 12:03:04.786341 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-d724f9a7-0708-434a-8c0e-8033153a6af3 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Action: 'create', calling method: .version_select at 0x7f041f676280>, body: {"keypair": {"name": "tempest-keypair-966677045"}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:03:04.800991 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-d724f9a7-0708-434a-8c0e-8033153a6af3 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Getting quotas for project 64941c642e224d3f88408dabb16d87c6. Resources: {'key_pairs'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 12:03:04.804800 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-d724f9a7-0708-434a-8c0e-8033153a6af3 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Getting quotas for user 53044dbca5d24a1d9a67b158cede818a and project 64941c642e224d3f88408dabb16d87c6. Resources: {'key_pairs'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 12:03:05.327285 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-d724f9a7-0708-434a-8c0e-8033153a6af3 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Getting quotas for project 64941c642e224d3f88408dabb16d87c6. Resources: {'key_pairs'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 12:03:05.330854 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-d724f9a7-0708-434a-8c0e-8033153a6af3 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Getting quotas for user 53044dbca5d24a1d9a67b158cede818a and project 64941c642e224d3f88408dabb16d87c6. Resources: {'key_pairs'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 12:03:05.343344 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-d724f9a7-0708-434a-8c0e-8033153a6af3 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.562863 Apr 08 12:03:05.347836 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2146/3082] 10.222.0.46 () {60 vars in 1157 bytes} [Fri Apr 8 12:03:04 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 12:03:07.408247 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-39221a03-34e3-4248-b9af-a89e65ed2931 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1756873395", "imageRef": "35b8d8d2-a0e9-4c3e-8586-5e088dec27e6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bcb00e23-144e-490a-8c89-75aeca201213"}], "security_groups": [{"name": "tempest-securitygroup--94242894"}], "key_name": "tempest-keypair-966677045", "user_data": "}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:03:07.510587 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.network.neutron [None req-39221a03-34e3-4248-b9af-a89e65ed2931 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] validate_networks() for [('bcb00e23-144e-490a-8c89-75aeca201213', None, None, None, None, None)] {{(pid=117800) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 08 12:03:07.878300 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-39221a03-34e3-4248-b9af-a89e65ed2931 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Flavor limits 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 08 12:03:07.878728 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-39221a03-34e3-4248-b9af-a89e65ed2931 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Image limits 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 08 12:03:07.879214 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-39221a03-34e3-4248-b9af-a89e65ed2931 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Flavor pref 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 08 12:03:07.879633 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-39221a03-34e3-4248-b9af-a89e65ed2931 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Image pref 0:0:0 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 08 12:03:07.880080 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.virt.hardware [None req-39221a03-34e3-4248-b9af-a89e65ed2931 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 08 12:03:07.888942 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-39221a03-34e3-4248-b9af-a89e65ed2931 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:03:07.889400 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-39221a03-34e3-4248-b9af-a89e65ed2931 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:03:07.890245 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-39221a03-34e3-4248-b9af-a89e65ed2931 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:03:07.890688 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-39221a03-34e3-4248-b9af-a89e65ed2931 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:03:07.907646 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-39221a03-34e3-4248-b9af-a89e65ed2931 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Getting quotas for project 64941c642e224d3f88408dabb16d87c6. Resources: {'instances', 'ram', 'cores'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 08 12:03:07.911520 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.quota [None req-39221a03-34e3-4248-b9af-a89e65ed2931 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Getting quotas for user 53044dbca5d24a1d9a67b158cede818a and project 64941c642e224d3f88408dabb16d87c6. Resources: {'instances', 'ram', 'cores'} {{(pid=117800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 08 12:03:07.922146 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-39221a03-34e3-4248-b9af-a89e65ed2931 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Going to run 1 instances... {{(pid=117800) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 08 12:03:07.924378 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-39221a03-34e3-4248-b9af-a89e65ed2931 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: c87e6126-77ce-4624-8ca2-cea2e2a703c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='35b8d8d2-a0e9-4c3e-8586-5e088dec27e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 08 12:03:08.058712 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-39221a03-34e3-4248-b9af-a89e65ed2931 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.654861 Apr 08 12:03:08.059353 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2147/3083] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Apr 8 12:03:07 2022] POST /compute/v2.1/servers => generated 400 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 08 12:03:08.069739 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f1ca599c-1832-460e-be8d-0aee9d78397b tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:03:08.070975 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f1ca599c-1832-460e-be8d-0aee9d78397b tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: c87e6126-77ce-4624-8ca2-cea2e2a703c6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:03:08.122603 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-f1ca599c-1832-460e-be8d-0aee9d78397b tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:03:08.129587 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f1ca599c-1832-460e-be8d-0aee9d78397b tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6" status: 200 len: 1241 microversion: 2.1 time: 0.064275 Apr 08 12:03:08.130194 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2148/3084] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:03:08 2022] GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6 => generated 1241 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:03:09.146411 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9667aefb-ace8-48d9-8c89-1cd8ecc54a1d tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:03:09.147142 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9667aefb-ace8-48d9-8c89-1cd8ecc54a1d tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: c87e6126-77ce-4624-8ca2-cea2e2a703c6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:03:09.153947 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9667aefb-ace8-48d9-8c89-1cd8ecc54a1d tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:03:09.154407 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9667aefb-ace8-48d9-8c89-1cd8ecc54a1d tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:03:09.155182 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9667aefb-ace8-48d9-8c89-1cd8ecc54a1d tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:03:09.155628 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9667aefb-ace8-48d9-8c89-1cd8ecc54a1d tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:03:09.213718 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9667aefb-ace8-48d9-8c89-1cd8ecc54a1d tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:03:09.221628 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9667aefb-ace8-48d9-8c89-1cd8ecc54a1d tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6" status: 200 len: 1245 microversion: 2.1 time: 0.078513 Apr 08 12:03:09.222476 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2149/3085] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:03:09 2022] GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6 => generated 1245 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:03:10.239043 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-7d2f0a6e-8e5c-451b-97e6-a169dbd4db10 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:03:10.239760 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-7d2f0a6e-8e5c-451b-97e6-a169dbd4db10 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: c87e6126-77ce-4624-8ca2-cea2e2a703c6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:03:10.246001 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d2f0a6e-8e5c-451b-97e6-a169dbd4db10 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:03:10.246460 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d2f0a6e-8e5c-451b-97e6-a169dbd4db10 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:03:10.247233 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d2f0a6e-8e5c-451b-97e6-a169dbd4db10 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:03:10.247675 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-7d2f0a6e-8e5c-451b-97e6-a169dbd4db10 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:03:10.310026 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-7d2f0a6e-8e5c-451b-97e6-a169dbd4db10 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:03:10.317840 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-7d2f0a6e-8e5c-451b-97e6-a169dbd4db10 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6" status: 200 len: 1301 microversion: 2.1 time: 0.083205 Apr 08 12:03:10.318422 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2150/3086] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:03:10 2022] GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6 => generated 1301 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:03:11.334759 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ea366d99-6a2e-46f5-a709-6dfd4b5d130a tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:03:11.335430 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ea366d99-6a2e-46f5-a709-6dfd4b5d130a tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: c87e6126-77ce-4624-8ca2-cea2e2a703c6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:03:11.341640 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ea366d99-6a2e-46f5-a709-6dfd4b5d130a tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:03:11.342184 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ea366d99-6a2e-46f5-a709-6dfd4b5d130a tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:03:11.342910 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ea366d99-6a2e-46f5-a709-6dfd4b5d130a tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:03:11.343353 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ea366d99-6a2e-46f5-a709-6dfd4b5d130a tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:03:11.476582 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ea366d99-6a2e-46f5-a709-6dfd4b5d130a tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:03:11.484054 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ea366d99-6a2e-46f5-a709-6dfd4b5d130a tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6" status: 200 len: 1365 microversion: 2.1 time: 0.153928 Apr 08 12:03:11.484624 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2151/3087] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:03:11 2022] GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:03:11.859245 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-ebdf8a74-d079-4d98-88c3-b7e779aeae39 req-c53f2df7-96d5-4641-b93a-c2b256a5537f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c87e6126-77ce-4624-8ca2-cea2e2a703c6", "tag": "abf3fe48-6d66-4a95-ada4-c9f66c09a896"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:03:11.868248 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-ebdf8a74-d079-4d98-88c3-b7e779aeae39 req-c53f2df7-96d5-4641-b93a-c2b256a5537f service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:03:11.868692 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-ebdf8a74-d079-4d98-88c3-b7e779aeae39 req-c53f2df7-96d5-4641-b93a-c2b256a5537f service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:03:11.881674 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-ebdf8a74-d079-4d98-88c3-b7e779aeae39 req-c53f2df7-96d5-4641-b93a-c2b256a5537f service nova] Creating event network-changed:abf3fe48-6d66-4a95-ada4-c9f66c09a896 for instance c87e6126-77ce-4624-8ca2-cea2e2a703c6 on hv-cinder-83607 Apr 08 12:03:11.886822 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-ebdf8a74-d079-4d98-88c3-b7e779aeae39 req-c53f2df7-96d5-4641-b93a-c2b256a5537f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031484 Apr 08 12:03:11.892056 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2152/3088] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 12:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 12:03:12.501669 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-42b731b2-ec02-49fa-a662-fd971f3462b3 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:03:12.502405 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-42b731b2-ec02-49fa-a662-fd971f3462b3 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: c87e6126-77ce-4624-8ca2-cea2e2a703c6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:03:12.508701 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-42b731b2-ec02-49fa-a662-fd971f3462b3 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:03:12.509226 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-42b731b2-ec02-49fa-a662-fd971f3462b3 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:03:12.510414 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-42b731b2-ec02-49fa-a662-fd971f3462b3 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:03:12.511004 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-42b731b2-ec02-49fa-a662-fd971f3462b3 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:03:12.648333 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-42b731b2-ec02-49fa-a662-fd971f3462b3 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:03:12.655795 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-42b731b2-ec02-49fa-a662-fd971f3462b3 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6" status: 200 len: 1365 microversion: 2.1 time: 0.158754 Apr 08 12:03:12.656454 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2153/3089] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:03:12 2022] GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:03:13.672940 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9f978bb8-9a19-4d4f-81b0-92347d0ab1e6 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:03:13.673540 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9f978bb8-9a19-4d4f-81b0-92347d0ab1e6 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: c87e6126-77ce-4624-8ca2-cea2e2a703c6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:03:13.680116 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9f978bb8-9a19-4d4f-81b0-92347d0ab1e6 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:03:13.680458 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9f978bb8-9a19-4d4f-81b0-92347d0ab1e6 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:03:13.681261 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9f978bb8-9a19-4d4f-81b0-92347d0ab1e6 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:03:13.681696 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9f978bb8-9a19-4d4f-81b0-92347d0ab1e6 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:03:13.808645 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-9f978bb8-9a19-4d4f-81b0-92347d0ab1e6 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:03:13.816296 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9f978bb8-9a19-4d4f-81b0-92347d0ab1e6 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6" status: 200 len: 1365 microversion: 2.1 time: 0.147179 Apr 08 12:03:13.816867 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2154/3090] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:03:13 2022] GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:03:14.832986 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-4e20f217-12be-40fb-be7b-b22bc48458a3 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:03:14.833609 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-4e20f217-12be-40fb-be7b-b22bc48458a3 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: c87e6126-77ce-4624-8ca2-cea2e2a703c6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:03:14.839966 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4e20f217-12be-40fb-be7b-b22bc48458a3 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:03:14.840424 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4e20f217-12be-40fb-be7b-b22bc48458a3 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:03:14.841195 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4e20f217-12be-40fb-be7b-b22bc48458a3 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:03:14.841640 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-4e20f217-12be-40fb-be7b-b22bc48458a3 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:03:14.985293 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-4e20f217-12be-40fb-be7b-b22bc48458a3 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:03:14.991416 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-4e20f217-12be-40fb-be7b-b22bc48458a3 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6" status: 200 len: 1365 microversion: 2.1 time: 0.162326 Apr 08 12:03:14.991986 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2155/3091] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:03:14 2022] GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:03:16.008190 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1aff8f1d-6baa-44e8-acf4-3ad487e9fc5e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:03:16.008845 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1aff8f1d-6baa-44e8-acf4-3ad487e9fc5e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: c87e6126-77ce-4624-8ca2-cea2e2a703c6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:03:16.015325 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1aff8f1d-6baa-44e8-acf4-3ad487e9fc5e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:03:16.015794 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1aff8f1d-6baa-44e8-acf4-3ad487e9fc5e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:03:16.016582 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1aff8f1d-6baa-44e8-acf4-3ad487e9fc5e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:03:16.017022 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1aff8f1d-6baa-44e8-acf4-3ad487e9fc5e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:03:16.149700 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-1aff8f1d-6baa-44e8-acf4-3ad487e9fc5e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:03:16.157640 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1aff8f1d-6baa-44e8-acf4-3ad487e9fc5e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6" status: 200 len: 1365 microversion: 2.1 time: 0.153249 Apr 08 12:03:16.158809 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2156/3092] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:03:16 2022] GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:03:17.174712 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2892fe56-803c-465f-abfa-c163f96770f4 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:03:17.175398 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2892fe56-803c-465f-abfa-c163f96770f4 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: c87e6126-77ce-4624-8ca2-cea2e2a703c6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:03:17.181691 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2892fe56-803c-465f-abfa-c163f96770f4 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:03:17.182179 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2892fe56-803c-465f-abfa-c163f96770f4 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:03:17.182950 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2892fe56-803c-465f-abfa-c163f96770f4 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:03:17.183401 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2892fe56-803c-465f-abfa-c163f96770f4 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:03:17.319877 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-2892fe56-803c-465f-abfa-c163f96770f4 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:03:17.327209 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2892fe56-803c-465f-abfa-c163f96770f4 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6" status: 200 len: 1365 microversion: 2.1 time: 0.156999 Apr 08 12:03:17.327777 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2157/3093] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:03:17 2022] GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:03:18.074420 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-ca4517cb-149b-44ee-91b4-d0c4079bc1e7 req-413954f4-399d-4c75-b123-aaff1b039424 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c87e6126-77ce-4624-8ca2-cea2e2a703c6", "name": "network-vif-plugged", "status": "completed", "tag": "abf3fe48-6d66-4a95-ada4-c9f66c09a896"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:03:18.087641 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-ca4517cb-149b-44ee-91b4-d0c4079bc1e7 req-413954f4-399d-4c75-b123-aaff1b039424 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:03:18.088093 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-ca4517cb-149b-44ee-91b4-d0c4079bc1e7 req-413954f4-399d-4c75-b123-aaff1b039424 service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:03:18.099347 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-ca4517cb-149b-44ee-91b4-d0c4079bc1e7 req-413954f4-399d-4c75-b123-aaff1b039424 service nova] Creating event network-vif-plugged:abf3fe48-6d66-4a95-ada4-c9f66c09a896 for instance c87e6126-77ce-4624-8ca2-cea2e2a703c6 on hv-cinder-83607 Apr 08 12:03:18.104186 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-ca4517cb-149b-44ee-91b4-d0c4079bc1e7 req-413954f4-399d-4c75-b123-aaff1b039424 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033466 Apr 08 12:03:18.104765 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2158/3094] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 12:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 12:03:18.345390 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-133c5f4b-c746-4d5e-926b-a7c7d51ce1b9 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:03:18.346111 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-133c5f4b-c746-4d5e-926b-a7c7d51ce1b9 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: c87e6126-77ce-4624-8ca2-cea2e2a703c6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:03:18.352185 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-133c5f4b-c746-4d5e-926b-a7c7d51ce1b9 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:03:18.353830 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-133c5f4b-c746-4d5e-926b-a7c7d51ce1b9 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:03:18.353830 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-133c5f4b-c746-4d5e-926b-a7c7d51ce1b9 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:03:18.353830 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-133c5f4b-c746-4d5e-926b-a7c7d51ce1b9 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:03:18.488869 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-133c5f4b-c746-4d5e-926b-a7c7d51ce1b9 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:03:18.496010 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-133c5f4b-c746-4d5e-926b-a7c7d51ce1b9 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6" status: 200 len: 1365 microversion: 2.1 time: 0.155326 Apr 08 12:03:18.496799 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2159/3095] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:03:18 2022] GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:03:19.513128 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-10da8a95-d56a-4796-91d4-d92641bf8fe4 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:03:19.513793 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-10da8a95-d56a-4796-91d4-d92641bf8fe4 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: c87e6126-77ce-4624-8ca2-cea2e2a703c6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:03:19.520797 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-10da8a95-d56a-4796-91d4-d92641bf8fe4 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:03:19.521256 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-10da8a95-d56a-4796-91d4-d92641bf8fe4 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:03:19.522072 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-10da8a95-d56a-4796-91d4-d92641bf8fe4 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:03:19.522519 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-10da8a95-d56a-4796-91d4-d92641bf8fe4 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:03:19.655362 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-10da8a95-d56a-4796-91d4-d92641bf8fe4 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:03:19.662619 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-10da8a95-d56a-4796-91d4-d92641bf8fe4 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6" status: 200 len: 1365 microversion: 2.1 time: 0.153598 Apr 08 12:03:19.664071 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2160/3096] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:03:19 2022] GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:03:20.683606 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ffea2fc4-1a00-4b55-899f-ad158b066b68 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:03:20.684331 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ffea2fc4-1a00-4b55-899f-ad158b066b68 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: c87e6126-77ce-4624-8ca2-cea2e2a703c6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:03:20.691496 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ffea2fc4-1a00-4b55-899f-ad158b066b68 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:03:20.691942 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ffea2fc4-1a00-4b55-899f-ad158b066b68 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:03:20.692702 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ffea2fc4-1a00-4b55-899f-ad158b066b68 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:03:20.693135 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ffea2fc4-1a00-4b55-899f-ad158b066b68 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:03:20.826895 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-ffea2fc4-1a00-4b55-899f-ad158b066b68 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:03:20.834258 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ffea2fc4-1a00-4b55-899f-ad158b066b68 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6" status: 200 len: 1554 microversion: 2.1 time: 0.154402 Apr 08 12:03:20.834827 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2161/3097] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:03:20 2022] GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:03:20.850202 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-af536696-9049-4569-8ebe-a1a90398609e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:03:20.850698 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-af536696-9049-4569-8ebe-a1a90398609e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: c87e6126-77ce-4624-8ca2-cea2e2a703c6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:03:20.856245 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-af536696-9049-4569-8ebe-a1a90398609e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:03:20.856697 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-af536696-9049-4569-8ebe-a1a90398609e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:03:20.857465 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-af536696-9049-4569-8ebe-a1a90398609e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:03:20.857952 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-af536696-9049-4569-8ebe-a1a90398609e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:03:20.937655 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-af536696-9049-4569-8ebe-a1a90398609e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090869 Apr 08 12:03:20.938291 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2162/3098] 10.222.0.46 () {58 vars in 1274 bytes} [Fri Apr 8 12:03:20 2022] GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 12:03:22.170678 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-94f69a14-1859-4577-8675-b3c1401e1f22 req-e1d88ae0-647a-462d-8759-c55d5baa9bdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c87e6126-77ce-4624-8ca2-cea2e2a703c6", "tag": "abf3fe48-6d66-4a95-ada4-c9f66c09a896"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:03:22.178663 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-94f69a14-1859-4577-8675-b3c1401e1f22 req-e1d88ae0-647a-462d-8759-c55d5baa9bdd service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:03:22.179153 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-94f69a14-1859-4577-8675-b3c1401e1f22 req-e1d88ae0-647a-462d-8759-c55d5baa9bdd service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:03:22.190454 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-94f69a14-1859-4577-8675-b3c1401e1f22 req-e1d88ae0-647a-462d-8759-c55d5baa9bdd service nova] Creating event network-changed:abf3fe48-6d66-4a95-ada4-c9f66c09a896 for instance c87e6126-77ce-4624-8ca2-cea2e2a703c6 on hv-cinder-83607 Apr 08 12:03:22.195360 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-94f69a14-1859-4577-8675-b3c1401e1f22 req-e1d88ae0-647a-462d-8759-c55d5baa9bdd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028756 Apr 08 12:03:22.195945 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2163/3099] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 12:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 12:04:37.258115 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-5ebdd2c6-1dbc-4457-8580-9fc08c92eaec tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:04:37.258953 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-5ebdd2c6-1dbc-4457-8580-9fc08c92eaec tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: c87e6126-77ce-4624-8ca2-cea2e2a703c6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:04:37.265374 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5ebdd2c6-1dbc-4457-8580-9fc08c92eaec tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:04:37.265849 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5ebdd2c6-1dbc-4457-8580-9fc08c92eaec tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:04:37.266610 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5ebdd2c6-1dbc-4457-8580-9fc08c92eaec tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:04:37.267039 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-5ebdd2c6-1dbc-4457-8580-9fc08c92eaec tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:04:37.289163 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-5ebdd2c6-1dbc-4457-8580-9fc08c92eaec tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6/ips" status: 200 len: 148 microversion: 2.1 time: 0.036320 Apr 08 12:04:37.289716 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2164/3100] 10.222.0.46 () {58 vars in 1247 bytes} [Fri Apr 8 12:04:37 2022] GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6/ips => generated 148 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 12:04:39.928575 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-f3880059-f7b9-4a62-90e5-c3c266a7f280 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4343d60a-d465-425e-ba99-560d3ba07e88"}} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:04:39.929637 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-f3880059-f7b9-4a62-90e5-c3c266a7f280 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: c87e6126-77ce-4624-8ca2-cea2e2a703c6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:04:39.935938 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f3880059-f7b9-4a62-90e5-c3c266a7f280 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:04:39.936383 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f3880059-f7b9-4a62-90e5-c3c266a7f280 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:04:39.937140 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f3880059-f7b9-4a62-90e5-c3c266a7f280 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:04:39.937569 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-f3880059-f7b9-4a62-90e5-c3c266a7f280 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:04:40.628073 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-f3880059-f7b9-4a62-90e5-c3c266a7f280 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "POST /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.703202 Apr 08 12:04:40.628740 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2165/3101] 10.222.0.46 () {60 vars in 1322 bytes} [Fri Apr 8 12:04:39 2022] POST /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6/os-volume_attachments => generated 194 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 12:04:48.193234 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2e2ec3ac-8a28-426a-ba94-2cebb5b4396f tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:04:48.193882 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2e2ec3ac-8a28-426a-ba94-2cebb5b4396f tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: c87e6126-77ce-4624-8ca2-cea2e2a703c6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:04:48.200586 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2e2ec3ac-8a28-426a-ba94-2cebb5b4396f tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:04:48.201548 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2e2ec3ac-8a28-426a-ba94-2cebb5b4396f tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:04:48.202358 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2e2ec3ac-8a28-426a-ba94-2cebb5b4396f tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:04:48.202802 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2e2ec3ac-8a28-426a-ba94-2cebb5b4396f tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:04:48.280255 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-2e2ec3ac-8a28-426a-ba94-2cebb5b4396f tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lazy-loading 'services' on Instance uuid c87e6126-77ce-4624-8ca2-cea2e2a703c6 {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 12:04:48.542584 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2e2ec3ac-8a28-426a-ba94-2cebb5b4396f tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6/os-volume_attachments/4343d60a-d465-425e-ba99-560d3ba07e88" status: 202 len: 0 microversion: 2.1 time: 0.353452 Apr 08 12:04:48.543175 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2166/3102] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Apr 8 12:04:48 2022] DELETE /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6/os-volume_attachments/4343d60a-d465-425e-ba99-560d3ba07e88 => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 08 12:04:48.552875 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-ae2cc9b5-f105-4b4c-ad2b-3a2823c5ce99 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:04:48.553988 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-ae2cc9b5-f105-4b4c-ad2b-3a2823c5ce99 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: c87e6126-77ce-4624-8ca2-cea2e2a703c6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:04:48.561029 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ae2cc9b5-f105-4b4c-ad2b-3a2823c5ce99 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:04:48.561489 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ae2cc9b5-f105-4b4c-ad2b-3a2823c5ce99 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:04:48.562338 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ae2cc9b5-f105-4b4c-ad2b-3a2823c5ce99 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:04:48.562847 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-ae2cc9b5-f105-4b4c-ad2b-3a2823c5ce99 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:04:48.591306 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-ae2cc9b5-f105-4b4c-ad2b-3a2823c5ce99 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043207 Apr 08 12:04:48.591873 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2167/3103] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 12:04:48 2022] GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 12:04:49.603074 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-0bb83a1e-b3c9-470c-840c-104da230d417 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:04:49.604007 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-0bb83a1e-b3c9-470c-840c-104da230d417 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: c87e6126-77ce-4624-8ca2-cea2e2a703c6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:04:49.610584 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0bb83a1e-b3c9-470c-840c-104da230d417 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:04:49.611032 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0bb83a1e-b3c9-470c-840c-104da230d417 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:04:49.611792 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0bb83a1e-b3c9-470c-840c-104da230d417 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:04:49.612228 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-0bb83a1e-b3c9-470c-840c-104da230d417 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:04:49.641962 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-0bb83a1e-b3c9-470c-840c-104da230d417 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042801 Apr 08 12:04:49.642742 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2168/3104] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 8 12:04:49 2022] GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 08 12:04:49.697736 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1ac55272-06fc-484d-8822-2dab8b4d1040 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:04:49.698282 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1ac55272-06fc-484d-8822-2dab8b4d1040 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: c87e6126-77ce-4624-8ca2-cea2e2a703c6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:04:49.704734 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ac55272-06fc-484d-8822-2dab8b4d1040 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:04:49.705192 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ac55272-06fc-484d-8822-2dab8b4d1040 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:04:49.706027 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ac55272-06fc-484d-8822-2dab8b4d1040 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:04:49.706471 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1ac55272-06fc-484d-8822-2dab8b4d1040 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:04:49.729670 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1ac55272-06fc-484d-8822-2dab8b4d1040 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: c87e6126-77ce-4624-8ca2-cea2e2a703c6] Going to try to terminate instance {{(pid=117800) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 08 12:04:50.030753 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1ac55272-06fc-484d-8822-2dab8b4d1040 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6" status: 204 len: 0 microversion: 2.1 time: 0.336486 Apr 08 12:04:50.031350 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2169/3105] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 8 12:04:49 2022] DELETE /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 08 12:04:50.046121 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-41b45028-7332-4a68-840e-ae05db767c70 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:04:50.046820 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-41b45028-7332-4a68-840e-ae05db767c70 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: c87e6126-77ce-4624-8ca2-cea2e2a703c6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:04:50.052662 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-41b45028-7332-4a68-840e-ae05db767c70 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:04:50.053105 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-41b45028-7332-4a68-840e-ae05db767c70 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:04:50.053903 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-41b45028-7332-4a68-840e-ae05db767c70 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:04:50.054344 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-41b45028-7332-4a68-840e-ae05db767c70 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:04:50.190023 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-41b45028-7332-4a68-840e-ae05db767c70 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:04:50.197303 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-41b45028-7332-4a68-840e-ae05db767c70 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6" status: 200 len: 1678 microversion: 2.1 time: 0.155792 Apr 08 12:04:50.199811 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2170/3106] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:04:50 2022] GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:04:51.214470 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-575f6d99-76e9-43aa-ab6b-02113d471104 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:04:51.215134 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-575f6d99-76e9-43aa-ab6b-02113d471104 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: c87e6126-77ce-4624-8ca2-cea2e2a703c6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:04:51.222227 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-575f6d99-76e9-43aa-ab6b-02113d471104 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:04:51.222386 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-575f6d99-76e9-43aa-ab6b-02113d471104 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:04:51.223121 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-575f6d99-76e9-43aa-ab6b-02113d471104 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:04:51.223618 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-575f6d99-76e9-43aa-ab6b-02113d471104 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:04:51.359778 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-575f6d99-76e9-43aa-ab6b-02113d471104 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:04:51.367043 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-575f6d99-76e9-43aa-ab6b-02113d471104 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6" status: 200 len: 1678 microversion: 2.1 time: 0.156417 Apr 08 12:04:51.367607 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2171/3107] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:04:51 2022] GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:04:52.384347 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-29eb1dda-a59f-4597-8cc5-93a94f53b34f tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:04:52.385038 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-29eb1dda-a59f-4597-8cc5-93a94f53b34f tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: c87e6126-77ce-4624-8ca2-cea2e2a703c6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:04:52.391920 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-29eb1dda-a59f-4597-8cc5-93a94f53b34f tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:04:52.392450 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-29eb1dda-a59f-4597-8cc5-93a94f53b34f tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:04:52.393312 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-29eb1dda-a59f-4597-8cc5-93a94f53b34f tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:04:52.393860 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-29eb1dda-a59f-4597-8cc5-93a94f53b34f tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:04:52.535039 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-29eb1dda-a59f-4597-8cc5-93a94f53b34f tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:04:52.544434 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-29eb1dda-a59f-4597-8cc5-93a94f53b34f tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6" status: 200 len: 1678 microversion: 2.1 time: 0.164209 Apr 08 12:04:52.554036 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2172/3108] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:04:52 2022] GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:04:53.054594 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [req-db875ca8-369f-4581-bf12-c913d622d376 req-6bc1fe25-6293-4fd4-9476-fd32c75e96ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c87e6126-77ce-4624-8ca2-cea2e2a703c6", "name": "network-vif-deleted", "tag": "abf3fe48-6d66-4a95-ada4-c9f66c09a896"}]} {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 12:04:53.063089 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-db875ca8-369f-4581-bf12-c913d622d376 req-6bc1fe25-6293-4fd4-9476-fd32c75e96ee service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:04:53.063532 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [req-db875ca8-369f-4581-bf12-c913d622d376 req-6bc1fe25-6293-4fd4-9476-fd32c75e96ee service nova] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:04:53.074499 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.compute.server_external_events [req-db875ca8-369f-4581-bf12-c913d622d376 req-6bc1fe25-6293-4fd4-9476-fd32c75e96ee service nova] Creating event network-vif-deleted:abf3fe48-6d66-4a95-ada4-c9f66c09a896 for instance c87e6126-77ce-4624-8ca2-cea2e2a703c6 on hv-cinder-83607 Apr 08 12:04:53.079424 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [req-db875ca8-369f-4581-bf12-c913d622d376 req-6bc1fe25-6293-4fd4-9476-fd32c75e96ee service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028672 Apr 08 12:04:53.080014 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2173/3109] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 8 12:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 12:04:53.563620 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-74c286ca-1f51-4475-8abe-4d62a92bbd01 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:04:53.566587 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-74c286ca-1f51-4475-8abe-4d62a92bbd01 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: c87e6126-77ce-4624-8ca2-cea2e2a703c6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:04:53.570555 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-74c286ca-1f51-4475-8abe-4d62a92bbd01 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:04:53.571010 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-74c286ca-1f51-4475-8abe-4d62a92bbd01 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:04:53.571835 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-74c286ca-1f51-4475-8abe-4d62a92bbd01 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:04:53.572282 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-74c286ca-1f51-4475-8abe-4d62a92bbd01 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:04:53.602574 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-74c286ca-1f51-4475-8abe-4d62a92bbd01 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:04:53.603024 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-74c286ca-1f51-4475-8abe-4d62a92bbd01 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:04:53.603475 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.objects.instance [None req-74c286ca-1f51-4475-8abe-4d62a92bbd01 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lazy-loading 'fault' on Instance uuid c87e6126-77ce-4624-8ca2-cea2e2a703c6 {{(pid=117800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 08 12:04:53.644443 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.policy [None req-74c286ca-1f51-4475-8abe-4d62a92bbd01 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53044dbca5d24a1d9a67b158cede818a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64941c642e224d3f88408dabb16d87c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117800) authorize /opt/stack/nova/nova/policy.py:199}} Apr 08 12:04:53.651850 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-74c286ca-1f51-4475-8abe-4d62a92bbd01 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6" status: 200 len: 1331 microversion: 2.1 time: 0.093347 Apr 08 12:04:53.652430 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2174/3110] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:04:53 2022] GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6 => generated 1331 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 12:04:54.668503 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9705c431-2a56-4e7e-bbfa-f7666c85597f tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:04:54.669638 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-9705c431-2a56-4e7e-bbfa-f7666c85597f tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: c87e6126-77ce-4624-8ca2-cea2e2a703c6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:04:54.675919 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9705c431-2a56-4e7e-bbfa-f7666c85597f tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:04:54.676369 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9705c431-2a56-4e7e-bbfa-f7666c85597f tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:04:54.677138 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9705c431-2a56-4e7e-bbfa-f7666c85597f tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:04:54.677580 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-9705c431-2a56-4e7e-bbfa-f7666c85597f tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:04:54.691027 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-9705c431-2a56-4e7e-bbfa-f7666c85597f tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] HTTP exception thrown: Instance c87e6126-77ce-4624-8ca2-cea2e2a703c6 could not be found. Apr 08 12:04:54.691620 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-9705c431-2a56-4e7e-bbfa-f7666c85597f tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Returning 404 to user: Instance c87e6126-77ce-4624-8ca2-cea2e2a703c6 could not be found. {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 12:04:54.692434 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-9705c431-2a56-4e7e-bbfa-f7666c85597f tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6" status: 404 len: 111 microversion: 2.1 time: 0.027875 Apr 08 12:04:54.692959 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2175/3111] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:04:54 2022] GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 12:04:54.700669 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-bad0585d-a572-44e8-a687-4d49cc3260da tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '.version_select at 0x7f042875dee0>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:04:54.785530 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-bad0585d-a572-44e8-a687-4d49cc3260da tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-966677045" status: 202 len: 0 microversion: 2.1 time: 0.088252 Apr 08 12:04:54.786129 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2176/3112] 10.222.0.46 () {58 vars in 1217 bytes} [Fri Apr 8 12:04:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-966677045 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 08 12:04:56.740126 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8b4c5faa-db2c-479f-a3b8-e0def4700094 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:04:56.740714 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8b4c5faa-db2c-479f-a3b8-e0def4700094 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: c87e6126-77ce-4624-8ca2-cea2e2a703c6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:04:56.746437 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8b4c5faa-db2c-479f-a3b8-e0def4700094 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:04:56.746895 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8b4c5faa-db2c-479f-a3b8-e0def4700094 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:04:56.747663 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8b4c5faa-db2c-479f-a3b8-e0def4700094 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:04:56.748107 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8b4c5faa-db2c-479f-a3b8-e0def4700094 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:04:56.761338 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-8b4c5faa-db2c-479f-a3b8-e0def4700094 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] HTTP exception thrown: Instance c87e6126-77ce-4624-8ca2-cea2e2a703c6 could not be found. Apr 08 12:04:56.761952 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8b4c5faa-db2c-479f-a3b8-e0def4700094 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Returning 404 to user: Instance c87e6126-77ce-4624-8ca2-cea2e2a703c6 could not be found. {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 12:04:56.763264 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8b4c5faa-db2c-479f-a3b8-e0def4700094 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6" status: 404 len: 111 microversion: 2.1 time: 0.026942 Apr 08 12:04:56.763786 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2177/3113] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 8 12:04:56 2022] DELETE /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 12:04:56.770937 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-febe708e-aada-44e2-ba6b-4994181fb72d tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:04:56.771541 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-febe708e-aada-44e2-ba6b-4994181fb72d tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: c87e6126-77ce-4624-8ca2-cea2e2a703c6] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:04:56.776804 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-febe708e-aada-44e2-ba6b-4994181fb72d tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:04:56.777285 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-febe708e-aada-44e2-ba6b-4994181fb72d tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:04:56.778071 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-febe708e-aada-44e2-ba6b-4994181fb72d tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:04:56.779096 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-febe708e-aada-44e2-ba6b-4994181fb72d tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:04:56.791578 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-febe708e-aada-44e2-ba6b-4994181fb72d tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] HTTP exception thrown: Instance c87e6126-77ce-4624-8ca2-cea2e2a703c6 could not be found. Apr 08 12:04:56.792157 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-febe708e-aada-44e2-ba6b-4994181fb72d tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Returning 404 to user: Instance c87e6126-77ce-4624-8ca2-cea2e2a703c6 could not be found. {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 12:04:56.792961 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-febe708e-aada-44e2-ba6b-4994181fb72d tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6" status: 404 len: 111 microversion: 2.1 time: 0.025391 Apr 08 12:04:56.793477 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2178/3114] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:04:56 2022] GET /compute/v2.1/servers/c87e6126-77ce-4624-8ca2-cea2e2a703c6 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 12:04:58.059977 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-64335a3f-2d75-4e7b-be46-1619674c5b8e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:04:58.060560 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-64335a3f-2d75-4e7b-be46-1619674c5b8e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d0d236e7-c2c0-4574-a6d7-c7351092ab7e] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:04:58.066722 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-64335a3f-2d75-4e7b-be46-1619674c5b8e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:04:58.067172 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-64335a3f-2d75-4e7b-be46-1619674c5b8e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:04:58.067932 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-64335a3f-2d75-4e7b-be46-1619674c5b8e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:04:58.068373 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-64335a3f-2d75-4e7b-be46-1619674c5b8e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:04:58.081916 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-64335a3f-2d75-4e7b-be46-1619674c5b8e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] HTTP exception thrown: Instance d0d236e7-c2c0-4574-a6d7-c7351092ab7e could not be found. Apr 08 12:04:58.082490 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-64335a3f-2d75-4e7b-be46-1619674c5b8e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Returning 404 to user: Instance d0d236e7-c2c0-4574-a6d7-c7351092ab7e could not be found. {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 12:04:58.083294 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-64335a3f-2d75-4e7b-be46-1619674c5b8e tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e" status: 404 len: 111 microversion: 2.1 time: 0.027720 Apr 08 12:04:58.083809 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2179/3115] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 8 12:04:58 2022] DELETE /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 12:04:58.091078 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2cbd76a7-b020-4241-9e3d-4eb26d560944 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:04:58.091705 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-2cbd76a7-b020-4241-9e3d-4eb26d560944 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d0d236e7-c2c0-4574-a6d7-c7351092ab7e] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:04:58.096953 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2cbd76a7-b020-4241-9e3d-4eb26d560944 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:04:58.097398 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2cbd76a7-b020-4241-9e3d-4eb26d560944 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:04:58.098195 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2cbd76a7-b020-4241-9e3d-4eb26d560944 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:04:58.098667 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-2cbd76a7-b020-4241-9e3d-4eb26d560944 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:04:58.111079 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-2cbd76a7-b020-4241-9e3d-4eb26d560944 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] HTTP exception thrown: Instance d0d236e7-c2c0-4574-a6d7-c7351092ab7e could not be found. Apr 08 12:04:58.111647 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-2cbd76a7-b020-4241-9e3d-4eb26d560944 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Returning 404 to user: Instance d0d236e7-c2c0-4574-a6d7-c7351092ab7e could not be found. {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 12:04:58.112442 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-2cbd76a7-b020-4241-9e3d-4eb26d560944 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e" status: 404 len: 111 microversion: 2.1 time: 0.024736 Apr 08 12:04:58.112949 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2180/3116] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:04:58 2022] GET /compute/v2.1/servers/d0d236e7-c2c0-4574-a6d7-c7351092ab7e => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 12:04:58.120034 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1d223e7d-063a-416d-81f0-5661d7e132e9 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:04:58.120527 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-1d223e7d-063a-416d-81f0-5661d7e132e9 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d4219023-ecd9-413c-a7a1-12c02d9a08c1] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:04:58.126316 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1d223e7d-063a-416d-81f0-5661d7e132e9 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:04:58.126767 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1d223e7d-063a-416d-81f0-5661d7e132e9 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:04:58.127516 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1d223e7d-063a-416d-81f0-5661d7e132e9 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:04:58.127952 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-1d223e7d-063a-416d-81f0-5661d7e132e9 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:04:58.141153 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-1d223e7d-063a-416d-81f0-5661d7e132e9 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] HTTP exception thrown: Instance d4219023-ecd9-413c-a7a1-12c02d9a08c1 could not be found. Apr 08 12:04:58.141719 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-1d223e7d-063a-416d-81f0-5661d7e132e9 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Returning 404 to user: Instance d4219023-ecd9-413c-a7a1-12c02d9a08c1 could not be found. {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 12:04:58.142531 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-1d223e7d-063a-416d-81f0-5661d7e132e9 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1" status: 404 len: 111 microversion: 2.1 time: 0.025863 Apr 08 12:04:58.143035 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2181/3117] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 8 12:04:58 2022] DELETE /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 12:04:58.149966 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8948bcdb-e40a-442a-95a5-fb6e50704d54 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:04:58.150571 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-8948bcdb-e40a-442a-95a5-fb6e50704d54 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: d4219023-ecd9-413c-a7a1-12c02d9a08c1] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:04:58.156302 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8948bcdb-e40a-442a-95a5-fb6e50704d54 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:04:58.156748 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8948bcdb-e40a-442a-95a5-fb6e50704d54 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:04:58.157496 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8948bcdb-e40a-442a-95a5-fb6e50704d54 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:04:58.157969 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-8948bcdb-e40a-442a-95a5-fb6e50704d54 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:04:58.170462 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-8948bcdb-e40a-442a-95a5-fb6e50704d54 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] HTTP exception thrown: Instance d4219023-ecd9-413c-a7a1-12c02d9a08c1 could not be found. Apr 08 12:04:58.171079 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-8948bcdb-e40a-442a-95a5-fb6e50704d54 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Returning 404 to user: Instance d4219023-ecd9-413c-a7a1-12c02d9a08c1 could not be found. {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 12:04:58.171876 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-8948bcdb-e40a-442a-95a5-fb6e50704d54 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1" status: 404 len: 111 microversion: 2.1 time: 0.025234 Apr 08 12:04:58.172375 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2182/3118] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:04:58 2022] GET /compute/v2.1/servers/d4219023-ecd9-413c-a7a1-12c02d9a08c1 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 12:04:59.428668 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6c0fdcc4-4bb3-4e02-a97b-4d2125a2e309 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:04:59.429267 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-6c0fdcc4-4bb3-4e02-a97b-4d2125a2e309 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: b18587f1-b868-4631-9e70-86c38739a780] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:04:59.435878 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6c0fdcc4-4bb3-4e02-a97b-4d2125a2e309 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:04:59.436322 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6c0fdcc4-4bb3-4e02-a97b-4d2125a2e309 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:04:59.437074 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6c0fdcc4-4bb3-4e02-a97b-4d2125a2e309 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:04:59.437507 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-6c0fdcc4-4bb3-4e02-a97b-4d2125a2e309 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:04:59.450882 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-6c0fdcc4-4bb3-4e02-a97b-4d2125a2e309 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] HTTP exception thrown: Instance b18587f1-b868-4631-9e70-86c38739a780 could not be found. Apr 08 12:04:59.451451 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-6c0fdcc4-4bb3-4e02-a97b-4d2125a2e309 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Returning 404 to user: Instance b18587f1-b868-4631-9e70-86c38739a780 could not be found. {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 12:04:59.452256 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-6c0fdcc4-4bb3-4e02-a97b-4d2125a2e309 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780" status: 404 len: 111 microversion: 2.1 time: 0.027421 Apr 08 12:04:59.452765 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2183/3119] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 8 12:04:59 2022] DELETE /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 12:04:59.460080 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e6c753c4-6e39-472e-8a64-e292fa7f63b2 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Calling method '>' {{(pid=117800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 12:04:59.460710 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.compute.api [None req-e6c753c4-6e39-472e-8a64-e292fa7f63b2 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] [instance: b18587f1-b868-4631-9e70-86c38739a780] Fetching instance by UUID {{(pid=117800) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 08 12:04:59.466195 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e6c753c4-6e39-472e-8a64-e292fa7f63b2 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:04:59.466639 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e6c753c4-6e39-472e-8a64-e292fa7f63b2 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:04:59.467388 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e6c753c4-6e39-472e-8a64-e292fa7f63b2 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 08 12:04:59.467818 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG oslo_concurrency.lockutils [None req-e6c753c4-6e39-472e-8a64-e292fa7f63b2 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Lock "d6edf63b-1f02-42e6-8c3b-21b0e04531ff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 08 12:04:59.481104 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.wsgi [None req-e6c753c4-6e39-472e-8a64-e292fa7f63b2 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] HTTP exception thrown: Instance b18587f1-b868-4631-9e70-86c38739a780 could not be found. Apr 08 12:04:59.481665 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: DEBUG nova.api.openstack.wsgi [None req-e6c753c4-6e39-472e-8a64-e292fa7f63b2 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] Returning 404 to user: Instance b18587f1-b868-4631-9e70-86c38739a780 could not be found. {{(pid=117800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 08 12:04:59.482490 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO nova.api.openstack.requestlog [None req-e6c753c4-6e39-472e-8a64-e292fa7f63b2 tempest-AttachVolumeNegativeTest-1031402050 tempest-AttachVolumeNegativeTest-1031402050-project] 10.222.0.46 "GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780" status: 404 len: 111 microversion: 2.1 time: 0.025897 Apr 08 12:04:59.482989 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: [pid: 117800|app: 0|req: 2184/3120] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 8 12:04:59 2022] GET /compute/v2.1/servers/b18587f1-b868-4631-9e70-86c38739a780 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 12:06:11.967961 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 12:06:11.968614 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 12:06:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 12:09:31.976021 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 12:09:31.976680 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 12:09:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 12:09:58.156371 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 12:09:58.157056 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 12:09:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 08 12:10:00.949849 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 12:10:00.950473 dv-cinder-836074-3-iscsi devstack@n-api.service[117800]: Fri Apr 8 12:10:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!